<browserCaps> and NULL UserAgent

[Jason Collins]

There are some Requests that occur that have a NULL UserAgent. Some of these
are legitimate crawlers (e.g., Overture's crawler), and I'm attempting to
adjust my <browserCaps> to correctly classify crawlers.

In an attempt to capture browsers with (UserAgent == null), I've added a
case like this:

<filter>
<case match="^$">
crawler=true
</case>
</filter>

But that only seems to trap the empty string (as expected, really).

Does anyone know a way to match the null string?

Thanks,
j

[Steven Cheng[MSFT]]

Hi Jason,

Thank you for posting in community.
From your description, you're wondering how to set the browserCap' filter
so as to capture those clients whose useragent is null, yes?
Regarding on the issue, I am
finding proper resource to assist you and we will update as soon as posible.

Regards,

Steven Cheng
Microsoft Online Support

Get Secure! www.microsoft.com/security(This posting is provided "AS IS",
with no warranties, and confers no rights.)

[Jason Collins]

Yes, this is what I want to do (i.e., match clients with UserAgent==null )
j

"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message
news:zz******** ******@cpmsftng xa07.phx.gbl...

Hi Jason,

Thank you for posting in community.
From your description, you're wondering how to set the browserCap' filter
so as to capture those clients whose useragent is null, yes?
Regarding on the issue, I am
finding proper resource to assist you and we will update as soon as posible.
Regards,

Steven Cheng
Microsoft Online Support

Get Secure! www.microsoft.com/security(This posting is provided "AS IS",
with no warranties, and confers no rights.)

[Jim Cheshire [MSFT]]

Hi Jason,

I am currently researching your issue and attempting to repro. I will post
back here ASAP. It will be sometime tomorrow.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.
--------------------

From: "Jason Collins" <jc************ *@point2.com>
References: <u9************ **@TK2MSFTNGP11 .phx.gbl> <zz************ **@cpmsftngxa07 .phx.gbl>Subject: Re: <browserCaps> and NULL UserAgent
Date: Mon, 23 Feb 2004 08:54:02 -0600
Lines: 24
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
NNTP-Posting-Host: codemonkey.net 142.165.166.48
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2129 73
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet

Yes, this is what I want to do (i.e., match clients with UserAgent==null )
j

"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message
news:zz******* *******@cpmsftn gxa07.phx.gbl.. .

Hi Jason,

Thank you for posting in community.
From your description, you're wondering how to set the browserCap' filter
so as to capture those clients whose useragent is null, yes?
Regarding on the issue, I am
finding proper resource to assist you and we will update as soon as

posible.

Regards,

Steven Cheng
Microsoft Online Support

Get Secure! www.microsoft.com/security(This posting is provided "AS IS",
with no warranties, and confers no rights.)

[Jim Cheshire [MSFT]]

Hi Jason,

I'm still researching this. It's going to be a bit longer before I'll have
something for you.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

X-Tomcat-ID: 749098030
References: <u9************ **@TK2MSFTNGP11 .phx.gbl> <zz************ **@cpmsftngxa07 .phx.gbl>
<#D************ *@TK2MSFTNGP11. phx.gbl>MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
Organization : Microsoft
Date: Mon, 23 Feb 2004 23:56:52 GMT
Subject: Re: <browserCaps> and NULL UserAgent
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
Message-ID: <CR************ **@cpmsftngxa06 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
Lines: 47
Path: cpmsftngxa06.ph x.gbl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2131 35
NNTP-Posting-Host: tomcatimport2.p hx.gbl 10.201.218.182

Hi Jason,

I am currently researching your issue and attempting to repro. I will postback here ASAP. It will be sometime tomorrow.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@onlin e.microsoft.com

This post is provided as-is with no warranties and confers no rights.
--------------------

From: "Jason Collins" <jc************ *@point2.com>
References: <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz*********** ***@cpmsftngxa0 7.phx.gbl>

Subject: Re: <browserCaps> and NULL UserAgent
Date: Mon, 23 Feb 2004 08:54:02 -0600
Lines: 24
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
NNTP-Posting-Host: codemonkey.net 142.165.166.48
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2129 73
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet

Yes, this is what I want to do (i.e., match clients with UserAgent==null )
j

"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message
news:zz****** ********@cpmsft ngxa07.phx.gbl. ..

Hi Jason,

Thank you for posting in community.
From your description, you're wondering how to set the browserCap' filter so as to capture those clients whose useragent is null, yes?
Regarding on the issue, I am
finding proper resource to assist you and we will update as soon as

posible.

Regards,

Steven Cheng
Microsoft Online Support

Get Secure! www.microsoft.com/security(This posting is provided "AS IS",
with no warranties, and confers no rights.)

[Jim Cheshire [MSFT]]

Hi Jason,

I have conferred with all of the experts, and the bottom line is that this
cannot be done. You can match an empty string, but you cannot match
something that is undefined. In order to match something with RegEx, you
must first define it.

In the process of troubleshooting your issue, I was pointed at a really
cool tool that I thought I'd share with you. Here it is:

http://www.gotdotnet.com/Community/U...mpleGuid=C712F
2DF-B026-4D58-8961-4EE2729D7322

Thanks.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

X-Tomcat-ID: 713102383
References: <u9************ **@TK2MSFTNGP11 .phx.gbl> <zz************ **@cpmsftngxa07 .phx.gbl>
<#D************ *@TK2MSFTNGP11. phx.gbl>
<CR************ **@cpmsftngxa06 .phx.gbl>MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
Organization : Microsoft
Date: Tue, 24 Feb 2004 23:25:19 GMT
Subject: Re: <browserCaps> and NULL UserAgent
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
Message-ID: <l7************ **@cpmsftngxa10 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
Lines: 75
NNTP-Posting-Host: TOMCATIMPORT1 10.201.218.122
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG XA06.phx.gbl!cp msftngxa10.phx. gbl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2134 09

Hi Jason,

I'm still researching this. It's going to be a bit longer before I'll havesomething for you.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@onlin e.microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

X-Tomcat-ID: 749098030
References: <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz*********** ***@cpmsftngxa0 7.phx.gbl>
<#D*********** **@TK2MSFTNGP11 .phx.gbl>

MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
Organizatio n: Microsoft
Date: Mon, 23 Feb 2004 23:56:52 GMT
Subject: Re: <browserCaps> and NULL UserAgent
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
Message-ID: <CR************ **@cpmsftngxa06 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
Lines: 47
Path: cpmsftngxa06.ph x.gbl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2131 35
NNTP-Posting-Host: tomcatimport2.p hx.gbl 10.201.218.182

Hi Jason,

I am currently researching your issue and attempting to repro. I will

post

back here ASAP. It will be sometime tomorrow.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@onli ne.microsoft.co m

This post is provided as-is with no warranties and confers no rights.
--------------------

From: "Jason Collins" <jc************ *@point2.com>
References : <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz********** ****@cpmsftngxa 07.phx.gbl>

Subject: Re: <browserCaps> and NULL UserAgent
Date: Mon, 23 Feb 2004 08:54:02 -0600
Lines: 24
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
Newsgroups : microsoft.publi c.dotnet.framew ork.aspnet
NNTP-Posting-Host: codemonkey.net 142.165.166.48
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2129 73X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet

Yes, this is what I want to do (i.e., match clients with UserAgent==null )
j

"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message
news:zz***** *********@cpmsf tngxa07.phx.gbl ...
Hi Jason,

Thank you for posting in community.
From your description, you're wondering how to set the browserCap'filter so as to capture those clients whose useragent is null, yes?
Regarding on the issue, I am
finding proper resource to assist you and we will update as soon as
posible.

Regards,

Steven Cheng
Microsoft Online Support

Get Secure! www.microsoft.com/security(This posting is provided "AS IS", with no warranties, and confers no rights.)

[Eric Lawrence [MSFT]]

Perhaps I'm missing something. Why not just test the
Request.Headers["User-Agent"] against null?

--
Thanks,

Eric Lawrence
Program Manager
Assistance and Worldwide Services

This posting is provided "AS IS" with no warranties, and confers no rights.

"Jim Cheshire [MSFT]" <ja******@onlin e.microsoft.com > wrote in message
news:kz******** ******@cpmsftng xa06.phx.gbl...

Hi Jason,

I have conferred with all of the experts, and the bottom line is that this
cannot be done. You can match an empty string, but you cannot match
something that is undefined. In order to match something with RegEx, you
must first define it.

In the process of troubleshooting your issue, I was pointed at a really
cool tool that I thought I'd share with you. Here it is:

http://www.gotdotnet.com/Community/U...mpleGuid=C712F 2DF-B026-4D58-8961-4EE2729D7322

Thanks.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

X-Tomcat-ID: 713102383
References: <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz************ **@cpmsftngxa07 .phx.gbl>
<#D************ *@TK2MSFTNGP11. phx.gbl>
<CR************ **@cpmsftngxa06 .phx.gbl>

MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
Organization : Microsoft
Date: Tue, 24 Feb 2004 23:25:19 GMT
Subject: Re: <browserCaps> and NULL UserAgent
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
Message-ID: <l7************ **@cpmsftngxa10 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
Lines: 75
NNTP-Posting-Host: TOMCATIMPORT1 10.201.218.122
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG XA06.phx.gbl!cp msftngxa10.phx. gbl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2134 09

Hi Jason,

I'm still researching this. It's going to be a bit longer before I'll

have

something for you.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@onlin e.microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

X-Tomcat-ID: 749098030
References: <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz*********** ***@cpmsftngxa0 7.phx.gbl>
<#D*********** **@TK2MSFTNGP11 .phx.gbl>

MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
Organizatio n: Microsoft
Date: Mon, 23 Feb 2004 23:56:52 GMT
Subject: Re: <browserCaps> and NULL UserAgent
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
Message-ID: <CR************ **@cpmsftngxa06 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
Lines: 47
Path: cpmsftngxa06.ph x.gbl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2131 35NNTP-Posting-Host: tomcatimport2.p hx.gbl 10.201.218.182

Hi Jason,

I am currently researching your issue and attempting to repro. I will

post

back here ASAP. It will be sometime tomorrow.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@onli ne.microsoft.co m

This post is provided as-is with no warranties and confers no rights.
--------------------
From: "Jason Collins" <jc************ *@point2.com>
References : <u9************ **@TK2MSFTNGP11 .phx.gbl>
<zz********** ****@cpmsftngxa 07.phx.gbl>
Subject: Re: <browserCaps> and NULL UserAgent
Date: Mon, 23 Feb 2004 08:54:02 -0600
Lines: 24
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
Newsgroups : microsoft.publi c.dotnet.framew ork.aspnet
NNTP-Posting-Host: codemonkey.net 142.165.166.48
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl
Xref: cpmsftngxa06.ph x.gbl

microsoft.publi c.dotnet.framew ork.aspnet:2129 73X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet

Yes, this is what I want to do (i.e., match clients with UserAgent==null )j

"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message
news:zz***** *********@cpmsf tngxa07.phx.gbl ...
> Hi Jason,
>
> Thank you for posting in community.
> From your description, you're wondering how to set the browserCap'

filter

> so as to capture those clients whose useragent is null, yes?
> Regarding on the issue, I am
> finding proper resource to assist you and we will update as soon as
posible.
>
> Regards,
>
> Steven Cheng
> Microsoft Online Support
>
> Get Secure! www.microsoft.com/security(This posting is provided "AS IS",> with no warranties, and confers no rights.)
>

[Jason Collins]

Because I'm want to do this centrally in the machine.config' s <browserCaps>
so that it doesn't litter my code all over the place.

j
"Eric Lawrence [MSFT]" <e_********@hot mail.com> wrote in message
news:%2******** ********@TK2MSF TNGP11.phx.gbl. ..

Perhaps I'm missing something. Why not just test the
Request.Headers["User-Agent"] against null?

--
Thanks,

Eric Lawrence
Program Manager
Assistance and Worldwide Services

This posting is provided "AS IS" with no warranties, and confers no rights.
"Jim Cheshire [MSFT]" <ja******@onlin e.microsoft.com > wrote in message
news:kz******** ******@cpmsftng xa06.phx.gbl...

Hi Jason,

I have conferred with all of the experts, and the bottom line is that this

cannot be done. You can match an empty string, but you cannot match
something that is undefined. In order to match something with RegEx, you must first define it.

In the process of troubleshooting your issue, I was pointed at a really
cool tool that I thought I'd share with you. Here it is:

http://www.gotdotnet.com/Community/U...mpleGuid=C712F

2DF-B026-4D58-8961-4EE2729D7322

Thanks.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

X-Tomcat-ID: 713102383
References: <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz************ **@cpmsftngxa07 .phx.gbl>
<#D************ *@TK2MSFTNGP11. phx.gbl>
<CR************ **@cpmsftngxa06 .phx.gbl>

MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 7bit
From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
Organization : Microsoft
Date: Tue, 24 Feb 2004 23:25:19 GMT
Subject: Re: <browserCaps> and NULL UserAgent
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
Message-ID: <l7************ **@cpmsftngxa10 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
Lines: 75
NNTP-Posting-Host: TOMCATIMPORT1 10.201.218.122
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG XA06.phx.gbl!cp msftngxa10.phx. gbl
Xref: cpmsftngxa06.ph x.gbl

microsoft.publi c.dotnet.framew ork.aspnet:2134 09
Hi Jason,

I'm still researching this. It's going to be a bit longer before I'll

have

something for you.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@onlin e.microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------
>X-Tomcat-ID: 749098030
>References: <u9************ **@TK2MSFTNGP11 .phx.gbl>
<zz*********** ***@cpmsftngxa0 7.phx.gbl>
<#D*********** **@TK2MSFTNGP11 .phx.gbl>
>MIME-Version: 1.0
>Content-Type: text/plain
>Content-Transfer-Encoding: 7bit
>From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
>Organizatio n: Microsoft
>Date: Mon, 23 Feb 2004 23:56:52 GMT
>Subject: Re: <browserCaps> and NULL UserAgent
>X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
>Message-ID: <CR************ **@cpmsftngxa06 .phx.gbl>
>Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
>Lines: 47
>Path: cpmsftngxa06.ph x.gbl
>Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2131 35>NNTP-Posting-Host: tomcatimport2.p hx.gbl 10.201.218.182
>
>Hi Jason,
>
>I am currently researching your issue and attempting to repro. I will
post
>back here ASAP. It will be sometime tomorrow.
>
>Jim Cheshire, MCSE, MCSD [MSFT]
>ASP.NET
>Developer Support
>ja******@onli ne.microsoft.co m
>
>This post is provided as-is with no warranties and confers no rights.
>
>
>--------------------
>>From: "Jason Collins" <jc************ *@point2.com>
>>References : <u9************ **@TK2MSFTNGP11 .phx.gbl>
><zz********** ****@cpmsftngxa 07.phx.gbl>
>>Subject: Re: <browserCaps> and NULL UserAgent
>>Date: Mon, 23 Feb 2004 08:54:02 -0600
>>Lines: 24
>>X-Priority: 3
>>X-MSMail-Priority: Normal
>>X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
>>X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
>>Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
>>Newsgroups : microsoft.publi c.dotnet.framew ork.aspnet
>>NNTP-Posting-Host: codemonkey.net 142.165.166.48
>>Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl
>>Xref: cpmsftngxa06.ph x.gbl

microsoft.publi c.dotnet.framew ork.aspnet:2129 73

>>X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
>>
>>Yes, this is what I want to do (i.e., match clients with UserAgent==null )>>j
>>
>>"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message
>>news:zz***** *********@cpmsf tngxa07.phx.gbl ...
>>> Hi Jason,
>>>
>>> Thank you for posting in community.
>>> From your description, you're wondering how to set the browserCap'
filter
>>> so as to capture those clients whose useragent is null, yes?
>>> Regarding on the issue, I am
>>> finding proper resource to assist you and we will update as soon as
>>posible.
>>>
>>> Regards,
>>>
>>> Steven Cheng
>>> Microsoft Online Support
>>>
>>> Get Secure! www.microsoft.com/security(This posting is provided "AS

IS",

>>> with no warranties, and confers no rights.)
>>>
>>
>>
>>
>
>

[Jim Cheshire [MSFT]]

Jason,

That's just not going to be possible via the machine.config file. There is
no Regular Expression that will match a value that is not defined.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

From: "Jason Collins" <jc************ *@point2.com>
References: <u9************ **@TK2MSFTNGP11 .phx.gbl> <zz************ **@cpmsftngxa07 .phx.gbl>
<#D************ *@TK2MSFTNGP11. phx.gbl>
<CR************ **@cpmsftngxa06 .phx.gbl>
<l7************ **@cpmsftngxa10 .phx.gbl>
<kz************ **@cpmsftngxa06 .phx.gbl>
<#E************ **@TK2MSFTNGP11 .phx.gbl>Subject: Re: <browserCaps> and NULL UserAgent
Date: Thu, 26 Feb 2004 16:23:54 -0600
Lines: 175
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <eg************ **@TK2MSFTNGP09 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
NNTP-Posting-Host: codemonkey.net 142.165.166.48
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP09.phx.g bl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2140 88
X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet

Because I'm want to do this centrally in the machine.config' s <browserCaps>
so that it doesn't litter my code all over the place.

j
"Eric Lawrence [MSFT]" <e_********@hot mail.com> wrote in message
news:%2******* *********@TK2MS FTNGP11.phx.gbl ...

Perhaps I'm missing something. Why not just test the
Request.Headers["User-Agent"] against null?

--
Thanks,

Eric Lawrence
Program Manager
Assistance and Worldwide Services

This posting is provided "AS IS" with no warranties, and confers no

rights.

"Jim Cheshire [MSFT]" <ja******@onlin e.microsoft.com > wrote in message
news:kz******** ******@cpmsftng xa06.phx.gbl...

> Hi Jason,
>
> I have conferred with all of the experts, and the bottom line is thatthis > cannot be done. You can match an empty string, but you cannot match
> something that is undefined. In order to match something with RegEx,you > must first define it.
>
> In the process of troubleshooting your issue, I was pointed at a really
> cool tool that I thought I'd share with you. Here it is:
>
>

http://www.gotdotnet.com/Community/U...ampleGuid=C712

F

> 2DF-B026-4D58-8961-4EE2729D7322
>
> Thanks.
>
> Jim Cheshire, MCSE, MCSD [MSFT]
> ASP.NET
> Developer Support
> ja******@online .microsoft.com
>
> This post is provided as-is with no warranties and confers no rights.
>
> --------------------
> >X-Tomcat-ID: 713102383
> >References: <u9************ **@TK2MSFTNGP11 .phx.gbl>
> <zz************ **@cpmsftngxa07 .phx.gbl>
> <#D************ *@TK2MSFTNGP11. phx.gbl>
> <CR************ **@cpmsftngxa06 .phx.gbl>
> >MIME-Version: 1.0
> >Content-Type: text/plain
> >Content-Transfer-Encoding: 7bit
> >From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
> >Organization : Microsoft
> >Date: Tue, 24 Feb 2004 23:25:19 GMT
> >Subject: Re: <browserCaps> and NULL UserAgent
> >X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
> >Message-ID: <l7************ **@cpmsftngxa10 .phx.gbl>
> >Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
> >Lines: 75
> >NNTP-Posting-Host: TOMCATIMPORT1 10.201.218.122
> >Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG XA06.phx.gbl!cp msftngxa10.phx. gbl
> >Xref: cpmsftngxa06.ph x.gbl

microsoft.publi c.dotnet.framew ork.aspnet:2134 09

> >
> >Hi Jason,
> >
> >I'm still researching this. It's going to be a bit longer before I'll
> have
> >something for you.
> >
> >Jim Cheshire, MCSE, MCSD [MSFT]
> >ASP.NET
> >Developer Support
> >ja******@onlin e.microsoft.com
> >
> >This post is provided as-is with no warranties and confers no rights.
> >
> >--------------------
> >>X-Tomcat-ID: 749098030
> >>References: <u9************ **@TK2MSFTNGP11 .phx.gbl>
> ><zz*********** ***@cpmsftngxa0 7.phx.gbl>
> ><#D*********** **@TK2MSFTNGP11 .phx.gbl>
> >>MIME-Version: 1.0
> >>Content-Type: text/plain
> >>Content-Transfer-Encoding: 7bit
> >>From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
> >>Organizatio n: Microsoft
> >>Date: Mon, 23 Feb 2004 23:56:52 GMT
> >>Subject: Re: <browserCaps> and NULL UserAgent
> >>X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
> >>Message-ID: <CR************ **@cpmsftngxa06 .phx.gbl>
> >>Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
> >>Lines: 47
> >>Path: cpmsftngxa06.ph x.gbl
> >>Xref: cpmsftngxa06.ph x.gbl

microsoft.publi c.dotnet.framew ork.aspnet:2131 35

> >>NNTP-Posting-Host: tomcatimport2.p hx.gbl 10.201.218.182
> >>
> >>Hi Jason,
> >>
> >>I am currently researching your issue and attempting to repro. I will > >post
> >>back here ASAP. It will be sometime tomorrow.
> >>
> >>Jim Cheshire, MCSE, MCSD [MSFT]
> >>ASP.NET
> >>Developer Support
> >>ja******@onli ne.microsoft.co m
> >>
> >>This post is provided as-is with no warranties and confers no rights.
> >>
> >>
> >>--------------------
> >>>From: "Jason Collins" <jc************ *@point2.com>
> >>>References : <u9************ **@TK2MSFTNGP11 .phx.gbl>
> >><zz********** ****@cpmsftngxa 07.phx.gbl>
> >>>Subject: Re: <browserCaps> and NULL UserAgent
> >>>Date: Mon, 23 Feb 2004 08:54:02 -0600
> >>>Lines: 24
> >>>X-Priority: 3
> >>>X-MSMail-Priority: Normal
> >>>X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
> >>>X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
> >>>Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
> >>>Newsgroups : microsoft.publi c.dotnet.framew ork.aspnet
> >>>NNTP-Posting-Host: codemonkey.net 142.165.166.48
> >>>Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl
> >>>Xref: cpmsftngxa06.ph x.gbl
> microsoft.publi c.dotnet.framew ork.aspnet:2129 73
> >>>X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
> >>>
> >>>Yes, this is what I want to do (i.e., match clients with

UserAgent==null )

> >>>j
> >>>
> >>>"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message > >>>news:zz***** *********@cpmsf tngxa07.phx.gbl ...
> >>>> Hi Jason,
> >>>>
> >>>> Thank you for posting in community.
> >>>> From your description, you're wondering how to set the browserCap'
> >filter
> >>>> so as to capture those clients whose useragent is null, yes?
> >>>> Regarding on the issue, I am
> >>>> finding proper resource to assist you and we will update as soon as > >>>posible.
> >>>>
> >>>> Regards,
> >>>>
> >>>> Steven Cheng
> >>>> Microsoft Online Support
> >>>>
> >>>> Get Secure! www.microsoft.com/security(This posting is provided "AS > IS",
> >>>> with no warranties, and confers no rights.)
> >>>>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
>

[Jason Collins]

Too bad.

Can you get this feedback to the Whidbey team, as there are a growing number
of popular crawlers that are simply using NULL as their UserAgent?

It would seem that some special attribute would have to be introduced to the
<case> tag to make this match.

Thanks,
j

"Jim Cheshire [MSFT]" <ja******@onlin e.microsoft.com > wrote in message
news:46******** ********@cpmsft ngxa06.phx.gbl. ..

Jason,

That's just not going to be possible via the machine.config file. There is no Regular Expression that will match a value that is not defined.

Jim Cheshire, MCSE, MCSD [MSFT]
ASP.NET
Developer Support
ja******@online .microsoft.com

This post is provided as-is with no warranties and confers no rights.

--------------------

From: "Jason Collins" <jc************ *@point2.com>
References: <u9************ **@TK2MSFTNGP11 .phx.gbl>

<zz************ **@cpmsftngxa07 .phx.gbl>
<#D************ *@TK2MSFTNGP11. phx.gbl>
<CR************ **@cpmsftngxa06 .phx.gbl>
<l7************ **@cpmsftngxa10 .phx.gbl>
<kz************ **@cpmsftngxa06 .phx.gbl>
<#E************ **@TK2MSFTNGP11 .phx.gbl>

Subject: Re: <browserCaps> and NULL UserAgent
Date: Thu, 26 Feb 2004 16:23:54 -0600
Lines: 175
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
Message-ID: <eg************ **@TK2MSFTNGP09 .phx.gbl>
Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
NNTP-Posting-Host: codemonkey.net 142.165.166.48
Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP09.phx.g bl
Xref: cpmsftngxa06.ph x.gbl microsoft.publi c.dotnet.framew ork.aspnet:2140 88

X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet

Because I'm want to do this centrally in the machine.config' s <browserCaps>so that it doesn't litter my code all over the place.

j
"Eric Lawrence [MSFT]" <e_********@hot mail.com> wrote in message
news:%2******* *********@TK2MS FTNGP11.phx.gbl ...

Perhaps I'm missing something. Why not just test the
Request.Headers["User-Agent"] against null?

--
Thanks,

Eric Lawrence
Program Manager
Assistance and Worldwide Services

This posting is provided "AS IS" with no warranties, and confers no

rights.

"Jim Cheshire [MSFT]" <ja******@onlin e.microsoft.com > wrote in message
news:kz******** ******@cpmsftng xa06.phx.gbl...
> Hi Jason,
>
> I have conferred with all of the experts, and the bottom line is that

this

> cannot be done. You can match an empty string, but you cannot match
> something that is undefined. In order to match something with RegEx,

you

> must first define it.
>
> In the process of troubleshooting your issue, I was pointed at a really > cool tool that I thought I'd share with you. Here it is:
>
>

http://www.gotdotnet.com/Community/U...ampleGuid=C712
F > 2DF-B026-4D58-8961-4EE2729D7322
>
> Thanks.
>
> Jim Cheshire, MCSE, MCSD [MSFT]
> ASP.NET
> Developer Support
> ja******@online .microsoft.com
>
> This post is provided as-is with no warranties and confers no rights.
>
> --------------------
> >X-Tomcat-ID: 713102383
> >References: <u9************ **@TK2MSFTNGP11 .phx.gbl>
> <zz************ **@cpmsftngxa07 .phx.gbl>
> <#D************ *@TK2MSFTNGP11. phx.gbl>
> <CR************ **@cpmsftngxa06 .phx.gbl>
> >MIME-Version: 1.0
> >Content-Type: text/plain
> >Content-Transfer-Encoding: 7bit
> >From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
> >Organization : Microsoft
> >Date: Tue, 24 Feb 2004 23:25:19 GMT
> >Subject: Re: <browserCaps> and NULL UserAgent
> >X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
> >Message-ID: <l7************ **@cpmsftngxa10 .phx.gbl>
> >Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
> >Lines: 75
> >NNTP-Posting-Host: TOMCATIMPORT1 10.201.218.122
> >Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG XA06.phx.gbl!cp msftngxa10.phx. gbl > >Xref: cpmsftngxa06.ph x.gbl
microsoft.publi c.dotnet.framew ork.aspnet:2134 09
> >
> >Hi Jason,
> >
> >I'm still researching this. It's going to be a bit longer before I'll > have
> >something for you.
> >
> >Jim Cheshire, MCSE, MCSD [MSFT]
> >ASP.NET
> >Developer Support
> >ja******@onlin e.microsoft.com
> >
> >This post is provided as-is with no warranties and confers no rights. > >
> >--------------------
> >>X-Tomcat-ID: 749098030
> >>References: <u9************ **@TK2MSFTNGP11 .phx.gbl>
> ><zz*********** ***@cpmsftngxa0 7.phx.gbl>
> ><#D*********** **@TK2MSFTNGP11 .phx.gbl>
> >>MIME-Version: 1.0
> >>Content-Type: text/plain
> >>Content-Transfer-Encoding: 7bit
> >>From: ja******@online .microsoft.com (Jim Cheshire [MSFT])
> >>Organizatio n: Microsoft
> >>Date: Mon, 23 Feb 2004 23:56:52 GMT
> >>Subject: Re: <browserCaps> and NULL UserAgent
> >>X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
> >>Message-ID: <CR************ **@cpmsftngxa06 .phx.gbl>
> >>Newsgroups: microsoft.publi c.dotnet.framew ork.aspnet
> >>Lines: 47
> >>Path: cpmsftngxa06.ph x.gbl
> >>Xref: cpmsftngxa06.ph x.gbl
microsoft.publi c.dotnet.framew ork.aspnet:2131 35
> >>NNTP-Posting-Host: tomcatimport2.p hx.gbl 10.201.218.182
> >>
> >>Hi Jason,
> >>
> >>I am currently researching your issue and attempting to repro. I will > >post
> >>back here ASAP. It will be sometime tomorrow.
> >>
> >>Jim Cheshire, MCSE, MCSD [MSFT]
> >>ASP.NET
> >>Developer Support
> >>ja******@onli ne.microsoft.co m
> >>
> >>This post is provided as-is with no warranties and confers no rights. > >>
> >>
> >>--------------------
> >>>From: "Jason Collins" <jc************ *@point2.com>
> >>>References : <u9************ **@TK2MSFTNGP11 .phx.gbl>
> >><zz********** ****@cpmsftngxa 07.phx.gbl>
> >>>Subject: Re: <browserCaps> and NULL UserAgent
> >>>Date: Mon, 23 Feb 2004 08:54:02 -0600
> >>>Lines: 24
> >>>X-Priority: 3
> >>>X-MSMail-Priority: Normal
> >>>X-Newsreader: Microsoft Outlook Express 6.00.2800.1158
> >>>X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165
> >>>Message-ID: <#D************ *@TK2MSFTNGP11. phx.gbl>
> >>>Newsgroups : microsoft.publi c.dotnet.framew ork.aspnet
> >>>NNTP-Posting-Host: codemonkey.net 142.165.166.48
> >>>Path: cpmsftngxa06.ph x.gbl!TK2MSFTNG P08.phx.gbl!TK2 MSFTNGP11.phx.g bl > >>>Xref: cpmsftngxa06.ph x.gbl
> microsoft.publi c.dotnet.framew ork.aspnet:2129 73
> >>>X-Tomcat-NG: microsoft.publi c.dotnet.framew ork.aspnet
> >>>
> >>>Yes, this is what I want to do (i.e., match clients with
UserAgent==null )
> >>>j
> >>>
> >>>"Steven Cheng[MSFT]" <v-******@online.m icrosoft.com> wrote in message > >>>news:zz***** *********@cpmsf tngxa07.phx.gbl ...
> >>>> Hi Jason,
> >>>>
> >>>> Thank you for posting in community.
> >>>> From your description, you're wondering how to set the browserCap' > >filter
> >>>> so as to capture those clients whose useragent is null, yes?
> >>>> Regarding on the issue, I am
> >>>> finding proper resource to assist you and we will update as soon as > >>>posible.
> >>>>
> >>>> Regards,
> >>>>
> >>>> Steven Cheng
> >>>> Microsoft Online Support
> >>>>
> >>>> Get Secure! www.microsoft.com/security(This posting is provided "AS > IS",
> >>>> with no warranties, and confers no rights.)
> >>>>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
>