By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
444,120 Members | 1,786 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 444,120 IT Pros & Developers. It's quick & easy.

Distinguishing Crawlers

P: n/a
Hello,

Does anyone happen to have a Browsercaps update that properly sets the
Crawler attribute? I am seeing that google and others are being recognized as
browsers and not crawlers.

Thank you.
Nov 19 '05 #1
Share this Question
Share on Google+
5 Replies


P: n/a
Ian Lane .enizin.net> <ian@ wrote:
Hello,

Does anyone happen to have a Browsercaps update that properly sets the
Crawler attribute? I am seeing that google and others are being recognized as
browsers and not crawlers.

Thank you.


recognized by what?
The browscap is an outdated tech.... may want to look elsewhere

--
Curt Christianson
site: http://www.darkfalz.com
blog: http://blog.darkfalz.com
Nov 19 '05 #2

P: n/a
The machine.config browsercaps section sets the HttpBrowserCapabilities
object properties correct?

I need to know when a search engine is crawling my site so I know not to
prompt it to select a country for pricing. If there is something other than
using the Browser.Crawler property I would love to hear about it.

Thanks!

"Curt_C [MVP]" wrote:
Ian Lane .enizin.net> <ian@ wrote:
Hello,

Does anyone happen to have a Browsercaps update that properly sets the
Crawler attribute? I am seeing that google and others are being recognized as
browsers and not crawlers.

Thank you.


recognized by what?
The browscap is an outdated tech.... may want to look elsewhere

--
Curt Christianson
site: http://www.darkfalz.com
blog: http://blog.darkfalz.com

Nov 19 '05 #3

P: n/a
You might want to try adding this meta tag
to the pages you don't want crawlers/robots to index :

<META NAME="ROBOTS" CONTENT="NOINDEX">


Juan T. Llibre
ASP.NET MVP
http://asp.net.do/foros/
Foros de ASP.NET en Español
Ven, y hablemos de ASP.NET...
======================

"Ian Lane .enizin.net>" <ian@<nospam> wrote in message
news:FC**********************************@microsof t.com...
The machine.config browsercaps section sets the HttpBrowserCapabilities
object properties correct?

I need to know when a search engine is crawling my site so I know not to
prompt it to select a country for pricing. If there is something other than
using the Browser.Crawler property I would love to hear about it.

Thanks!

"Curt_C [MVP]" wrote:
Ian Lane .enizin.net> <ian@ wrote:
> Hello,
>
> Does anyone happen to have a Browsercaps update that properly sets the
> Crawler attribute? I am seeing that google and others are being recognized as
> browsers and not crawlers.
>
> Thank you.


recognized by what?
The browscap is an outdated tech.... may want to look elsewhere

--
Curt Christianson
site: http://www.darkfalz.com
blog: http://blog.darkfalz.com

Nov 19 '05 #4

P: n/a
> Hello,

Does anyone happen to have a Browsercaps update that properly sets the
Crawler attribute? I am seeing that google and others are being
recognized as browsers and not crawlers.

Thank you.


try here:

http://slingfive.com/pages/code/browserCaps/

Hans Kesting
Nov 19 '05 #5

P: n/a
Crawlers have more legs. If they have MANY more legs, they are called
"millipedes."

--
;-),

Kevin Spencer
Microsoft MVP
..Net Developer
Ambiguity has a certain quality to it.

"Ian Lane .enizin.net>" <ian@<nospam> wrote in message
news:D4**********************************@microsof t.com...
Hello,

Does anyone happen to have a Browsercaps update that properly sets the
Crawler attribute? I am seeing that google and others are being recognized
as
browsers and not crawlers.

Thank you.

Nov 19 '05 #6

This discussion thread is closed

Replies have been disabled for this discussion.