By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
440,320 Members | 2,109 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 440,320 IT Pros & Developers. It's quick & easy.

Problems with crawlers

P: n/a
I try to trace users on my web page

In global.asax.cs on Application_BeginRequest I check if user has my cookie,
if not I give him new cookie (integer identity number from database). When
session ends I save in database some information (names of pages he
visited). I don't want to save what crawlers (Google, yahoo.) do on my page,
but don't know how to do that.

I have one more problem with crawlers; some of them come to my site with
wrong query string. My web site is multilingual and typically my pages looks
like this page1.aspx?id=123&lang=en, page2.aspx?id=4&lang=fr etc., but some
crawlers come to my site with page.aspx?id =1&lang=en?lang=de or
page2? Id=3&lang=en?lang=en?lang=hr and I don't know how to
avoid this.
Nov 19 '05 #1
Share this question for a faster answer!
Share on Google+

This discussion thread is closed

Replies have been disabled for this discussion.