By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
432,385 Members | 847 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 432,385 IT Pros & Developers. It's quick & easy.

Why crawler don't get to my aspx page unless the Work Process is started?

P: n/a
I need HELP!!!!!
The crawler (Google or other) don't index my web site unless the web site is
currently visited
If there is nobody visiting those .aspx page therefor activating the aspnet
no crawler is going throught the site

I play with the robots file the meta tag etc.
Also played with the crawler class but no success

Sub Application_BeginRequest(ByVal sender As Object, ByVal e As EventArgs)
Try
If Request.Browser.Crawler Then
Response.Redirect("index.htm")
End If
Catch ex As Exception
End Try
End Sub

The problem with the above it always goes to the same page therefor not very
efficient

I'm running W2003 with II6 and Framework 1.1 sp1

Thanks for your help please
http://www.novadata.com

Nicolas
Nov 19 '05 #1
Share this question for a faster answer!
Share on Google+

This discussion thread is closed

Replies have been disabled for this discussion.