468,457 Members | 1,748 Online
Bytes | Developer Community
New Post

Home Posts Topics Members FAQ

Post your question to a community of 468,457 developers. It's quick & easy.

Crawl a site

Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?
Jul 19 '05 #1
1 1455
Dave wrote:
Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?


Using PerlScript and the Robot module.

http://search.cpan.org/~awrigley/WWW...b/WWW/Robot.pm

Eric
Jul 19 '05 #2

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

reply views Thread by Marlo Brandon | last post: by
1 post views Thread by Danny | last post: by
2 posts views Thread by John | last post: by
7 posts views Thread by =?Utf-8?B?SklNLkgu?= | last post: by
reply views Thread by vinothPHP | last post: by
1 post views Thread by subhajit12345 | last post: by
By using this site, you agree to our Privacy Policy and Terms of Use.