Crawl a site

[Dave]

Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?

[Eric Gibson]

Dave wrote:

Is it possible to crawl a site using ASP & XML HTTP?

I know you can hit one link, but how can you go through each link in a
page and validate that it returns 200?

Using PerlScript and the Robot module.

http://search.cpan.org/~awrigley/WWW...b/WWW/Robot.pm

Eric