By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
440,152 Members | 1,647 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 440,152 IT Pros & Developers. It's quick & easy.

Web-Site Mapping tool

P: n/a
Hi,
I am looking for a tool that will map a given web-site and list out all the
files/folders under that website.
For example, if I want to map www.voicenow.com, the tool should list all the
sub-folders, and the files within each folder at www.voicenow.com.
More importantly, I should be able to use this tool programatically (even if
the tool generates an xml document of the site map, that will be useful)
from c#.
Please let me know of any such tool you might be aware of.
Thank you.
Ashwin Kambli
Nov 15 '05 #1
Share this Question
Share on Google+
1 Reply


P: n/a
You cannot list all the files/folders of a website (unless the webserver
does a directory listing)... Think about security.

You can only crawl a site - with exposed links. For that, you have to write
your own crawler. It's not that difficult. You will have to parse an HTTP
page and strip out all links that belong to the same domain and add it to a
queue of "to-be-crawled" items. Make sure you don't go in a cyclic endless
loop.

-vJ

"Ashwin Kambli" <as****@voicenow.com> wrote in message
news:ef**************@TK2MSFTNGP11.phx.gbl...
Hi,
I am looking for a tool that will map a given web-site and list out all the files/folders under that website.
For example, if I want to map www.voicenow.com, the tool should list all the sub-folders, and the files within each folder at www.voicenow.com.
More importantly, I should be able to use this tool programatically (even if the tool generates an xml document of the site map, that will be useful)
from c#.
Please let me know of any such tool you might be aware of.
Thank you.
Ashwin Kambli

Nov 15 '05 #2

This discussion thread is closed

Replies have been disabled for this discussion.