download full sites?

[randomtalk]

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot :D

[Paul Rubin]

ra********@gmail.com writes:

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot :D

http://www.gnu.org/software/wget/wget.html
http://www.interlog.com/~tcharron/wgetwin.html

[Mike Meyer]

ra********@gmail.com writes:

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot :D

In the Tools directory of the Python script is webchecker/websucker.py
That should do what you want.

Of course, if you just want a tool to do this, wget works fine, and is
a lot more flexible.

<mike
--
Mike Meyer <mw*@mired.org> http://www.mired.org/home/mwm/
Independent WWW/Perforce/FreeBSD/Unix consultant, email for more information.

[linuxfreak]

Try curl...its pretty cool.. and also wget...

[Claudio Grondi]

ra********@gmail.com wrote:

hi, does anyone know of any package that will download a full site for
offline viewing? It will change all url to match local urls and follow
a logical structure (the site's structure would be suffice).. Please
tell me if you have heard of such a package.. thanks alot :D

I thougt, that HarvestMan
http://cheeseshop.python.org/pypi/Ha.../1.4.5%20final is THE tool
to do that. Because haven't used it yet, still dowloading with a
commercial OfflineExplorer program I have a license for, I would be glad
to hear how it compares to the other in this thread mentioned tools.

Claudio

[James]

This isn't a Python question unless you are looking for a Python
implementation.

HTTrack is one that I have used in the past as a general purpose tool.
http://www.httrack.com/

As for Python
http://harvestman.freezope.org/
I have no experience with it. I just searched in the CheeseShop.