WebScraping

[Graham Feeley]

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham

[Steven D'Aprano]

On Sun, 05 Nov 2006 08:09:52 +1000, Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???

The definitive documentation on the built-in Python modules can be found
here: http://docs.python.org/modindex.html

The ActiveState Python cookbook should be useful, e.g.
http://aspn.activestate.com/ASPN/Coo.../Recipe/391929

Also see Beautiful Soup:
http://www.crummy.com/software/BeautifulSoup/

And of course, GIYF ("Google Is Your Friend") http://www.google.com which
leads me to:

http://sig.levillage.org/?p=588
http://sig.levillage.org/2005/03/11/...ython-part-ii/
http://wiki.tcl.tk/2915 (not focused on Python, but may still be useful).

Ultimately I would like someone to write a script for me.

Are you offering to hire a developer?
--
Steven.

[Michael Torrie]

On Sun, 2006-11-05 at 13:40 +1100, Steven D'Aprano wrote:

On Sun, 05 Nov 2006 08:09:52 +1000, Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???

The definitive documentation on the built-in Python modules can be found
here: http://docs.python.org/modindex.html

The ActiveState Python cookbook should be useful, e.g.
http://aspn.activestate.com/ASPN/Coo.../Recipe/391929

Also see Beautiful Soup:
http://www.crummy.com/software/BeautifulSoup/

Beautiful soup is not always speedy, but it sure is the most flexible
scraper I've ever came across. I hacked together a web forum-to-nntp
gateway using Beautiful Soup. Worked very well.

Michael

>
And of course, GIYF ("Google Is Your Friend") http://www.google.com which
leads me to:

http://sig.levillage.org/?p=588
http://sig.levillage.org/2005/03/11/...ython-part-ii/
http://wiki.tcl.tk/2915 (not focused on Python, but may still be useful).

Ultimately I would like someone to write a script for me.

Are you offering to hire a developer?
--
Steven.

[ina]

This might be of help to you.
http://phlik.ishpeck.net/index.php?P=a1141076600phlik

http://phlik.ishpeck.net/index.php?P=b1134168973phlik

Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham

[Bernard]

yup yup BeautifulSoup is the way to go.

what would you like to scrape by the way?

Graham Feeley wrote:

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham

[Graham Feeley]

Well I would like to publicly thank Bernard Chhun for actually writing this
script and "pretting " it up for me.
He is truly a talented guy.
He used Beautifull Soup and Regex which i am still coming to terms trying to
understand them any way Thanks again Bernard.
Regards
graham

"Graham Feeley" <gr***********@optusnet.com.auwrote in message
news:45***********************@news.optusnet.com.a u...

Can someone steer me to scripts / modules etc on webscraping please???
Ultimately I would like someone to write a script for me.
However i am still searching for documentation on this subject
Thanks Graham