By using this site, you agree to our updated Privacy Policy and our Terms of Use. Manage your Cookies Settings.
449,315 Members | 1,672 Online
Bytes IT Community
+ Ask a Question
Need help? Post your question and get tips & solutions from a community of 449,315 IT Pros & Developers. It's quick & easy.

What was that web interaction library called again?

P: n/a
Hi,

I remember I came across a python library that made it radically
simple to interact with web sites, connecting to gmail and logging in
with four or five lines, for example. I thought, "that's interesting,
I must look into it sometime". Now there's this child I know who asked
me about programming, especially programs that could do things like
this, how difficult it was, and so on. I mentioned how I though Python
was a good intro to programming, and there was a library which was
perfect for what he wanted.

Only now I've forgotten the name of the library! And try as I might, I
can't find it with google. I know there are modules for it in the
standard libraries, but this thing was brilliantly simple in
comparison. It might have been some sort of research project, I can't
remember... but perhaps someone here can remind me what it was? If so,
there may be yet another young python programmer in training :-)

Jun 22 '07 #1
Share this Question
Share on Google+
6 Replies


P: n/a
Harald Korneliussen wrote:
Hi,

I remember I came across a python library that made it radically
simple to interact with web sites, connecting to gmail and logging in
with four or five lines, for example. I thought, "that's interesting,
I must look into it sometime". Now there's this child I know who asked
me about programming, especially programs that could do things like
this, how difficult it was, and so on. I mentioned how I though Python
was a good intro to programming, and there was a library which was
perfect for what he wanted.

Only now I've forgotten the name of the library! And try as I might, I
can't find it with google. I know there are modules for it in the
standard libraries, but this thing was brilliantly simple in
comparison. It might have been some sort of research project, I can't
remember... but perhaps someone here can remind me what it was? If so,
there may be yet another young python programmer in training :-)
BeautifulSoup?
--
Michael Hoffman
Jun 22 '07 #2

P: n/a
On Jun 22, 11:19 am, Harald Korneliussen <vinterm...@gmail.comwrote:
Hi,

I remember I came across a python library that made it radically
simple to interact with web sites, connecting to gmail and logging in
with four or five lines, for example. I thought, "that's interesting,
I must look into it sometime". Now there's this child I know who asked
me about programming, especially programs that could do things like
this, how difficult it was, and so on. I mentioned how I though Python
was a good intro to programming, and there was a library which was
perfect for what he wanted.
httplib2?

Jun 22 '07 #3

P: n/a
Maybe http://twill.idyll.org/

Jun 22 '07 #4

P: n/a
On Jun 22, 8:04 pm, felciano <felci...@gmail.comwrote:
Maybe http://twill.idyll.org/
That was it! Thanks, I'd googled for hours.

Jun 25 '07 #5

P: n/a
Harald Korneliussen wrote:
Hi,

I remember I came across a python library that made it radically
simple to interact with web sites, connecting to gmail and logging in
with four or five lines, for example. I thought, "that's interesting,
I must look into it sometime".
I was looking for something like this recently too. I don't believe
there is anything in the Python world quite as staggeringly
well-designed as the SimpleBrowser component nested within the
SimpleTest framework for PHP. If there is, I would like to know.

http://simpletest.sourceforge.net/en...mentation.html

Here is a code snippet:

class TestOfLastcraft extends WebTestCase {
...
function testContact() {
$this->get('http://www.lastcraft.com/');
$this->clickLink('About');
$this->assertTitle(new PatternExpectation('/About Last Craft/'));
}
}
Jun 25 '07 #6

P: n/a
Harald Korneliussen <vi********@gmail.comwrites:
Hi,

I remember I came across a python library that made it radically
simple to interact with web sites, connecting to gmail and logging in
with four or five lines, for example. I thought, "that's interesting,
I must look into it sometime". Now there's this child I know who asked
me about programming, especially programs that could do things like
this, how difficult it was, and so on. I mentioned how I though Python
was a good intro to programming, and there was a library which was
perfect for what he wanted.

Only now I've forgotten the name of the library! And try as I might, I
can't find it with google. I know there are modules for it in the
standard libraries, but this thing was brilliantly simple in
comparison. It might have been some sort of research project, I can't
remember... but perhaps someone here can remind me what it was? If so,
there may be yet another young python programmer in training :-)
Be warned that all the web scraping tools I know of expose a fairly
leaky abstraction. One has to know obscure and tiresome details
fairly often. One common culprit is lack of JavaScript support.
Another is HTML parsing problems.

Still, it's fun when it works. Test-first development is good thing,
IMHO -- make sure you don't actually have to do network stuff to test
your parsing code, for example, or the delays will get irritating
pretty fast.
John
Jun 25 '07 #7

This discussion thread is closed

Replies have been disabled for this discussion.