471,318 Members | 1,884 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,318 software developers and data experts.

Pulling data from a .asps site

There's a government website which shows public data for banks. We'd
like to pull the data down programmatically but the data is "hidden"
behind .aspx...

Is there anyway in Python to hook in directly to a browser (firefox or
IE) to do the following...

1) Fill the search criteria
2) Press the "Search" button
3) Press another button (the CSV button) on the resulting page
4) Then grab the data out of the notepad file that pops up

If this is a wild good chase, let me know... (or if there's a better
way besides Python... I may have to explore writing a firefox plug-in
or something)...
Nov 27 '07 #1
4 1592
---------- Forwarded message ----------
From: Todd O'Bryan <to********@gmail.com>
Date: Nov 27, 2007 1:48 PM
Subject: Re: Pulling data from a .asps site
To: ha*******@gmail.com
Check out Selenium Remote Control! It's very easy to use.
On Nov 27, 2007 1:37 PM, <ha*******@gmail.comwrote:
There's a government website which shows public data for banks. We'd
like to pull the data down programmatically but the data is "hidden"
behind .aspx...

Is there anyway in Python to hook in directly to a browser (firefox or
IE) to do the following...

1) Fill the search criteria
2) Press the "Search" button
3) Press another button (the CSV button) on the resulting page
4) Then grab the data out of the notepad file that pops up

If this is a wild good chase, let me know... (or if there's a better
way besides Python... I may have to explore writing a firefox plug-in
or something)...
--
http://mail.python.org/mailman/listinfo/python-list
Nov 27 '07 #2
On Tue, 27 Nov 2007 20:37:19 +0200, <ha*******@gmail.comwrote:
>
There's a government website which shows public data for banks. We'd
like to pull the data down programmatically but the data is "hidden"
behind .aspx...

Is there anyway in Python to hook in directly to a browser (firefox or
IE) to do the following...

1) Fill the search criteria
2) Press the "Search" button
3) Press another button (the CSV button) on the resulting page
4) Then grab the data out of the notepad file that pops up

If this is a wild good chase, let me know... (or if there's a better
way besides Python... I may have to explore writing a firefox plug-in
or something)...
Well, Python supports moving the mouse pointer so it's should be quite
simple to write such a program.
Nov 27 '07 #3
ha*******@gmail.com schrieb:
There's a government website which shows public data for banks. We'd
like to pull the data down programmatically but the data is "hidden"
behind .aspx...

Is there anyway in Python to hook in directly to a browser (firefox or
IE) to do the following...

1) Fill the search criteria
2) Press the "Search" button
3) Press another button (the CSV button) on the resulting page
4) Then grab the data out of the notepad file that pops up

If this is a wild good chase, let me know... (or if there's a better
way besides Python... I may have to explore writing a firefox plug-in
or something)...
There needs no browser to be involved - unless there is AJAX in the
game, and even then - after alle, it's all HTTP-requests.

Whichfor there are several options to work with - one popular is

http://wwwsearch.sourceforge.net/mechanize/

Diez
Nov 27 '07 #4
On 27/11/2007, ha*******@gmail.com <ha*******@gmail.comwrote:
There's a government website which shows public data for banks. We'd
like to pull the data down programmatically but the data is "hidden"
behind .aspx...

Is there anyway in Python to hook in directly to a browser (firefox or
IE) to do the following...

1) Fill the search criteria
2) Press the "Search" button
3) Press another button (the CSV button) on the resulting page
4) Then grab the data out of the notepad file that pops up

If this is a wild good chase, let me know... (or if there's a better
way besides Python... I may have to explore writing a firefox plug-in
or something)...
Amongst others, IEC will allow you to open an IE browser window,
navigate around sites (including pushing buttons), and retrieve text.

http://www.mayukhbose.com/python/IEC/index.php

HTH :)
Nov 28 '07 #5

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

3 posts views Thread by Rob Rutherford | last post: by
7 posts views Thread by colleen1980 | last post: by
3 posts views Thread by BARTHA CLIFTON | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.