urllib2 meta-refresh

[Artificial Life]

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to forward
me to the intended page. Any way around this?

[Dave Brueck]

Artificial Life wrote:

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to forward
me to the intended page.
Right - urllib2 is for working with protocols (like HTTP) to transfer data,
whereas META-REFRESH is an application (browser) level "instruction" *in* that
data. Compare this to a 302 HTTP response header (a simple redirect) - urllib2
can handle it because it is part of HTTP.
Any way around this?

Sure - META-REFRESH is an instruction to the browser, so have your code be the
browser: scan the HTML for the tag, extract the URL, and send that new URL off
to urllib2.

-Dave

[JanC]

Artificial Life schreef:

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to
forward me to the intended page. Any way around this?

Have a look at the HTTPRefreshProcessor in ClientCookie:
<http://wwwsearch.sourceforge.net/ClientCookie/doc.html>

--
JanC

"Be strict when sending and tolerant when receiving."
RFC 1958 - Architectural Principles of the Internet - section 3.9

[John J. Lee]

JanC <us*********@janc.invalid> writes:

Artificial Life schreef:

urllib2 does not seem to be able to handle META-REFRESH in an html
document. I just get back the html to the page that is supposed to
forward me to the intended page. Any way around this?

Have a look at the HTTPRefreshProcessor in ClientCookie:
<http://wwwsearch.sourceforge.net/ClientCookie/doc.html>

Be sure to read all the notes under "Notes about ClientCookie, urllib2
and cookielib" on this page:

http://wwwsearch.sourceforge.net/ClientCookie/
John