SSL (HTTPS) with 2.4

[Bloke]

Hi all.

Some time ago (years) I had a script on Python 2.2 that would retieve a
HTTPS web site. I used python22-win32-ssl.zip to handle the SSL aspect
and it worked wonderfully. I am revisiting the project and need to
update it to Python 2.4.1. python22-win32-ssl.zip isn't compatable
(duh) and I can't find a newer version. I have had a search and can't
find anything to point me in the right direction.

Can someone please help?

[Martin v. Löwis]

Bloke wrote:

Some time ago (years) I had a script on Python 2.2 that would retieve a
HTTPS web site. I used python22-win32-ssl.zip to handle the SSL aspect
and it worked wonderfully. I am revisiting the project and need to
update it to Python 2.4.1. python22-win32-ssl.zip isn't compatable
(duh) and I can't find a newer version. I have had a search and can't
find anything to point me in the right direction.

Can someone please help?

In Python 2.4, you don't need any additional libraries to do SSL on
the HTTP client side - Python 2.4 comes with SSL included (IIRC, you
didn't need these libraries in Python 2.2, either).

Just use httplib.HTTPS or httplib.HTTPSCo nnection instead.

Regards,
Martin

[Bloke]

Thanks Martin. That means my code should work.

I am trying to go through a proxy, which works fine for HTTP sites.
However, when I try a HTTPS site, the program doesn't respond for quite
a while, and returns the error:

" File "C:\Python24\li b\urllib2.py", line 996, in do_open
raise URLError(err)
URLError: <urlopen error (8, 'EOF occurred in violation of protocol')>"

Here is my testing code:

import urllib2

proxy_info = {
'user' : 'me',
'pass' : 'mypassword',
'host' : 'proxy.mycompan y.com',
'port' : 8008 } # settings taken from web browser
# build a new opener that uses a proxy requiring authorization
proxy_support =
urllib2.ProxyHa ndler({"https": "https://%(user)s:%(pass )s@%(host)s:%(p ort)d"
% proxy_info})
opener = urllib2.build_o pener(proxy_sup port, urllib2.HTTPHan dler)

# install it
urllib2.install _opener(opener)

# use it
f = urllib2.urlopen ('https://www.directshare s.com.au')
print f.headers
f.close()

Any ideas what is wrong?

Bloke

[Bloke]

I just removed my installation of Python 2.4.1, which was the one on
the python.org web site. I installed the Activepython 2.4.1 and now I
get the following error with the same code above:

File "C:\Python24\li b\urllib2.py", line 1053, in unknown_open
raise URLError('unkno wn url type: %s' % type)
URLError: <urlopen error unknown url type: https>

I'm getting a bit frustrated. Do I need to import another library?
Any advise is appreciated.

Bloke.

[Lucas Raab]

Bloke wrote:

I just removed my installation of Python 2.4.1, which was the one on
the python.org web site. I installed the Activepython 2.4.1 and now I
get the following error with the same code above:

File "C:\Python24\li b\urllib2.py", line 1053, in unknown_open
raise URLError('unkno wn url type: %s' % type)
URLError: <urlopen error unknown url type: https>

I'm getting a bit frustrated. Do I need to import another library?
Any advise is appreciated.

Bloke.

I think it's saying it doesn't understand the HTTPS protocol based on the

raise URL error('unknown url type: %' % type)
URLError: <urlopen error unknown url type: https>

--
--------------------------
Lucas Raab
lvraab"@"earthl ink.net
dotpyFE"@"gmail .com
AIM: Phoenix11890
MSN: dotpyfe "@" gmail.com
IRC: lvraab
ICQ: 324767918
Yahoo: Phoenix11890

[Bloke]

Yes, on looking into it, sockets.ssl is not installed with
activepython, so it doesn't recognise https. So I have removed it, and
reinstalled the v 2.4.1 which I downloaded from www.python.org . This
leaves me with with the problem where the script 'hangs' for a long
time, then returns:

Traceback (most recent call last):
File "C:\Documen ts and
Settings\rhall\ Desktop\softwar e\python\auth_e xample_5.py", line 18, in
?
f = urllib2.urlopen ('https://www.directshare s.com.au/')
File "C:\Python24\Li b\urllib2.py", line 130, in urlopen
return _opener.open(ur l, data)
File "C:\Python24\Li b\urllib2.py", line 358, in open
response = self._open(req, data)
File "C:\Python24\Li b\urllib2.py", line 376, in _open
'_open', req)
File "C:\Python24\Li b\urllib2.py", line 337, in _call_chain
result = func(*args)
File "C:\Python24\Li b\urllib2.py", line 1029, in https_open
return self.do_open(ht tplib.HTTPSConn ection, req)
File "C:\Python24\Li b\urllib2.py", line 996, in do_open
raise URLError(err)
URLError: <urlopen error (8, 'EOF occurred in violation of protocol')>

I'm stuck...

[Bloke]

I just tried the https connection through a friends internet connection
which uses a transparent proxy as follows:

import urllib2
f = urllib2.urlopen ('https://www.directshare s.com.au/')
print f.headers
print f.read()
f.close()

This works fine. So it must be a problem with either the proxyhandler
(in Python) or our proxy server. Given that I can connect to the site
through the proxy with a web browser, it must be something to do with
my the way I have set up the proxy handler in python. I have read
multiple ways of setting up the connection, and this is the only way I
can get it to run with http:

import urllib2

proxy_info = {
'user' : 'me',
'pass' : 'password',
'host' : 'companyproxy.c om.au',
'port' : 8008 }

# build a new opener that uses a proxy requiring authorization
proxy_support =
urllib2.ProxyHa ndler({"http":" http://%(user)s:%(pass )s@%(host)s:%(p ort)d"
% proxy_info})
opener = urllib2.build_o pener(proxy_sup port, urllib2.HTTPHan dler)

# install it
urllib2.install _opener(opener)
Is there a better way for me to do this?

[Bloke]

Following my above comment, if my script works with http, then what is
the problem with https, even when I change the ProxyHandler to specify
https?

[Martin v. Löwis]

Bloke wrote:

Following my above comment, if my script works with http, then what is
the problem with https, even when I change the ProxyHandler to specify
https?

I believe there is a bug in the https implementations of certain Web
services, in particular the Microsoft-ish ones. They are supposed to
send a message to close the connection, but fail to do so. Instead,
they eventually shut down the connection (without sending a
CloseConnection message first).

So part of the problem is that your web server, in violation of the
protocol, just drops the connection.

The other question is why there is a period of inactivity. This, again,
may be the result of a misunderstandin g in the protocol implementations ,
of which the first problem is only a side effect (i.e. the server might
close the connection because of the inactivity).

This typically means that either side is expecting the other one to send
a message, but both sides fail to do so. Which one specifically is buggy
can only be determined by studying the messages sent back and forth in
more detail.

As a wild guess: try not to use HTTP/1.1, use HTTP/1.0 instead. To do
so, try not using urllib, use httplib directly.

Regards,
Martin

[Trent Mick]

[Bloke wrote]

I just removed my installation of Python 2.4.1, which was the one on
the python.org web site. I installed the Activepython 2.4.1 and now I
get the following error with the same code above:

File "C:\Python24\li b\urllib2.py", line 1053, in unknown_open
raise URLError('unkno wn url type: %s' % type)
URLError: <urlopen error unknown url type: https>

I'm getting a bit frustrated. Do I need to import another library?
Any advise is appreciated.

Unfortunately ActivePython cannot include the SSL library by default
because of crypto export regulations. For SSL support in an ActivePython
installation you'd have to add the _ssl.pyd extension separately (either
building it yourself, or finding an available binary).

Sincerely,
Trent

--
Trent Mick
Tr****@ActiveSt ate.com