473,383 Members | 1,737 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,383 software developers and data experts.

deliberate versus os socket timeout

While messing about with some deliberate socket timeout code I got an unexpected
timeout after 20 seconds when my code was doing socket.setdefaulttimeout(120).

Closer inspection revealed that this error in fact seemed to come from the os
(in this case windows xp).

By inspection of test cases the error.reason from the deliberate socket timeout
looks like
'timed out'
whereas the windows caused timeout error.reason looks like
'(10060 operation timed out)'

it would be nice to know if that is in fact true and whether there is any way to
do the attribution of errors more sensibly.

Both of these seem to cause urllib2.URLError and presumably appear somewhere in
the socket code.

It might be nice if the deliberate timeout could be something like 'timed out
deliberately after xxx seconds'.

More importantly is there anything I can do to avoid these wrong os inspired
timeouts? I'm just using urllib2 to read from a remote site inside of a cgi
script. I'm not sure it's a big problem, but I have no idea what could cause it.

The code I'm using is based on one of jjlee's recipes

def httpGet(self):
import urllib2, socket
from xml.sax.saxutils import escape
oto = socket.getdefaulttimeout()
try:
socket.setdefaulttimeout(self.timeout)
self.url = url = self.makeUrl(self.params)
try:
self.response = r = urllib2.urlopen(url)
except urllib2.URLError, e:
if hasattr(e, 'reason'):
msg = 'HTTP error '+str(e.reason)
if 'time' in msg:
msg += '(our timeout=%s)' % socket.getdefaulttimeout()
return 1,escape(msg)
elif hasattr(e, 'code'):
return 1, escape('The server couldn\'t fulfill the
request.\nError code: '+str(e.code))
else:
# everything is fine
h = self.headers = {}
........
return 0,......
finally:
socket.setdefaulttimeout(oto)

--
Robin Becker

Jul 5 '07 #1
2 2787
Robin Becker <ro***@reportlab.comwrites:
While messing about with some deliberate socket timeout code I got an
unexpected timeout after 20 seconds when my code was doing
socket.setdefaulttimeout(120).

Closer inspection revealed that this error in fact seemed to come from
the os (in this case windows xp).

By inspection of test cases the error.reason from the deliberate
socket timeout looks like
'timed out'
whereas the windows caused timeout error.reason looks like
'(10060 operation timed out)'

it would be nice to know if that is in fact true and whether there is
any way to do the attribution of errors more sensibly.
What do you mean "is in fact true"? Is what true? That the reason is
always formatted in those ways when those particular errors occur?
Not sure there's any reason to rely on that: I'd expect .reason to be
an exception object, so (reading the docs for module socket)
e.reason.args[0] should be the error code if one is available, in this
case errno.ETIMEDOUT (i.e. WSAETIMEDOUT, which means the timeout
occurred before a connection was established). Sometimes
e.reason.args will be length-1, and e.reason.args[0] will be a string,
again according to the docs for module socket.

Both of these seem to cause urllib2.URLError and presumably appear
somewhere in the socket code.

It might be nice if the deliberate timeout could be something like
timed out deliberately after xxx seconds'.
By "deliberate timeout", you mean the one you asked for by calling
socket.setdefaulttimeout().

In that case, I think e.reason will be a socket.timeout instance (as
opposed to socket.error in the WSAETIMEOUT case).

More importantly is there anything I can do to avoid these wrong os
inspired timeouts? I'm just using urllib2 to read from a remote site
[...]

Please define "wrong" ;-)

Googling suggests Windows doesn't let you configure its connect
timeout, except through a registry setting:

http://www.tech-archive.net/Archive/.../msg00918.html
John
Jul 5 '07 #2
John J. Lee wrote:
>
What do you mean "is in fact true"? Is what true? That the reason is
always formatted in those ways when those particular errors occur?
Not sure there's any reason to rely on that: I'd expect .reason to be
an exception object, so (reading the docs for module socket)
e.reason.args[0] should be the error code if one is available, in this
case errno.ETIMEDOUT (i.e. WSAETIMEDOUT, which means the timeout
occurred before a connection was established). Sometimes
e.reason.args will be length-1, and e.reason.args[0] will be a string,
again according to the docs for module socket.
well I suspect there's a whole twisty maze of stuff to do to reliably detect
whether a timeout was deliberate or not so I'll pass on that.

..........
>
>More importantly is there anything I can do to avoid these wrong os
inspired timeouts? I'm just using urllib2 to read from a remote site
[...]

Please define "wrong" ;-)
well if I ask to be timed out after 120 seconds I don't expect a timeout error
after 20 so I would define the 20 second case to be somehow wrong or unexpected.
Googling suggests Windows doesn't let you configure its connect
timeout, except through a registry setting:

http://www.tech-archive.net/Archive/.../msg00918.html
the implication of windows providing its own timeout seems to make the socket
defaulttimeout irrelevant since I can have no per socket control over it. I
think this came up before and I just forgot about it mumble mumble
--
Robin Becker

Jul 6 '07 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

17
by: Achim Domma | last post by:
Hi, I'm using Python 2.3s timeout sockets and have code like this to read a page from web: request = ... self.page = urllib2.urlopen(request) and later:
3
by: Thomas Hervé | last post by:
My problem is not really python specific but as I do my implementation in python I hope someone here can help me. I have two programs that talk through a socket. Here is the code : <server>...
5
by: Russell Warren | last post by:
Does anyone know the scope of the socket.setdefaulttimeout call? Is it a cross-process/system setting or does it stay local in the application in which it is called? I've been testing this and...
3
by: Robert A. van Ginkel | last post by:
Hello Fellow Developer, I use the System.Net.Sockets to send/receive data (no tcpclient/tcplistener), I made a receivethread in my wrapper, the receivethread loops/sleeps while waiting for data...
4
by: Chris Tanger | last post by:
Context: C# System.Net.Sockets Socket created with constructor prarmeters Internetwork, Stream and TCP everything else is left at the default parameters and options except linger may be changed...
2
by: djc | last post by:
I read a network programming book (based on framework 1.1) which indicated that you should 'never' use the RecieveTimeout or the SendTimeout 'socket options' on TCP sockets or you may loose data. I...
1
by: jnair | last post by:
When using socket.socket.settimeout we normally only guard against "socket.timeout" exception.Now the implementation of "settimeout" in "Python-2.4.3/Modules/socketmodule.c" sets the socket fd to...
2
by: carl.rosenberger | last post by:
Hi, I am trying to get the following behaviour for my Socket connection: (1) Attempt a blocked read for a defined amount of time. (2) If a timeout occurs, because no data has been sent to the...
2
by: Heikki Toivonen | last post by:
M2Crypto has some old code that gets and sets socket timeouts in http://svn.osafoundation.org/m2crypto/trunk/M2Crypto/SSL/Connection.py, for example: def get_socket_read_timeout(self): return...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...
0
by: ryjfgjl | last post by:
In our work, we often need to import Excel data into databases (such as MySQL, SQL Server, Oracle) for data analysis and processing. Usually, we use database tools like Navicat or the Excel import...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.