Webrequest threading timeout

[LS]

Hi Guys,

I'm building a spider application for our intranet and have problems making
webrequests.
I spin of 10 threads, they all do the same code, a webrequest and processing
of the page.
This is the code of the webrequest:
--------------------------------------------------------
req = HttpWebRequest.Create(myRSS.RSSLink)
req.UserAgent = "Mozilla/6.0 (MSIE 6.1; Windows NT 5.1;)"
req.MaximumAutomaticRedirections = 20
req.Timeout = 10000
req.KeepAlive = False
res = req.GetResponse
--------------------------------------------------------
The code always times out on the last line.
If I fetch the page manually with my browser it works fine.

any ideas?

[shriop]

Is the URL an https site? If so, you're running into the 2 max
simultaneous connection limit.

Bruce Dunwiddie
http://www.csvreader.com

LS wrote:

Hi Guys,

I'm building a spider application for our intranet and have problems making
webrequests.
I spin of 10 threads, they all do the same code, a webrequest and processing
of the page.
This is the code of the webrequest:
--------------------------------------------------------
req = HttpWebRequest.Create(myRSS.RSSLink)
req.UserAgent = "Mozilla/6.0 (MSIE 6.1; Windows NT 5.1;)"
req.MaximumAutomaticRedirections = 20
req.Timeout = 10000
req.KeepAlive = False
res = req.GetResponse
--------------------------------------------------------
The code always times out on the last line.
If I fetch the page manually with my browser it works fine.

any ideas?

[Neo]

Hi,

you have two problem.

1. 2 Connection Limit
You can solve this limit by setting

req.ServicePoint.ConnectionLimit = 30;

then you have a max of 30 connections instead of 2

2. HttpWebRequest Bug ;-)
Here is the KB Article....

http://www.kbalertz.com/kb_904262.aspx

.....read it and try to set the timeouts like the article says....
I had the same Problem and the article has no effect on my 2003 Server.

To solve the Problem i had to write a wrapper for the wininet.dll. You can
find examples at www.codeproject.com.
"shriop" wrote:

Is the URL an https site? If so, you're running into the 2 max
simultaneous connection limit.

Bruce Dunwiddie
http://www.csvreader.com

LS wrote:

Hi Guys,

I'm building a spider application for our intranet and have problems making
webrequests.
I spin of 10 threads, they all do the same code, a webrequest and processing
of the page.
This is the code of the webrequest:
--------------------------------------------------------
req = HttpWebRequest.Create(myRSS.RSSLink)
req.UserAgent = "Mozilla/6.0 (MSIE 6.1; Windows NT 5.1;)"
req.MaximumAutomaticRedirections = 20
req.Timeout = 10000
req.KeepAlive = False
res = req.GetResponse
--------------------------------------------------------
The code always times out on the last line.
If I fetch the page manually with my browser it works fine.

any ideas?