HttpWebRequest times out with ASP.NET_Session Id cookie (response TIMEOUT)

[davvel]

It has been 6 days of re-writing the same code in different ways to try
and avoid a getResponse Timeout which haunted me for much too long now.

I am trying to do a very simple thing which is prooving the most
difficult in my career. Scrape a screen which has several session
variables within it, and send this page to an e-mail.

I have two pages in my application webform1.aspx and webform2.aspx, in
webform1.aspx I set several session variables which when one goes to
webform2.aspx will be displayed in varies places. Going to
webform2.aspx through the normal browser works ok.

Now I write a very simple screen scraper using httpWebRequest pointing
to webform2.aspx, I pass the necessary cookies in the header to
maintain session state and the page times out on me. If I don't pass
the session cookie ( ASP.NET_Session ID ) then the page is scraped but
of course the session variables are all null.
Can anyone tell me if I can scrape a page within my application without
using htppwebrequest or else if there is a known bug / trick on how to
read the current session ID (I read it from this.Context ) and pass it
over to the webform2.aspx.

One version of my code...

HttpWebRequest m_webreq;
HttpWebResponse m_webresp;
string m_response;
System.Net.Cook ieCollection m_cookies;
string url="webform2.a spx";

m_webreq = (HttpWebRequest ) WebRequest.Crea te(url);
m_webreq.Cookie Container = new CookieContainer ();

foreach (String cookieName in
System.Web.Http Context.Current .Request.Cookie s)
{
System.Web.Http Cookie cookie =
System.Web.Http Context.Current .Request.Cookie s[cookieName];
System.Net.Cook ie myCookie = new System.Net.Cook ie();
myCookie.Name = cookie.Name;
myCookie.Value = cookie.Value;
myCookie.Domain = this.Context.Re quest.Url.Host;
m_webreq.Cookie Container.Add(m yCookie);
}

m_webreq.Method = "POST";
m_webreq.Timeou t = 20000;
//Times out in the next line if I use POST and have cookies
m_webresp = (HttpWebRespons e)m_webreq.GetR esponse();

StreamReader stream = new StreamReader(m_ webresp.GetResp onseStream(),
System.Text.Enc oding.UTF8);

//m_response is never filled with the page that I need
m_response = stream.ReadToEn d();
stream.Close();
m_webresp.Close ();

[David]

Case Closed. One can user Server.Execute for this.