HttpWebResponse is truncated

[Dean Rettig]

I am using HttpWebRequest to get an HttpWebResponse from an https://
site.

I am using cookies and certificates and everything seems to be working
properly EXCEPT...

The largest (html) document that I am trying to read is about 28788
bytes when downloaded using Firefox

but when my dotnet app tries to retrieve it, the response is only about
26580 bytes. Here is a code snippet:

HttpWebResponse response = (HttpWebResponse) request.GetResponse ( );
System.Text.Encoding enc = System.Text.Encoding.GetEncoding(1252); //
Windows default Code Page
System.IO.StreamReader reader = new System.IO.StreamReader(
response.GetResponseStream(), enc );
string content = reader.ReadToEnd();
reader.Close();
response.Close();

I've tried different methods of StreamReader all with the same results.
Can anyone tell me where the last 2KB of my response is going and how
I can get it back?

Muchas grathias,
Dean

[Jon Skeet [C# MVP]]

Dean Rettig <re******@gmail.comwrote:

I am using HttpWebRequest to get an HttpWebResponse from an https://
site.

I am using cookies and certificates and everything seems to be working
properly EXCEPT...

The largest (html) document that I am trying to read is about 28788
bytes when downloaded using Firefox

but when my dotnet app tries to retrieve it, the response is only about
26580 bytes. Here is a code snippet:

HttpWebResponse response = (HttpWebResponse) request.GetResponse ( );
System.Text.Encoding enc = System.Text.Encoding.GetEncoding(1252); //
Windows default Code Page
System.IO.StreamReader reader = new System.IO.StreamReader(
response.GetResponseStream(), enc );
string content = reader.ReadToEnd();
reader.Close();
response.Close();

I've tried different methods of StreamReader all with the same results.
Can anyone tell me where the last 2KB of my response is going and how
I can get it back?

How sure are you that it's encoded in Windows-1252?

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet Blog: http://www.msmvps.com/jon.skeet
If replying to the group, please do not mail me too

[Dean Rettig]

Jon,

I thought of that.

I've tried all of the popular encodings and plain raw binary and get
the same thing. I think I'll try them all again just to make sure.

I'm beginning to think that there is some latency/timeout that is
causing the response to timeout and return before it has received all
of the data.

Dean

On Jan 25, 4:00 pm, Jon Skeet [C# MVP] <[e-mail]:

Dean Rettig <[e-mail]:

I am using HttpWebRequest to get an HttpWebResponse from an https://
site.

I am using cookies and certificates and everything seems to be working
properly EXCEPT...

The largest (html) document that I am trying to read is about 28788
bytes when downloaded using Firefox

but when my dotnet app tries to retrieve it, the response is only about
26580 bytes. Here is a code snippet:

HttpWebResponse response = (HttpWebResponse) request.GetResponse ( );
System.Text.Encoding enc = System.Text.Encoding.GetEncoding(1252); //
Windows default Code Page
System.IO.StreamReader reader = new System.IO.StreamReader(
response.GetResponseStream(), enc );
string content = reader.ReadToEnd();
reader.Close();
response.Close();

I've tried different methods of StreamReader all with the same results.
Can anyone tell me where the last 2KB of my response is going and how
I can get it back?How sure are you that it's encoded in Windows-1252?

--
Jon Skeet - <[e-mail]>http://www.pobox.com/~skeet Blog:http://www.msmvps.com/jon.skeet
If replying to the group, please do not mail me too

[Jon Skeet [C# MVP]]

On Jan 29, 4:37 pm, "Dean Rettig" <[e-mail]:

I thought of that.

I've tried all of the popular encodings and plain raw binary and get
the same thing. I think I'll try them all again just to make sure.

I'm beginning to think that there is some latency/timeout that is
causing the response to timeout and return before it has received all
of the data.

That sounds unlikely. Have you looked at what's coming in over the
network using something like Ethereal?

Jon

[Dean Rettig]

On Jan 29, 11:43 am, "Jon Skeet [C# MVP]" <[e-mail]:

On Jan 29, 4:37 pm, "Dean Rettig" <[e-mail]:

I thought of that.

I've tried all of the popular encodings and plain raw binary and get
the same thing. I think I'll try them all again just to make sure.

I'm beginning to think that there is some latency/timeout that is
causing the response to timeout and return before it has received all
of the data.

That sounds unlikely. Have you looked at what's coming in over the
network using something like Ethereal?

Jon

Thanks Jon - I found the problem and it was unrelated to
HttpWebRequest/Response.

I was writing (some debuging info and) the output in a Textbox with
the max string length set to 32768 which was clipping it.
I increased the textbox max length to 1000000 and now I can see all of
it.

thanks for your ideas.

Dean