c#:collectin cookies frm httpwebresponse when multiple set-cookies headers r returned

[piedpiper]

I am coding a http proxy in c# and using httpwebrequest class to send request to the web server, when the server returns multiple set-cookie headers then the httpwebresponse object combines them all in to a single set-cookie key-value pair.
I am tryin to get the value of the headers in the following way.

 
for (int i = 0; i < response.Headers.Count; ++i)
 Console.WriteLine("{0}:{1}", response.Headers.Keys[i], response.Headers[i]);
 
 

when i send a request to mypsace.com the server returns the following :

set-cookie headers
Set-Cookie: MYUSERINFO=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: MYUSERINFO=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: USER=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: USER=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/

when i try to get the same through my code it looks like this :

Set-Cookie:MYUSERINFO=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 G
MT; path=/,MYUSERINFO=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GM
T; path=/,USER=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; pat
h=/,USER=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT

I tried using the response.cookies method but gave up on it as it was processing all the cookie values, i need to get the exact values of the raw headers to proxy it to the browser.
Any help would be much appreciated, this is my first project in .net and i think i hav hit a road block here.
thanks in advance

[Plater]

Why not just use the .Cookies property to see what cookies are trying to be set and the combine from there?

[piedpiper]

Why not just use the .Cookies property to see what cookies are trying to be set and the combine from there?

hi plater, thanks for the reply.
i did think about it as well, it would involve more code and i might possible miss out something.i have seen websites setting really weird cookies.i was hoping if there was a more direct way through which i could directly access the raw set-cookie headers, that way possibilities of introducing bugs would become less.

[Plater]

Well I didn't see how the two headers you showed were different?
I would guess that the extra line breaks are just because you are using Console, which will insert them to line-wrap as needed.

EDIT: seems it doesn't make any entries in the Cookies section, weird.

Here's what I got from myspace.com

Content-Length: 51280
Cache-Control: private
Content-Type: text/html; charset=utf-8
Set-Cookie: MYUSERINFO=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,MYUSERINFO=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,USER=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,USER=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,MSCulture=IP=74.92.34.25&IPCulture=en-US&PreferredCulture=en-US&PreferredCulturePending=&Country=US&ForcedExpiration=0&timeZone=0&USRLOC=QXJlYUNvZGU9NjAzJkNpdHk9QnJvb2tsaW5lJkNvdW50cnlDb2RlPVVTJkNvdW50cnlOYW1lPVVuaXRlZCBTdGF0ZXMmRG1hQ29kZT01MDYmTGF0aXR1ZGU9NDIuNzQ5NCZMb25naXR1ZGU9LTcxLjY2ODEmUG9zdGFsQ29kZT0wMzAzMyZSZWdpb25OYW1lPU5I; domain=.myspace.com; expires=Fri, 08-Feb-2008 16:42:19 GMT; path=/,SessionDDF1=42cd8b692c61f9128296c4dc372a5e9655c15692e06749df; domain=.myspace.com; path=/,SessionDDF2=16e5eae9c9f477affed68ed69aa6e7414885361be2a4277b; domain=.myspace.com; path=/; expires=Friday, 01-Aug-08 16:42:19 GMT
Server: Microsoft-IIS/6.0
X-AspNet-Version: 2.0.50727
X-Server: 66dc745d1825fe9ae98e6af186c04a019bd5bfcab67cbd10
Date: Fri, 01 Feb 2008 16:42:19 GMT
 

[piedpiper]

Well I didn't see how the two headers you showed were different?
I would guess that the extra line breaks are just because you are using Console, which will insert them to line-wrap as needed.

EDIT: seems it doesn't make any entries in the Cookies section, weird.

Here's what I got from myspace.com

Content-Length: 51280
Cache-Control: private
Content-Type: text/html; charset=utf-8
Set-Cookie: MYUSERINFO=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,MYUSERINFO=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,USER=; domain=.myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,USER=; domain=myspace.com; expires=Wed, 19-Jan-2005 08:28:17 GMT; path=/,MSCulture=IP=74.92.34.25&IPCulture=en-US&PreferredCulture=en-US&PreferredCulturePending=&Country=US&ForcedExpiration=0&timeZone=0&USRLOC=QXJlYUNvZGU9NjAzJkNpdHk9QnJvb2tsaW5lJkNvdW50cnlDb2RlPVVTJkNvdW50cnlOYW1lPVVuaXRlZCBTdGF0ZXMmRG1hQ29kZT01MDYmTGF0aXR1ZGU9NDIuNzQ5NCZMb25naXR1ZGU9LTcxLjY2ODEmUG9zdGFsQ29kZT0wMzAzMyZSZWdpb25OYW1lPU5I; domain=.myspace.com; expires=Fri, 08-Feb-2008 16:42:19 GMT; path=/,SessionDDF1=42cd8b692c61f9128296c4dc372a5e9655c15692e06749df; domain=.myspace.com; path=/,SessionDDF2=16e5eae9c9f477affed68ed69aa6e7414885361be2a4277b; domain=.myspace.com; path=/; expires=Friday, 01-Aug-08 16:42:19 GMT
Server: Microsoft-IIS/6.0
X-AspNet-Version: 2.0.50727
X-Server: 66dc745d1825fe9ae98e6af186c04a019bd5bfcab67cbd10
Date: Fri, 01 Feb 2008 16:42:19 GMT
 

well actually the mypsace.com sever sets 5-6 separate set-cookie headers and when u get it thru response.headers then all of them are pushed in to a single set-cookie header, i want to split them back and send them to the browser as 5 seperate set-cookie headers like the server had sent, but since every site has its own style for cookies am not sure i can write a regex which will work all the time. dats y i was looking for an alternate method.
Thanks again.

[Plater]

Hmm, I would guess it was done because the collection object requires a unique key for the headers. (Really I suspect it is bad form to have multiple header lines with the same name: 'Set-Cookie')
At any rate, it seems to comma delimenate them so a simple .Split() on that string for commas should give you all the various cookie headers.


EDIT: I just noticed a problem with this, guess it's not as simple as i thought.
So using:

string n = "";
string[] pieces = resp.GetResponseHeader("Set-Cookie").Split(',');
for (int i = 0; i < pieces.Length; ++i)
{
   n += "Set-Cookie: " + pieces[i] + "\r\n";
}
 

I was able to get:

Set-Cookie: MYUSERINFO=; domain=.myspace.com; expires=Wed
Set-Cookie:  19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: MYUSERINFO=; domain=myspace.com; expires=Wed
Set-Cookie:  19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: USER=; domain=.myspace.com; expires=Wed
Set-Cookie:  19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: USER=; domain=myspace.com; expires=Wed
Set-Cookie:  19-Jan-2005 08:28:17 GMT; path=/
Set-Cookie: MSCulture=IP=74.92.34.25&IPCulture=en-US&PreferredCulture=en-US&PreferredCulturePending=&Country=US&ForcedExpiration=0&timeZone=0&USRLOC=QXJlYUNvZGU9NjAzJkNpdHk9QnJvb2tsaW5lJkNvdW50cnlDb2RlPVVTJkNvdW50cnlOYW1lPVVuaXRlZCBTdGF0ZXMmRG1hQ29kZT01MDYmTGF0aXR1ZGU9NDIuNzQ5NCZMb25naXR1ZGU9LTcxLjY2ODEmUG9zdGFsQ29kZT0wMzAzMyZSZWdpb25OYW1lPU5I; domain=.myspace.com; expires=Mon
Set-Cookie:  11-Feb-2008 14:33:09 GMT; path=/
Set-Cookie: SessionDDF1=cc057dfe6d288a6385cf9b3706676a3c5168edc0b1fd4516; domain=.myspace.com; path=/
Set-Cookie: SessionDDF2=d4284c7faeaa883d1c57e9f40849a63d6dc1394e38b5fbe9; domain=.myspace.com; path=/; expires=Monday
Set-Cookie:  04-Aug-08 14:33:09 GMT