WebService Parameter Size Limit and Impact!

[Vai2000]

Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design paradigms
or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to
pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem
allocated but no clue here)
TIA

[Nicholas Paldino [.NET/C# MVP]]

Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely encoded so
in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks
of data at a time, and then put them all together in a more efficient manner
on the server.

Hope this helps.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com
"Vai2000" <no****@microsoft.com> wrote in message
news:ey****************@TK2MSFTNGP10.phx.gbl...

Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design paradigms or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to
pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem
allocated but no clue here)
TIA

[Vai2000]

Thanks Nic.

"Nicholas Paldino [.NET/C# MVP]" <mv*@spam.guard.caspershouse.com> wrote in
message news:ux*************@TK2MSFTNGP11.phx.gbl...

Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely encoded so in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks of data at a time, and then put them all together in a more efficient manner on the server.

Hope this helps.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com
"Vai2000" <no****@microsoft.com> wrote in message
news:ey****************@TK2MSFTNGP10.phx.gbl...

Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design

paradigms

or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem allocated but no clue here)
TIA

[Vai2000]

1 more question. If I use DIME technically I don't send the blob inside the
SOAP rather send a reference to the DIME Message, so anyway I do a heavy R/T
with my data over the wire- so DIME won't buy much to my case.
Problem is some folks are uploading large files >25MB into the system and we
have to validate these files using a WS. Right now File is read in a string
and validated with the WS (quick & easy solution)

Please advice.

TIA
"Nicholas Paldino [.NET/C# MVP]" <mv*@spam.guard.caspershouse.com> wrote in
message news:ux*************@TK2MSFTNGP11.phx.gbl...

Vai,

I think that 20MB for input into a method is a little excessive. What
is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely encoded so in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take chunks of data at a time, and then put them all together in a more efficient manner on the server.

Hope this helps.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com
"Vai2000" <no****@microsoft.com> wrote in message
news:ey****************@TK2MSFTNGP10.phx.gbl...

Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes
close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design

paradigms

or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way to pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem allocated but no clue here)
TIA

[Nicholas Paldino [.NET/C# MVP]]

Vai2000,

If the file size is too large, then I would break up the calls to the
web serivce among multiple calls, and then process the chunks as needed,
perhaps in a process outside of the ASP space, when all the chunks have been
uploaded.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Vai2000" <no****@microsoft.com> wrote in message
news:OM**************@TK2MSFTNGP09.phx.gbl...

1 more question. If I use DIME technically I don't send the blob inside the SOAP rather send a reference to the DIME Message, so anyway I do a heavy R/T with my data over the wire- so DIME won't buy much to my case.
Problem is some folks are uploading large files >25MB into the system and we have to validate these files using a WS. Right now File is read in a string and validated with the WS (quick & easy solution)

Please advice.

TIA
"Nicholas Paldino [.NET/C# MVP]" <mv*@spam.guard.caspershouse.com> wrote in message news:ux*************@TK2MSFTNGP11.phx.gbl...

Vai,

I think that 20MB for input into a method is a little excessive. What

is it that you are trying to do exactly? If it is an attachment of some
sort then you might want to look into using MTOM as the mechanism for
transporting such large pieces of data (the string is most likely

encoded so

in a manner which will inflate what is uploaded). I believe (I am not
sure), that the WSE package supports this to some degree.

Also, you might want to consider writing a method which will take

chunks

of data at a time, and then put them all together in a more efficient

manner

on the server.

Hope this helps.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com
"Vai2000" <no****@microsoft.com> wrote in message
news:ey****************@TK2MSFTNGP10.phx.gbl...

Hi All, I have a Websvc which exposes a method for validation. The
validation string coming in is significantly large at times....sometimes close to 20MB. Due to this my aspnet_wp.exe is hogging memory
exorbitantly...
aspnet_wp.exe mem usage goes to 500MB sometimes...on the server.
I am a bit worried about this....Can you guys suggest some design

paradigms

or other tips for resolving this issue...
1. Is it OK to pass 20MB data in string object...(don't know other way

to pass data to WebSvc)?
2. How to free the string? (Had it been VC++ I would have deleted the mem allocated but no clue here)
TIA