473,396 Members | 2,158 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

Saving large files using HTTP PUT

Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET
application on Web Server stores large files 10MB+ on the App Server using
HTTP PUT. This is a Server to Server communication. This works fine with 4-5
MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are within the
bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh

Nov 18 '05 #1
6 2207
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime
section.

I don't know that you can control the bandwidth utilization with the default
WS plumbing provided by the framework - maybe there's a way to do it through
IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:22**********************************@microsof t.com...
Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET
application on Web Server stores large files 10MB+ on the App Server using
HTTP PUT. This is a Server to Server communication. This works fine with 4-5 MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are within the bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh

Nov 18 '05 #2

"Klaus H. Probst" <us*******@simulplex.net> wrote in message
news:u3**************@TK2MSFTNGP09.phx.gbl...
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime
section.


Sorry, that's maxRequestLength:

<httpRuntime maxRequestLength="xxxxx" ... />
--
Klaus H. Probst, MVP
http://www.vbbox.com/
Nov 18 '05 #3
We already changed the httpruntime section in the web.config file to accept
files upto 20mb.

"Klaus H. Probst" wrote:
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime
section.

I don't know that you can control the bandwidth utilization with the default
WS plumbing provided by the framework - maybe there's a way to do it through
IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:22**********************************@microsof t.com...
Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET
application on Web Server stores large files 10MB+ on the App Server using
HTTP PUT. This is a Server to Server communication. This works fine with

4-5
MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are within

the
bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh


Nov 18 '05 #4
There is a practical though "undocumented" limit of 3.9MB or so I've always
observed when moving binary data through web services. I've never been able
to get past that, though I've heard some people claim they have. Perhaps
it's a configuration setting or the version of IIS you happen to be running
(IIS is the thing that actually handles the requests, after all). This is
true as far as I'm concerned regardless of the way you're moving the data -
whether it's a simple byte array on a web method, WS-Attachments/DIME or
some other thing.

The solution (for me at least) has been to maintain state on the server or
piggyback state on the web request and chunk the data manually to manageable
sizes (500K or so). This also has the benefit of saving you from timeouts
and whatnot.

--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:8D**********************************@microsof t.com...
We already changed the httpruntime section in the web.config file to accept files upto 20mb.

"Klaus H. Probst" wrote:
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime section.

I don't know that you can control the bandwidth utilization with the default WS plumbing provided by the framework - maybe there's a way to do it through IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:22**********************************@microsof t.com...
Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET application on Web Server stores large files 10MB+ on the App Server using HTTP PUT. This is a Server to Server communication. This works fine
with 4-5
MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are
within the
bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh


Nov 18 '05 #5
be sure to set the page timeouts on the calling and recieving pages. you can
use timers to throttle the bandwidth. to do this correctly, you will need to
create a static class that monitors bandwidth to the server (to handle two
pages posting at the same time). post in chucks, then call the timer with
the chuck size and posting time. delay if required. if there is a dedicated
nic card for the 15mb network, you could monitor its i/o stats.

-- bruce (sqlwork.com)
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:22**********************************@microsof t.com...
| Hi,
|
| We are receiving an error 'The operation has timed out' when our ASP.NET
| application on Web Server stores large files 10MB+ on the App Server using
| HTTP PUT. This is a Server to Server communication. This works fine with
4-5
| MB files though. Also there is a 15 mb shared bandwidth limitation.
| how can we throttle/control the transfer rate to see that we are within
the
| bandwidth limits ?
|
| Any help is highly appreciated
|
| Thanks
| Ramesh
|
Nov 18 '05 #6
Thanks for your quick responses.

We are using a file upload control on an asp.net page to upload the the file.
We are receving the files from clients desktops. MaxRequestLength and
timeout are configured appropriately. The asp.net app uses WebClient to post
the data (using HTTP PUT/WEBDAV) to another server. And this is timing out.
THe whole thing works in DEV and SIT envs. It is failing when bandwidth
limitations are applied. I am wondering if there is a way to slice up the
file and upload in pieces. How that works with PUT/WEBDAV ?

Thanks
Ramesh

"Klaus H. Probst" wrote:
There is a practical though "undocumented" limit of 3.9MB or so I've always
observed when moving binary data through web services. I've never been able
to get past that, though I've heard some people claim they have. Perhaps
it's a configuration setting or the version of IIS you happen to be running
(IIS is the thing that actually handles the requests, after all). This is
true as far as I'm concerned regardless of the way you're moving the data -
whether it's a simple byte array on a web method, WS-Attachments/DIME or
some other thing.

The solution (for me at least) has been to maintain state on the server or
piggyback state on the web request and chunk the data manually to manageable
sizes (500K or so). This also has the benefit of saving you from timeouts
and whatnot.

--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:8D**********************************@microsof t.com...
We already changed the httpruntime section in the web.config file to

accept
files upto 20mb.

"Klaus H. Probst" wrote:
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime section.

I don't know that you can control the bandwidth utilization with the default WS plumbing provided by the framework - maybe there's a way to do it through IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discussions.microsoft.com> wrote in message
news:22**********************************@microsof t.com...
> Hi,
>
> We are receiving an error 'The operation has timed out' when our ASP.NET > application on Web Server stores large files 10MB+ on the App Server using > HTTP PUT. This is a Server to Server communication. This works fine with 4-5
> MB files though. Also there is a 15 mb shared bandwidth limitation.
> how can we throttle/control the transfer rate to see that we are within the
> bandwidth limits ?
>
> Any help is highly appreciated
>
> Thanks
> Ramesh
>


Nov 18 '05 #7

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: Victor Engmark | last post by:
Background: People want to be able to record large amounts of product data ("a few MB") on laptop or tablet PCs without _any_ kind of network connection, and then to submit the data to a database...
6
by: Vijay | last post by:
I need to generate HTML files based on the some codes. One HTML file per code. I have the link (ex:http://123.234.345.456/WebPages/GetTestData.aspx?SomeCode=25), by passing the code as parameter I...
4
by: Pedro Leite | last post by:
Good Afternoon. the code below is properly retreiving binary data from a database and saving it. but instead of saving at client machine is saving at the server machine. what is wrong with my...
10
by: Nathan Sokalski | last post by:
I am using ASP.NET 2.0, and need to know how to save and use an image that is stored in an SQL Server image datatype. How can I do this using ASP.NET? Thanks.
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.