473,749 Members | 2,402 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Saving large files using HTTP PUT

Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET
application on Web Server stores large files 10MB+ on the App Server using
HTTP PUT. This is a Server to Server communication. This works fine with 4-5
MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are within the
bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh

Nov 18 '05 #1
6 2234
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime
section.

I don't know that you can control the bandwidth utilization with the default
WS plumbing provided by the framework - maybe there's a way to do it through
IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:22******** *************** ***********@mic rosoft.com...
Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET
application on Web Server stores large files 10MB+ on the App Server using
HTTP PUT. This is a Server to Server communication. This works fine with 4-5 MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are within the bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh

Nov 18 '05 #2

"Klaus H. Probst" <us*******@simu lplex.net> wrote in message
news:u3******** ******@TK2MSFTN GP09.phx.gbl...
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime
section.


Sorry, that's maxRequestLengt h:

<httpRuntime maxRequestLengt h="xxxxx" ... />
--
Klaus H. Probst, MVP
http://www.vbbox.com/
Nov 18 '05 #3
We already changed the httpruntime section in the web.config file to accept
files upto 20mb.

"Klaus H. Probst" wrote:
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime
section.

I don't know that you can control the bandwidth utilization with the default
WS plumbing provided by the framework - maybe there's a way to do it through
IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:22******** *************** ***********@mic rosoft.com...
Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET
application on Web Server stores large files 10MB+ on the App Server using
HTTP PUT. This is a Server to Server communication. This works fine with

4-5
MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are within

the
bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh


Nov 18 '05 #4
There is a practical though "undocument ed" limit of 3.9MB or so I've always
observed when moving binary data through web services. I've never been able
to get past that, though I've heard some people claim they have. Perhaps
it's a configuration setting or the version of IIS you happen to be running
(IIS is the thing that actually handles the requests, after all). This is
true as far as I'm concerned regardless of the way you're moving the data -
whether it's a simple byte array on a web method, WS-Attachments/DIME or
some other thing.

The solution (for me at least) has been to maintain state on the server or
piggyback state on the web request and chunk the data manually to manageable
sizes (500K or so). This also has the benefit of saving you from timeouts
and whatnot.

--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:8D******** *************** ***********@mic rosoft.com...
We already changed the httpruntime section in the web.config file to accept files upto 20mb.

"Klaus H. Probst" wrote:
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime section.

I don't know that you can control the bandwidth utilization with the default WS plumbing provided by the framework - maybe there's a way to do it through IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:22******** *************** ***********@mic rosoft.com...
Hi,

We are receiving an error 'The operation has timed out' when our ASP.NET application on Web Server stores large files 10MB+ on the App Server using HTTP PUT. This is a Server to Server communication. This works fine
with 4-5
MB files though. Also there is a 15 mb shared bandwidth limitation.
how can we throttle/control the transfer rate to see that we are
within the
bandwidth limits ?

Any help is highly appreciated

Thanks
Ramesh


Nov 18 '05 #5
be sure to set the page timeouts on the calling and recieving pages. you can
use timers to throttle the bandwidth. to do this correctly, you will need to
create a static class that monitors bandwidth to the server (to handle two
pages posting at the same time). post in chucks, then call the timer with
the chuck size and posting time. delay if required. if there is a dedicated
nic card for the 15mb network, you could monitor its i/o stats.

-- bruce (sqlwork.com)
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:22******** *************** ***********@mic rosoft.com...
| Hi,
|
| We are receiving an error 'The operation has timed out' when our ASP.NET
| application on Web Server stores large files 10MB+ on the App Server using
| HTTP PUT. This is a Server to Server communication. This works fine with
4-5
| MB files though. Also there is a 15 mb shared bandwidth limitation.
| how can we throttle/control the transfer rate to see that we are within
the
| bandwidth limits ?
|
| Any help is highly appreciated
|
| Thanks
| Ramesh
|
Nov 18 '05 #6
Thanks for your quick responses.

We are using a file upload control on an asp.net page to upload the the file.
We are receving the files from clients desktops. MaxRequestLengt h and
timeout are configured appropriately. The asp.net app uses WebClient to post
the data (using HTTP PUT/WEBDAV) to another server. And this is timing out.
THe whole thing works in DEV and SIT envs. It is failing when bandwidth
limitations are applied. I am wondering if there is a way to slice up the
file and upload in pieces. How that works with PUT/WEBDAV ?

Thanks
Ramesh

"Klaus H. Probst" wrote:
There is a practical though "undocument ed" limit of 3.9MB or so I've always
observed when moving binary data through web services. I've never been able
to get past that, though I've heard some people claim they have. Perhaps
it's a configuration setting or the version of IIS you happen to be running
(IIS is the thing that actually handles the requests, after all). This is
true as far as I'm concerned regardless of the way you're moving the data -
whether it's a simple byte array on a web method, WS-Attachments/DIME or
some other thing.

The solution (for me at least) has been to maintain state on the server or
piggyback state on the web request and chunk the data manually to manageable
sizes (500K or so). This also has the benefit of saving you from timeouts
and whatnot.

--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:8D******** *************** ***********@mic rosoft.com...
We already changed the httpruntime section in the web.config file to

accept
files upto 20mb.

"Klaus H. Probst" wrote:
The default limit is 4MB. You can override this in web.config or
machine.config by changing the maxRequestSize attribute in the httpRuntime section.

I don't know that you can control the bandwidth utilization with the default WS plumbing provided by the framework - maybe there's a way to do it through IIS.
--
Klaus H. Probst, MVP
http://www.vbbox.com/
"Ramesh" <Ra****@discuss ions.microsoft. com> wrote in message
news:22******** *************** ***********@mic rosoft.com...
> Hi,
>
> We are receiving an error 'The operation has timed out' when our ASP.NET > application on Web Server stores large files 10MB+ on the App Server using > HTTP PUT. This is a Server to Server communication. This works fine with 4-5
> MB files though. Also there is a 15 mb shared bandwidth limitation.
> how can we throttle/control the transfer rate to see that we are within the
> bandwidth limits ?
>
> Any help is highly appreciated
>
> Thanks
> Ramesh
>


Nov 18 '05 #7

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
4526
by: Victor Engmark | last post by:
Background: People want to be able to record large amounts of product data ("a few MB") on laptop or tablet PCs without _any_ kind of network connection, and then to submit the data to a database in the office come the end of the day. The installed base of the machines is controllable, but should include familiar concepts and structures, and it should be easy to deploy on many computers. The solution will be used for approximately two...
6
3292
by: Vijay | last post by:
I need to generate HTML files based on the some codes. One HTML file per code. I have the link (ex:http://123.234.345.456/WebPages/GetTestData.aspx?SomeCode=25), by passing the code as parameter I will get the page displayed. But I don't want to display it, instead save those files in one of the network directories that can be accessed by our third party vended web based application. How can I do this accessing and saving HTML files a...
4
6723
by: Pedro Leite | last post by:
Good Afternoon. the code below is properly retreiving binary data from a database and saving it. but instead of saving at client machine is saving at the server machine. what is wrong with my code ?? thank you Pedro Leite From Portugal ------------------------------------
10
7429
by: Nathan Sokalski | last post by:
I am using ASP.NET 2.0, and need to know how to save and use an image that is stored in an SQL Server image datatype. How can I do this using ASP.NET? Thanks.
0
8996
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
8832
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
9566
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
8256
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
6800
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6078
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
4879
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
2791
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
2217
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.