Hello,
I'm wondering if anybody has seen this problem. I basically need to cycle
through ~30000 db rows to update the data, I load up the id of the rows I
need first, put them into ArrayList, close the connection, then process
through one record at a time, so there is no nested transaction. It
normally take 1 hour or more, after about 45 min, the aspx page gives up
with a server unavailable msg, but the server still goes on in the
background for 15 min or more then stop.
App event in the server shows this: aspnet_wp.exe (PID: 2400) stopped
unexpectedly
Does anyone know what the problem is?
Thanks! 4 1162
Hi,
Without an error it is probably hard to say something, but cannot you make
an update in a some sort of batch? I do not think it is a good idea to make
updates one-by-one especially in ASP.NET environment. I am pretty sure there
is a better way to do this, but it depends on what you need to achieve
--
Val Mazur
Microsoft MVP http://xport.mvps.org
"Zeng" <Ze******@hotma il.com> wrote in message
news:ub******** ******@TK2MSFTN GP10.phx.gbl... Hello,
I'm wondering if anybody has seen this problem. I basically need to cycle through ~30000 db rows to update the data, I load up the id of the rows I need first, put them into ArrayList, close the connection, then process through one record at a time, so there is no nested transaction. It normally take 1 hour or more, after about 45 min, the aspx page gives up with a server unavailable msg, but the server still goes on in the background for 15 min or more then stop. App event in the server shows this: aspnet_wp.exe (PID: 2400) stopped unexpectedly
Does anyone know what the problem is?
Thanks!
How come you didn't think it was a good idea to make updates one-by-one in
asp.net environment? By the way, each update is a well-defined and
re-usable operation, doing it otherwise would risk code inconsistency, I
have to do this once every two weeks. MS must have tried something like
this to stress test the framework, right? Basically just do a big loop and
do several db read/update each iteration. My loop failed around the 10000th
record. If all resource (memory etc..) is released and/or recycled
properly, why would it matter if it's a big loop or not?
"Val Mazur (MVP)" <gr******@hotma il.com> wrote in message
news:OD******** ******@TK2MSFTN GP10.phx.gbl... Hi,
Without an error it is probably hard to say something, but cannot you make an update in a some sort of batch? I do not think it is a good idea to
make updates one-by-one especially in ASP.NET environment. I am pretty sure
there is a better way to do this, but it depends on what you need to achieve
-- Val Mazur Microsoft MVP
http://xport.mvps.org "Zeng" <Ze******@hotma il.com> wrote in message news:ub******** ******@TK2MSFTN GP10.phx.gbl... Hello,
I'm wondering if anybody has seen this problem. I basically need to
cycle through ~30000 db rows to update the data, I load up the id of the rows
I need first, put them into ArrayList, close the connection, then process through one record at a time, so there is no nested transaction. It normally take 1 hour or more, after about 45 min, the aspx page gives up with a server unavailable msg, but the server still goes on in the background for 15 min or more then stop. App event in the server shows this: aspnet_wp.exe (PID: 2400) stopped unexpectedly
Does anyone know what the problem is?
Thanks!
(excuse the caps).
RDBMS excel when SET based operations are used.
IE if you get data, you get a set of data using SELECT.
If you want to delete data, you delete a set of data using DELETE.
If you wish to update data, you use an UPDATE statement. It is by far the
most efficient way of performing the operation. Updating say 10,000 records
should take a second or so on a moderate performing server. It can of course
take a lot longer if there are complex joins in the update statement.
Using a cursor operation with procedural logic is akin to reading tape files
on a mainframe and processing a record at a time - it is inherently very
slow. In a client server environment, each fetch of next record [can]
involve a network round trip to the server which with network latency,
server latency etc. makes for a slow process. Effectively you are treating
the data source as a big serial file...
Certainly there are some situations where the values to use in each record
update may require a custom calculation, but where does this data come from?
If it comes from the database, then the concept is to chop out the network,
the client and devise an SQL statement that will execute the UPDATE for all
records in one statement on the server. If some of the data needed is
somewhere in the client, then bung it in the database in some suitable table
for the duration of the update and so make it available for the calculation.
There are techniques to batch the update into smaller chunks that involve
using the TOP operator.
As for the cause for your failure: as Val says, it is difficult to give any
answer without any errors. Is there anything in the event log? I would
suspect you are hitting a timeout of some sort. IMHO ASP.Net is not designed
for large Batch operations.
- Tim
"Zeng" <Ze******@hotma il.com> wrote in message
news:%2******** **********@TK2M SFTNGP12.phx.gb l... How come you didn't think it was a good idea to make updates one-by-one in asp.net environment? By the way, each update is a well-defined and re-usable operation, doing it otherwise would risk code inconsistency, I have to do this once every two weeks. MS must have tried something like this to stress test the framework, right? Basically just do a big loop and do several db read/update each iteration. My loop failed around the 10000th record. If all resource (memory etc..) is released and/or recycled properly, why would it matter if it's a big loop or not?
"Val Mazur (MVP)" <gr******@hotma il.com> wrote in message news:OD******** ******@TK2MSFTN GP10.phx.gbl... Hi,
Without an error it is probably hard to say something, but cannot you make an update in a some sort of batch? I do not think it is a good idea to make updates one-by-one especially in ASP.NET environment. I am pretty sure there is a better way to do this, but it depends on what you need to achieve
-- Val Mazur Microsoft MVP
http://xport.mvps.org "Zeng" <Ze******@hotma il.com> wrote in message news:ub******** ******@TK2MSFTN GP10.phx.gbl... > Hello, > > I'm wondering if anybody has seen this problem. I basically need to cycle > through ~30000 db rows to update the data, I load up the id of the rows I > need first, put them into ArrayList, close the connection, then process > through one record at a time, so there is no nested transaction. It > normally take 1 hour or more, after about 45 min, the aspx page gives > up > with a server unavailable msg, but the server still goes on in the > background for 15 min or more then stop. > App event in the server shows this: aspnet_wp.exe (PID: 2400) stopped > unexpectedly > > Does anyone know what the problem is? > > Thanks! > > >
Hi,
How? It does not matter if it is ASP.NET or Windows application environment,
it is always very expensive task to update/delete/insert records one-by-one.
But in ASP.NET environment it means huge load for the IIS and it is not a
benefit for sure. Anyway updating 30000 of rows in a database should not
take 45 minutes. If you use some sort of batch, I am pretty sure you could
do it in a couple of minutes if not under 1 minute. For example, you could
sent data as one XML batch into SP and call one UPDATE there.
--
Val Mazur
Microsoft MVP http://xport.mvps.org
"Zeng" <Ze******@hotma il.com> wrote in message
news:%2******** **********@TK2M SFTNGP12.phx.gb l... How come you didn't think it was a good idea to make updates one-by-one in asp.net environment? By the way, each update is a well-defined and re-usable operation, doing it otherwise would risk code inconsistency, I have to do this once every two weeks. MS must have tried something like this to stress test the framework, right? Basically just do a big loop and do several db read/update each iteration. My loop failed around the 10000th record. If all resource (memory etc..) is released and/or recycled properly, why would it matter if it's a big loop or not?
"Val Mazur (MVP)" <gr******@hotma il.com> wrote in message news:OD******** ******@TK2MSFTN GP10.phx.gbl... Hi,
Without an error it is probably hard to say something, but cannot you make an update in a some sort of batch? I do not think it is a good idea to make updates one-by-one especially in ASP.NET environment. I am pretty sure there is a better way to do this, but it depends on what you need to achieve
-- Val Mazur Microsoft MVP
http://xport.mvps.org "Zeng" <Ze******@hotma il.com> wrote in message news:ub******** ******@TK2MSFTN GP10.phx.gbl... > Hello, > > I'm wondering if anybody has seen this problem. I basically need to cycle > through ~30000 db rows to update the data, I load up the id of the rows I > need first, put them into ArrayList, close the connection, then process > through one record at a time, so there is no nested transaction. It > normally take 1 hour or more, after about 45 min, the aspx page gives > up > with a server unavailable msg, but the server still goes on in the > background for 15 min or more then stop. > App event in the server shows this: aspnet_wp.exe (PID: 2400) stopped > unexpectedly > > Does anyone know what the problem is? > > Thanks! > > >
This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics |
by: Zeng |
last post by:
Hello,
I'm wondering if anybody has seen this problem. I basically need to cycle
through ~30000 db rows to update the data, I load up the id of the rows I
need first, put them into ArrayList, close the connection, then process
through one record at a time, so there is no nested transaction. It
normally take 1 hour or more, after about 45 min, the aspx page gives up
with a server unavailable msg, but the server still goes on in the...
|
by: Keith |
last post by:
I am building an ASP.NET application using VS.NET 2002 on Framework
1.1.4322.0. I am debugging the application and everytime I click the
stop button to quit debugging, the server stops the aspnet_wp.exe
process and reports to the Event Log with no real explaination.
Something like: aspnet_wp.exe (PID: 1828) stopped unexpectedly.
PID: 1828 is unique of course.
Why is this happening and is it by design? Sometimes, other
developers are...
|
by: Stan |
last post by:
I get this error when I try to access any page on the website:
An error occurred while try to load the string resources (GetModuleHandle
failed with error 126).
At the same time here is what I got in the Event Log:
Event Type: Error
Event Source: ASP.NET 1.0.3705.288
Event Category: None
|
by: Umair Ahmed |
last post by:
Hi,
I m developing a web application on Win2k platform and
deploying the application on Win2k platform. I didnt get
any error on the development machine but when i deployed
to any machine on wch only .NET framework 1.o is
installed it gives the following error
Server Application Unavailable
The web application you are attempting to access on this
|
by: GP |
last post by:
We get " Object reference not set to an instance of an object. "
error in all the links whenever the browser is not used for more than 5
minutes.
In IIS 5.0 version we are setting the session time out to 60 minutes.
Please let me the know solution if any knows the answer.
Thanks
GP
| |
by: Shawn |
last post by:
JIT Debugging failed with the following error: Access is denied.
JIT Debugging was initiated by the following account 'PLISKEN\ASPNET'
I get this messag in a dialog window when I try to open an asp.net page. If
I press OK then I get a page with this message:
Server Application Unavailable
The web application you are attempting to access on this web server is
currently unavailable. Please hit the "Refresh" button in your web browser...
|
by: Tom |
last post by:
I am having the following show up in my application event log:
=====================================
Source: .NET Runtime
Event ID: 0
Description:
The description for Event ID ( 0 ) in Source ( .NET Runtime ) cannot be
found. The local computer may not have the necessary registry information or
message DLL files to display messages from a remote computer. The following
information is part of the event: .NET Runtime version...
|
by: Ramesh Dodamani |
last post by:
Environment:
XP Pro, VS.Net 2003, .Net 1.1.4322 with SP1 & KB Hotfix 886903
P4 2.2GHz, 1 GB RAM
My system was working fine till a few weeks back when I started seeing the
following errors.
"aspnet_wp.exe (PID: xxxx) stopped unexpectedly"
I am seeing the this error currently happen, but unlike the description in
articles Q823409 or 821387, I am not downloading any large file .The error
|
by: ImSoLost |
last post by:
My asp.net web application dies after an hour of processing (it's a long
database parsing process) and the web page becomes a "Page could not be
displayed" webpage. I looked in my event logs and found the following clue:
aspnet_wp.exe (PID: 2264) stopped unexpectedly.
Anyone have information on why the process stopped and how to resolve it?
Thanks in advance....
|
by: Woodwinds |
last post by:
I have a web application run under ASP.NET v1.1.4322
when I run that web application I got error that show on application log "aspnet_wp.exe stopped unexpectedly"
I re installed visual studio.net architecture 2003.
How do I know ASP.NET correct version for visual studio.net.
before install I got error when try to debug the web application test with visual studio.net "Can't run debug on web servers check to make sure ASP.net...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
| |
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
| |
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
|
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
| | |