473,387 Members | 1,903 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,387 software developers and data experts.

Large INSERT SQL Server 2000/C#

Hi,

I have a large structure of associated domain object instances...something
around 100.000 objects at the top level..
There are about 7-8 classes involved so we are totally looking at about
800.000 objects..

All these objects must be persisted to the db. I dont wan´t to call the db
100.000 times so I would like to do a batch/bulk insert of around 5.000
objects wrapped within one transaction and repeat that until I am done...

I need to have control of this in the Business layer (everything is user
initiated..the use case could not be started by back-office/functional
support). I will do this asynchronously with a worker thread from the thread
pool.

Some basic info:
The triggering application is an ASP.NET application...all logic will be
performed on the server in the Business and Access layer. I need to keep
track of each object and when everything is done retrive the result back to
the ASP.NET app (could be done in a number of ways..so this is not such a
big issue..).

Any toughts and ideas are more than welcomed!

Regards
/Oscar
Nov 17 '05 #1
0 1037

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
by: Oleg Berfirer | last post by:
I'm running a resource-intensive stored procedure, which reads a file with about 50,000 lines with a BULK INSERT into a temp table, then goes through it and inserts a record for each line into...
4
by: Jakob | last post by:
Hello, I have experienced that some of my tables occupies an extremely large amount of pages but with few rows. An example is a table with 37 rows over 22000 pages !. The columns are simple...
1
by: Pavel | last post by:
I have SQL 2000 and need to retrieve fairly large amout of data (~ 50.000 characters) in XML format and then insert it into the field of the text type. As 'FOR XML' can't be used with either local...
5
by: Mike | last post by:
This is a general question on the best way to import a large amount of data to a MS-SQL DB. I can have the data in just about any format I need to, I just don't know how to import the data. I...
4
by: rosherman | last post by:
Brief background: We are using SQL Server 2000, and one of the tables stores user sessions details (each time our users logs into our system we insert a new record in the session table, and each...
10
by: Avi | last post by:
Hi I need to read in a large set of text files (9GB+ each) into a database table based on fixed width lengths. There are several ways to complete this, but I am wondering if anyone has...
3
by: Dmitri | last post by:
Hello! I have a developer that is playing around with some SQL statements using VB.NET. He has a test table in a SQL 2000 database, and he has about 2000 generated INSERT statements. When the...
4
by: Emin | last post by:
Dear Experts, What is the best way to do a large insert WITHOUT having direct access to the machine SQL Server is running on? For example, imagine I want to insert something like 20,000 records....
10
by: nflacco | last post by:
I'm tinkering around with a data collection system, and have come up with a very hackish way to store my data- for reference, I'm anticipating collecting at least 100 million different dataId...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.