473,396 Members | 1,858 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

bulk load very slow

Hi,

I am running into a problem ( only in this particular instance).

I insert one row into a table - takes a fraction of a second
try to do a bulk load of the same --takes 10 seconds.

Anything that I need to be looking into to identify why bulk load
takes a long time?

Thanks,
Sumanth

Jul 13 '06 #1
5 2847
Try testing with bigger volume of data atleast 100,000 rows to see if
there is a problem. Bulk load is something you should do for highvolume
of data. And it needs a X lock on the table.

Sumanth wrote:
Hi,

I am running into a problem ( only in this particular instance).

I insert one row into a table - takes a fraction of a second
try to do a bulk load of the same --takes 10 seconds.

Anything that I need to be looking into to identify why bulk load
takes a long time?

Thanks,
Sumanth
Jul 13 '06 #2

I was trying this as a test. Have been using bulk load to load large
volumes. Taking more than 10 seconds to upload a single row
only on this particular instance indicates to me something is amiss, the
very same operation takes less than a second on other instances.
Any pointers on what parameters I need to look into ?

Thanks,
Sumnath

"Visu" <Vi*******@gmail.comwrote in message
news:11**********************@75g2000cwc.googlegro ups.com...
Try testing with bigger volume of data atleast 100,000 rows to see if
there is a problem. Bulk load is something you should do for highvolume
of data. And it needs a X lock on the table.

Sumanth wrote:
>Hi,

I am running into a problem ( only in this particular instance).

I insert one row into a table - takes a fraction of a second
try to do a bulk load of the same --takes 10 seconds.

Anything that I need to be looking into to identify why bulk load
takes a long time?

Thanks,
Sumanth

Jul 13 '06 #3
What are using to load ? Informatica?

Sumanth wrote:
I was trying this as a test. Have been using bulk load to load large
volumes. Taking more than 10 seconds to upload a single row
only on this particular instance indicates to me something is amiss, the
very same operation takes less than a second on other instances.
Any pointers on what parameters I need to look into ?

Thanks,
Sumnath

"Visu" <Vi*******@gmail.comwrote in message
news:11**********************@75g2000cwc.googlegro ups.com...
Try testing with bigger volume of data atleast 100,000 rows to see if
there is a problem. Bulk load is something you should do for highvolume
of data. And it needs a X lock on the table.

Sumanth wrote:
Hi,

I am running into a problem ( only in this particular instance).

I insert one row into a table - takes a fraction of a second
try to do a bulk load of the same --takes 10 seconds.

Anything that I need to be looking into to identify why bulk load
takes a long time?

Thanks,
Sumanth
Jul 13 '06 #4

sas to db2.

Thanks,
Sumanth

"Visu" <Vi*******@gmail.comwrote in message
news:11**********************@h48g2000cwc.googlegr oups.com...
What are using to load ? Informatica?

Sumanth wrote:
>I was trying this as a test. Have been using bulk load to load large
volumes. Taking more than 10 seconds to upload a single row
only on this particular instance indicates to me something is amiss, the
very same operation takes less than a second on other instances.
Any pointers on what parameters I need to look into ?

Thanks,
Sumnath

"Visu" <Vi*******@gmail.comwrote in message
news:11**********************@75g2000cwc.googlegr oups.com...
Try testing with bigger volume of data atleast 100,000 rows to see if
there is a problem. Bulk load is something you should do for highvolume
of data. And it needs a X lock on the table.

Sumanth wrote:
Hi,

I am running into a problem ( only in this particular
instance).

I insert one row into a table - takes a fraction of a second
try to do a bulk load of the same --takes 10 seconds.

Anything that I need to be looking into to identify why bulk
load
takes a long time?

Thanks,
Sumanth

Jul 13 '06 #5
Ian
Visu wrote:
Try testing with bigger volume of data atleast 100,000 rows to see if
there is a problem. Bulk load is something you should do for highvolume
of data. And it needs a X lock on the table.
Visu is correct.

The amount of time required to initiate a load will also depend on
whether you are in a partitioned (DPF) environment -- if so, there is
additional overhead involved in setting up the communications and
processes at all partitions involved in the load. For a large
partitioned environment, the setup can be significant (esp. if you
are comparing to a non-partitioned database).
Jul 14 '06 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
by: Clive Page | last post by:
I am trying to use the geometry data types introduced in version 4.1-alpha and the spatial indexing seems to work well. But I have a large volume of data to load, and from the documentation all I...
2
by: David Sharp | last post by:
I've been doing some experiments with speeding up copying tables of approximately 1 million rows between databases using BCP and BULK INSERT. I noticed that the total time for removing the...
2
by: php newbie | last post by:
Hello, I am trying to load a simple tab-delimited data file to SQL Server. I created a format file to go with it, since the data file differs from the destination table in number of columns. ...
20
by: akej via SQLMonster.com | last post by:
Hi, i have table with 15 columns CREATE TABLE . ( PRIMARY KEY , NULL , NULL , NULL , NULL , (50) NULL , NULL
3
by: moonriver | last post by:
Right now I develop an application to retrieve over 30,000 records from a binary file and then load them into a SQL Server DB. So far I load those records one by one, but the performance is very...
9
by: David Rysdam | last post by:
I have a large amount of data that I copy in and out of Sybase very often. Now I also want to copy this data in and out of postgres. I have an existing script that creates the entire database(s)...
11
by: Ted | last post by:
OK, I tried this: USE Alert_db; BULK INSERT funds FROM 'C:\\data\\myData.dat' WITH (FIELDTERMINATOR='\t', KEEPNULLS, ROWTERMINATOR='\r\n');
2
by: nano | last post by:
Does sql server have a way to handle errors in a sproc which would allow one to insert rows, ignoring rows which would create a duplicate key violation? I know if one loops one can handle the error...
5
by: yeoj13 | last post by:
Hello, I have a db2load script I'm using to populate a large table. Ideally, my target table is required to have "Not Null" constraints on a number of different columns. I've noticed a ...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.