I'm going to use cursor load to load 200GB data in my production
database.
My database has 2 partitions.
but I cannot find more info in the manual about this cursor load.
I'm concern about loading 200GB , this large amount of data, is there
any limitation?
I'm not sure from perfomance point of view, is there any difference
between loading from cursor and loading from flat files on the same
box?
is there any memeory limitation for cursor load ?
If anybody could share some experience on it, I would be very
appreciated.
Thanks.
7  3781 
My experience is that it's faster to load from a file than a cursor.
If you are loading into an MDC add an order by clause to the select to
match the orgainize by in the MDC.
Make sure you use the +c option when running the script, or somehow
else make sure that you don't commit between declaring and opening the
cursor and starting the load or the load will fail to start.
jane wrote: I'm going to use cursor load to load 200GB data in my production
database.
My database has 2 partitions.
but I cannot find more info in the manual about this cursor load.
I'm concern about loading 200GB , this large amount of data, is there
any limitation?
I'm not sure from perfomance point of view, is there any difference
between loading from cursor and loading from flat files on the same
box?
is there any memeory limitation for cursor load ?
Maybe you're missing something. Loading from a cursor allows you to
declare a cursor for a select statement (i.e. data is already in the
database) and then load from the cursor directly into another table.
This saves you the step of having to export the data to a flat file,
and is MUCH more efficient than 'insert into ... select ...' when
loading large amounts of data.
If your data is in a flat file, you do not have the option of loading
from a cursor.
There aren't memory restrictions to this -- load is simply reading the
cursor as it traverses the result set.
Thanks for the reply...
about '+c' option, I'm wondering that's that for?
I did not find it in manural...
I tried to do the declare and load without '+c' , it run successfully..
but I used small amount of data...
could you give me some more explain on that..
Thanks.
HI, Thanks for your reply...
I agree with you , probably there aren't memory restrictions to this...
HI, Pyle,
also for compare loading from file or load from cursor..
if load from file, there must have physical read I/O happened, but load
from cursor , there is not physical read I/O happened for read from
cursor.. I suppose load from file should slower than load from cursor
from I/O point of view..
you said load from file is faster than load from cursor, do you have
any idea why?
HI, Pyle,
also for compare loading from file or load from cursor..
if load from file, there must have physical read I/O happened, but load
from cursor , there is not physical read I/O happened for read from
cursor.. I suppose load from file should slower than load from cursor
from I/O point of view..
you said load from file is faster than load from cursor, do you have
any idea why?
"jane" <es**********@y ahoo.com> a écrit dans le message de
news:11******** *************@g 44g2000cwa.goog legroups.com... I'm going to use cursor load to load 200GB data in my production
database.
My database has 2 partitions.
but I cannot find more info in the manual about this cursor load.
I'm concern about loading 200GB , this large amount of data, is there
any limitation?
I'm not sure from perfomance point of view, is there any difference
between loading from cursor and loading from flat files on the same
box?
is there any memeory limitation for cursor load ?
If anybody could share some experience on it, I would be very
appreciated.
Thanks.
Hi, we use quite often load from cursor, in dpf context, because it is
easier to alter big fact tables this way: we first load to a table in a temp
schema, recreate the fact table fitting our needs (like transformation to
MDC), and load from the temp schema. This way, the DB supports the
duplication of the data - we are not sure that export will fit in FS, and
doing twice load from cursor is faster than exporting + loading from file.
You might consider increase UTIL_HEAP_SZ, especially if you load MDC.
HTH, Jean-Marc This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: Firehawk® |
last post by:
Hi,
I have a great experience with DB (Oracle and others) and I am using DB2
now.
Then, I have few questions:
1. How drop a schema (user) and all objects of this schema, like a Oracle
"drop user cascade" ?
2. Suposing, 2 Databases, DB1 and DB2, each one with a schema, schema1 in
DB1 and schema2 in DB2.
|
by: ChadDiesel |
last post by:
My basic question is why does my print report button on my subform print a
blank report when my cursor is on a blank entry line? Here is a more
detailed explanation of my problem.
I have a form that contains shipment destination information and a subform
that contains boxes for that shipment. The main form is a table called
Ship_Info, and the subform is a table called Label_Info. They both contain
and are linked by a field called...
|
by: Paul Cheetham |
last post by:
Hi,
I am trying to load a custom cursor from my programs resources.
I have successfully included the cursor resource, and I have confirmed
that the name I am using is correct.
Below is the code I am using to try and load the cursor - which always
returns null.
I have tried using LoadImage and LoadCursor with the same result.
|
by: Paul Cheetham |
last post by:
Hi,
I have some custom colour cursors which I have added to my c# project,
and set them to be compiled as "Embedded Resource"
It seems impossible to load a colour cursor using the standard Cursor
class, so I have had to resort to loading it using the Win32 API, and
creating the cursor with - new Cursor(HCURSOR)
The code I am using is shown at the bottom of this post.
|
by: nier |
last post by:
Be consider of efficiency, I want to use "load from cursor " instead of
"insert into ... select ..."
so I write sql sentence like following:
declare mycor cursor for select a.a, a.b from table1 a , table2 b where
a.a=b.a and a.b=b.b with ur; --column a and b in
table1,table2 both are primary key
then
load from mycor of cursor insert into table2(a, b)
but this operation will get a error message:
| | |
by: technocrat |
last post by:
Hi,
I am trying to declare and cursor and thn load from that cursor into
another table. Since I have almost 4 million records, I cant do it
without the cursor which reduces the time by almost 1/10th.
I tried to create a sql statement for "load from cursor cur insert into
table name" using java stored procedure, but this isnt recognised by
sql since load isnt a sql keyword. So whats the solution to this. I
have to do it programatically...
|
by: P. Adhia |
last post by:
Sorry for quoting an old post and probably I am reading out of context
so my concern is unfounded. But I would appreciate if I can get someone
or Serge to confirm. Also unlike the question asked in the post below,
my question involves non-partitioned table loads.
I want to know if, in general, loading from cursor is slower than
loading from a file? I was thinking cursor would normally be faster,
because of DB2's superior buffer/prefetch...
|
by: peteh |
last post by:
Hi All;
I have a 2.5mm row table (very wide columns) on an UDB v8.2.3 (DPF -
6x10) AIX box. We were doing some performance testing to determine the
pros and cons of delete/insert vs load from cursor operations in our
ETL architecture (data warehouse extract/transform/load).
We expected load from cursor to be substantially faster, but found that
the delete/insert took 2 minutes and the load from cursor took 5
minutes.
|
by: Ultrak The DBA |
last post by:
UDB Version 8.2 FP7 (r"DB2 v8.1.1.128", "s061108", "U810098", and
FixPak
"14".) 64 bit running on AIX 5.3.
We were getting the SQL0668 error below so we put the status sql into
the script to see the table state right before the cursor/load ran.
The table did not seem to be in a bad state. We switched this cursor/
load back to a regular export/load and the issue went away. We are
doing several cursor loads on some 52Million row tables...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it.
First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
| | |
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
|
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| | |
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
| |
