473,756 Members | 1,752 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Udb Db2 Vs 7.2 Vs 8 Upgrade Resulting In Increased Insert Times

In our shop we have a 28,000,000 row insert that gets reloaded every
night. I am not looking to change this process. I would like to know
why in UDB Vs 7.2 we were getting an insert rate of 3300 rows per
second. We migrated to version 8.1 of UDB (non-partitioned) and now
the rate decreased to ~1100 rows per second. The only thing we changed
is the database version.

On, a test box I did some testing.
The source in UDB version 7.2 fixpack 9 is reading at 20000 rows a
second.
The source in UDB version 8.1 fixpack 6(non-partitioned) is reading at
13200 rows a second.
The target in UDB version 7.2 is inserting at 4800 rows a second.
The target in UDB version 8.1 is inserting at 1600 rows a second.

This is really close to the percentages of throughput I am getting in
prod so I thought it would be a good place to tune.

I also looked at the database side by doing a
insert into table2
select * from table1
Vs 7.2 is 13000 / sec
Vs 8.1 is 10000 /sec
So to me it looks like UDB and Informatica are collaborating to cause
this issue.

Since the insert select in vs 8.1 is 75% of the vs7.2
In Informatica vs 8.1 is consistently 33% of vs 7.2.

By the way we are using Informatica Power center 6.2.1 (R133 D41).

Any help would be appreciated.
Nov 12 '05 #1
7 2113
Hi,

jafastinger wrote:
why in UDB Vs 7.2 we were getting an insert rate of 3300 rows per
second. We migrated to version 8.1 of UDB (non-partitioned) and now
the rate decreased to ~1100 rows per second. The only thing we changed
is the database version.


I don't know the application you are running but did you run runstats on
your tables after migrating to 8.1 ? I would recommend to do so and run
your tests again after collecting the Stats. Helped in my environment
during migration from 7.2 to 8.1.4.
regards,

Norbert
Nov 12 '05 #2
Ian
jafastinger wrote:

Since the insert select in vs 8.1 is 75% of the vs7.2
In Informatica vs 8.1 is consistently 33% of vs 7.2.

By the way we are using Informatica Power center 6.2.1 (R133 D41).


Did you (at some point) rebind the packages on your 7.2 system to
use buffered inserts?

This is a common recommendation from Informatica, and this is not
the default configuration for DB2 (rightly so).

Nov 12 '05 #3
Did you store your dbm/db cfg parms from V7 somewhere? Is it possible
that some of the cfg parms were changed by the migration? I have heard
of situations where this has happened.

Larry Edelstein

jafastinger wrote:
In our shop we have a 28,000,000 row insert that gets reloaded every
night. I am not looking to change this process. I would like to know
why in UDB Vs 7.2 we were getting an insert rate of 3300 rows per
second. We migrated to version 8.1 of UDB (non-partitioned) and now
the rate decreased to ~1100 rows per second. The only thing we changed
is the database version.

On, a test box I did some testing.
The source in UDB version 7.2 fixpack 9 is reading at 20000 rows a
second.
The source in UDB version 8.1 fixpack 6(non-partitioned) is reading at
13200 rows a second.
The target in UDB version 7.2 is inserting at 4800 rows a second.
The target in UDB version 8.1 is inserting at 1600 rows a second.

This is really close to the percentages of throughput I am getting in
prod so I thought it would be a good place to tune.

I also looked at the database side by doing a
insert into table2
select * from table1
Vs 7.2 is 13000 / sec
Vs 8.1 is 10000 /sec
So to me it looks like UDB and Informatica are collaborating to cause
this issue.

Since the insert select in vs 8.1 is 75% of the vs7.2
In Informatica vs 8.1 is consistently 33% of vs 7.2.

By the way we are using Informatica Power center 6.2.1 (R133 D41).

Any help would be appreciated.


Nov 12 '05 #4
Norbert Munkel <nm@acoreus.d e> wrote in message news:<jM******* ********@se2-cb104-9.zrh1.ch.colt. net>...
Hi,

jafastinger wrote:
why in UDB Vs 7.2 we were getting an insert rate of 3300 rows per
second. We migrated to version 8.1 of UDB (non-partitioned) and now
the rate decreased to ~1100 rows per second. The only thing we changed
is the database version.


I don't know the application you are running but did you run runstats on
your tables after migrating to 8.1 ? I would recommend to do so and run
your tests again after collecting the Stats. Helped in my environment
during migration from 7.2 to 8.1.4.
regards,

Norbert


we ran a convert of our indexes because of the type-2 indexes in Vs 8
and also had to run runstats after that. I set this up in our test
environment and got the same results but with ~6 Million rows.
Thanks,
Nov 12 '05 #5
Larry <la***@nospam.n et> wrote in message news:<4C******* *************@n ews4.srv.hcvlny .cv.net>...
Did you store your dbm/db cfg parms from V7 somewhere? Is it possible
that some of the cfg parms were changed by the migration? I have heard
of situations where this has happened.

Larry Edelstein

jafastinger wrote:
In our shop we have a 28,000,000 row insert that gets reloaded every
night. I am not looking to change this process. I would like to know
why in UDB Vs 7.2 we were getting an insert rate of 3300 rows per
second. We migrated to version 8.1 of UDB (non-partitioned) and now
the rate decreased to ~1100 rows per second. The only thing we changed
is the database version.

On, a test box I did some testing.
The source in UDB version 7.2 fixpack 9 is reading at 20000 rows a
second.
The source in UDB version 8.1 fixpack 6(non-partitioned) is reading at
13200 rows a second.
The target in UDB version 7.2 is inserting at 4800 rows a second.
The target in UDB version 8.1 is inserting at 1600 rows a second.

This is really close to the percentages of throughput I am getting in
prod so I thought it would be a good place to tune.

I also looked at the database side by doing a
insert into table2
select * from table1
Vs 7.2 is 13000 / sec
Vs 8.1 is 10000 /sec
So to me it looks like UDB and Informatica are collaborating to cause
this issue.

Since the insert select in vs 8.1 is 75% of the vs7.2
In Informatica vs 8.1 is consistently 33% of vs 7.2.

By the way we are using Informatica Power center 6.2.1 (R133 D41).

Any help would be appreciated.


We stored them off and reset them back up like they were in vs 7
We opend a ticket with IBM and with informatica. we will see what shakes out.
Thanks for replying.
Nov 12 '05 #6
Ian <ia*****@mobile audio.com> wrote in message news:<41******* ***@newsfeed.sl urp.net>...
jafastinger wrote:

Since the insert select in vs 8.1 is 75% of the vs7.2
In Informatica vs 8.1 is consistently 33% of vs 7.2.

By the way we are using Informatica Power center 6.2.1 (R133 D41).


Did you (at some point) rebind the packages on your 7.2 system to
use buffered inserts?

This is a common recommendation from Informatica, and this is not
the default configuration for DB2 (rightly so).


Our Vs7 database did not have the packages bound with Insert buf. So
we did not bind the Vs 8 with insert buf. I will try this in OUR test
environment and let you know. we will see.
Nov 12 '05 #7
ja*********@aep .com (jafastinger) wrote in message news:<1d******* *************** ****@posting.go ogle.com>...
Larry <la***@nospam.n et> wrote in message news:<4C******* *************@n ews4.srv.hcvlny .cv.net>...
Did you store your dbm/db cfg parms from V7 somewhere? Is it possible
that some of the cfg parms were changed by the migration? I have heard
of situations where this has happened.

Larry Edelstein

jafastinger wrote:
In our shop we have a 28,000,000 row insert that gets reloaded every
night. I am not looking to change this process. I would like to know
why in UDB Vs 7.2 we were getting an insert rate of 3300 rows per
second. We migrated to version 8.1 of UDB (non-partitioned) and now
the rate decreased to ~1100 rows per second. The only thing we changed
is the database version.

On, a test box I did some testing.
The source in UDB version 7.2 fixpack 9 is reading at 20000 rows a
second.
The source in UDB version 8.1 fixpack 6(non-partitioned) is reading at
13200 rows a second.
The target in UDB version 7.2 is inserting at 4800 rows a second.
The target in UDB version 8.1 is inserting at 1600 rows a second.

This is really close to the percentages of throughput I am getting in
prod so I thought it would be a good place to tune.

I also looked at the database side by doing a
insert into table2
select * from table1
Vs 7.2 is 13000 / sec
Vs 8.1 is 10000 /sec
So to me it looks like UDB and Informatica are collaborating to cause
this issue.

Since the insert select in vs 8.1 is 75% of the vs7.2
In Informatica vs 8.1 is consistently 33% of vs 7.2.

By the way we are using Informatica Power center 6.2.1 (R133 D41).

Any help would be appreciated.


We stored them off and reset them back up like they were in vs 7
We opend a ticket with IBM and with informatica. we will see what shakes out.
Thanks for replying.

Problem solved. Version 6.2.2 of informatica seemed to solve the
problem there was a patch applied for something to do with casting
Char fields as LONVARCHAR and that seemd to cause the bottle neck.
migrating informatica 6.2.2 to production soon.
Nov 12 '05 #8

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

14
7957
by: Ruth | last post by:
Hi All I am not a DBA, but a unix administrator. After our DBA's upgraded from oracle 8.0.5 to oracle 8.1.7.4 on our test server, we have noticed a big slow down in our application (acocobol). From ~10mins to ~45mins. Server info:
7
6664
by: Abdul-Wahid Paterson | last post by:
Hi, I have had a site working for the last 2 years and have had no problems until at the weekend I replace my database server with a newer one. The database migration went like a dream and I had the whole db changed over in 1 hour. Since the upgrade I have been getting the following error message sporadically.
1
1962
by: Roger | last post by:
running on XP pro adding vba code, I want to type in 'X = "good"' when I type the 'X', and a 'space', if I wait a second, the cursor automatically moves back over the 'space' when I type the 'X', a 'space' and the '=', if I wait a second, I get just 'X=' in red (like when you've got a syntax error) when I quickly type in 'X', '=' and '"', after a second I get 'X = ""' (making it hard to enter a string)
2
1777
by: Kelt | last post by:
I have a user who currently has Access 97 installed on her PC. She has purchased a new PC and would like to have Access installed on it. She would like to upgrade her current Access to Access 2003. When installing the Access 2003 upgrade on the new PC, do I have to install Access 97 first, then run the Access 2003 upgrade CD? And if so, do I need any unlocking or any type of codes during the Access 97 installation? Or can I just run...
47
4543
by: ship | last post by:
Hi We need some advice: We are thinking of upgrading our Access database from Access 2000 to Access 2004. How stable is MS Office 2003? (particularly Access 2003). We are just a small company and this is a big decision for us(!) It's not just the money it's committing to an new version of Access!
10
3397
by: Mike | last post by:
I know this sounds strange but I am at a loss. I am calling a simple funtion that opens a connection to a SQL Server 2000 database and executes an Insert Statement. private void AddMinimunWageStipen(string payrollid,double amount) { System.Data.SqlClient.SqlConnection cn = null; System.Data.SqlClient.SqlCommand cm = null;
5
1552
by: Pieter | last post by:
Hi, I have a VB.NET (2.0) application that integrates with Outlook 2003. I have windows XP SP2. The users had Windows 2000, and Office 2000. They upgraded (!) to Office 2003. But: - an action that takes 0,5 seconds on my pc, takes them 4-5 seconds - an action that takes 2,5 seconds on my pc, takes them 8-9 seconds
7
1447
by: cwdjrxyz | last post by:
I just installed the new Firefox 2.0 browser without problems. This is a major upgrade, and you need to go to the Firefox site and read the release notes before you download it. There are a few known issues and likely to be some more for such a major upgrade. The 2.0 now supports JavaScript 1.7. Firefox gives the following brief summary: JavaScript 1.7: JavaScript 1.7 is a language update introducing several new features such as...
0
1997
by: HD | last post by:
hi. i have just upgraded from version 4.1 to 5.1 but the server load increased from 0.30 to 1.20. same options in my.cnf so i can't understand the reason. using debian etch any experience like this?
0
9431
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9255
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
8688
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7226
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6514
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5289
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
3780
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3326
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
2647
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.