473,396 Members | 1,996 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

CPU usage in DPF on Windows during massive parallel single rowinserts

Hello, all.

DB2 v9.5.1 ESE, Windows 2003 Server 64-bit, 4 CPU (8 cores) each, DPF
environment.
There are 2 DPF instances on the same set of 5 computers.
One computer holds coordinator partitions and other 4 hold partitioned
tables (2 logical nodes per computer).

Application:
DataStage v8 running some (say 32) parallel massive single row inserts
(actually we use compound inserts: insert into table values
(?,..,?), ..., (?,...,?) ).
All inserts go through the coordinator partition and only into 1
database.
We don't use some advanced technique for inserts like local bypass or
INSERT BUF bind option.
intra_parallel parameter is off.

And we see that on each computer that holds partitioned tables 2 cores
are loaded almost on 100% and other 6 cores are almost idle.
It seems that such CPU usage is bottleneck of this workload.

My questions are:
Is the way to make db2 use all cores during such workload?
Has somebody encountered such problem?

Thanks in advance,
Mark B.
Jun 27 '08 #1
2 2387
Ian
4.****@mail.ru wrote:
>
My questions are:
Is the way to make db2 use all cores during such workload?
Has somebody encountered such problem?
I suspect that what you're seeing is a single agent for each database
partition doing the inserts for that partition. With a sufficiently
high level of inserts, you'll see the db2agent thread "pegging" a
single core.

The other EDUs (log writer, page cleaner, etc) are likely touching
the other cores, but relative to the agent there is very little work.
Jun 27 '08 #2
On Jun 18, 7:41*pm, Ian <ianb...@mobileaudio.comwrote:
>
I suspect that what you're seeing is a single agent for each database
partition doing the inserts for that partition. *With a sufficiently
high level of inserts, you'll see the db2agent thread "pegging" a
single core.

The other EDUs (log writer, page cleaner, etc) are likely touching
the other cores, but relative to the agent there is very little work.
Single agent for 32 parallel connections???
I think it's impossible since we are not playing with connection
concentrator.

May be DB2PROCESSORS registry variable adjusted for each node can
help?
Something like:
-- for the 1-st computer's nodes
db2set DB2PROCESSORS=0,1,2,3 -i my_inst 1
db2set DB2PROCESSORS=4,5,6,7 -i my_inst 2
...
-- for the 4-th computer's nodes
db2set DB2PROCESSORS=0,1,2,3 -i my_inst 7
db2set DB2PROCESSORS=4,5,6,7 -i my_inst 8
?

Unfortunately, I can't try this right now...
Jun 27 '08 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
by: Philip | last post by:
Hi, i'am looking for a db2 driver for windows the DB2 servers runs on as400 if that makes any difference. Thanks, Philip
2
by: Ryan Lowe | last post by:
maybe its just me, but the behavior of parallel lists in for loops seems backwards. why doesnt it mirror parallel assignment? i think tuple-unpacking should take precedence, but instead iteration...
2
by: Jarvis | last post by:
I've made a testing program to test the memory usage of some Data Forms. I create a MDI parent form with one single MDI child form, which is a Data Form generated by .NET Data Form Wizard. To...
0
by: Norm | last post by:
We are copying over a thousand tablespaces using LISTDEF. The Copy utility is restricting the parallelism to 6, even though Parallel 20 is specified. Environment: Z/OS R1.4 in 64-bit mode DB2...
10
by: Niall | last post by:
I'm not quite sure which groups to post this to, so short of a massive crosspost, I decided on these two. I am running into troubles with resource usage of our app on Win2k and above systems. In...
15
by: Dirk Reske | last post by:
Hello, why doesn't this code work correctly? private int GetCpuUsage(Process proc) { DateTime time1,time2; TimeSpan timediff; double cpu1,cpu2,cpudiff;
1
by: James | last post by:
After uppgrading from .NET v1.1 to .NET v2.0 we ca see massive usage of disc space(10 GB) in a subfolder in the following folder: C:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\Temporary ASP.NET...
2
by: 6tc1 | last post by:
Hi all, I'm inquiring about the mechanism that is used to implement event handlers in .NET (not really relevant, but I'm using C#). Anyway, I've noticed that I can pass an object in an event...
1
by: Damien | last post by:
Hi guys, I'm looking for ideas for troubleshooting the following. We've tried some random things to try to treat the symptoms, but none seem robust enough to use when we go live, and we'd rather...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.