473,790 Members | 2,734 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

CPU usage in DPF on Windows during massive parallel single rowinserts

Hello, all.

DB2 v9.5.1 ESE, Windows 2003 Server 64-bit, 4 CPU (8 cores) each, DPF
environment.
There are 2 DPF instances on the same set of 5 computers.
One computer holds coordinator partitions and other 4 hold partitioned
tables (2 logical nodes per computer).

Application:
DataStage v8 running some (say 32) parallel massive single row inserts
(actually we use compound inserts: insert into table values
(?,..,?), ..., (?,...,?) ).
All inserts go through the coordinator partition and only into 1
database.
We don't use some advanced technique for inserts like local bypass or
INSERT BUF bind option.
intra_parallel parameter is off.

And we see that on each computer that holds partitioned tables 2 cores
are loaded almost on 100% and other 6 cores are almost idle.
It seems that such CPU usage is bottleneck of this workload.

My questions are:
Is the way to make db2 use all cores during such workload?
Has somebody encountered such problem?

Thanks in advance,
Mark B.
Jun 27 '08 #1
2 2399
Ian
4.****@mail.ru wrote:
>
My questions are:
Is the way to make db2 use all cores during such workload?
Has somebody encountered such problem?
I suspect that what you're seeing is a single agent for each database
partition doing the inserts for that partition. With a sufficiently
high level of inserts, you'll see the db2agent thread "pegging" a
single core.

The other EDUs (log writer, page cleaner, etc) are likely touching
the other cores, but relative to the agent there is very little work.
Jun 27 '08 #2
On Jun 18, 7:41*pm, Ian <ianb...@mobile audio.comwrote:
>
I suspect that what you're seeing is a single agent for each database
partition doing the inserts for that partition. *With a sufficiently
high level of inserts, you'll see the db2agent thread "pegging" a
single core.

The other EDUs (log writer, page cleaner, etc) are likely touching
the other cores, but relative to the agent there is very little work.
Single agent for 32 parallel connections???
I think it's impossible since we are not playing with connection
concentrator.

May be DB2PROCESSORS registry variable adjusted for each node can
help?
Something like:
-- for the 1-st computer's nodes
db2set DB2PROCESSORS=0 ,1,2,3 -i my_inst 1
db2set DB2PROCESSORS=4 ,5,6,7 -i my_inst 2
...
-- for the 4-th computer's nodes
db2set DB2PROCESSORS=0 ,1,2,3 -i my_inst 7
db2set DB2PROCESSORS=4 ,5,6,7 -i my_inst 8
?

Unfortunately, I can't try this right now...
Jun 27 '08 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
4929
by: Philip | last post by:
Hi, i'am looking for a db2 driver for windows the DB2 servers runs on as400 if that makes any difference. Thanks, Philip
2
3412
by: Ryan Lowe | last post by:
maybe its just me, but the behavior of parallel lists in for loops seems backwards. why doesnt it mirror parallel assignment? i think tuple-unpacking should take precedence, but instead iteration happens along the first dimension and unpacking comes second, forcing the use of zip. >>> a, b = , # a = , b = >>> for a, b in zip(, ): print a, b instead of: >>> for a, b in , : print a, b # illegal
2
422
by: Jarvis | last post by:
I've made a testing program to test the memory usage of some Data Forms. I create a MDI parent form with one single MDI child form, which is a Data Form generated by .NET Data Form Wizard. To test the stuff, I keep to open that child data form for about 10 times. the memory usage shown in GC and task manager both increase. Then I close all those forms. and perform GC collect. The memory usage shown in GC falls, however, the memory...
0
1317
by: Norm | last post by:
We are copying over a thousand tablespaces using LISTDEF. The Copy utility is restricting the parallelism to 6, even though Parallel 20 is specified. Environment: Z/OS R1.4 in 64-bit mode DB2 V7 LPAR has 8GB and 2 Logical processors Job has Region of 64MB (changing this doesn't seem to make a difference)
10
2347
by: Niall | last post by:
I'm not quite sure which groups to post this to, so short of a massive crosspost, I decided on these two. I am running into troubles with resource usage of our app on Win2k and above systems. In several places, I have seen it said that the WinNT model only limits resources to available memory. However, I have seen errors caused by running out of resources on a machine with over 1GB of free memory (running Win2k server), as well as on my...
15
4896
by: Dirk Reske | last post by:
Hello, why doesn't this code work correctly? private int GetCpuUsage(Process proc) { DateTime time1,time2; TimeSpan timediff; double cpu1,cpu2,cpudiff;
1
1225
by: James | last post by:
After uppgrading from .NET v1.1 to .NET v2.0 we ca see massive usage of disc space(10 GB) in a subfolder in the following folder: C:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\Temporary ASP.NET Files IIS6 on Windows 2003 server web edition. This site contains a few hundred page and approximately 50 concurrrent users. The amount of data in the Temporary ASP.NET Files has increased with 2 GB within last 2 hours. We dont understand why? ...
2
1675
by: 6tc1 | last post by:
Hi all, I'm inquiring about the mechanism that is used to implement event handlers in .NET (not really relevant, but I'm using C#). Anyway, I've noticed that I can pass an object in an event argument and if the receiver (event handler) of that event changes any of the properties in that object, then the original object I passed is changed. I.E. it seems as if events are passed by reference and not by value. This certainly frees me up...
1
4854
by: Damien | last post by:
Hi guys, I'm looking for ideas for troubleshooting the following. We've tried some random things to try to treat the symptoms, but none seem robust enough to use when we go live, and we'd rather discover the root cause: We've got an ASP.NET application, running on framework 1.1 on Windows 2003 (IIS 6). Under default settings, during testing by two users, we're seeing the CPU usage on w3wp.exe rocket up and stay up (and thus cause web...
0
9512
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10413
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
10200
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
0
9021
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7530
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6769
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5422
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5551
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
4094
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.