473,396 Members | 2,057 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

DB2 Linux and High IO Usage

Hello,

I have a Linux box (RH 4 Update 2 / kernel 2.6) running DB2 V8 FP 10.

My application is continuosly inserting data to a table. The statement
is a simple "insert into table values (a,b), ... (c,d)". 50 rows are
inserted per transaction, and a Commit is issued after the insert.

I created event monitor and got odd insert times. They vary from 0.5s
to 40+s !

I have taken snapshots and there does not seems to exist any lock-wait
that could explain this delay. Also, examining the operating system
performance counters, I can see that my CPU spends about 50% on iowait
operations. Memory is fairly constrained, but eventually there is about
1GB of free RAM available. (out of 6Gb + 2Gb/swap)

Can anyone suggest something that may be looked within DB2 to
understand why my system is spending too much time doing IO operations?
I have taken explain snapshots on the INSERT statement and all costs
seems very low.

I just need to make sure this is not a DB2 problem, before contacting
our system admins.

db2diag.log does not have a single error message.

Thanks in advance,

Nov 12 '05 #1
3 4035
Not a db2 expert (yet) but a few things come to mind:

is there aggresive indexing on the table?
(Possibly re-org the indices... etc.)

runstats? would that help?

Possibly some serious table constraints, doing lookups for
foreign key constraints, etc.

Also, what type of hard disk are you utilizing? If i understand the
situation,
multiple smaller hard disks would perform better. (Splice the disk
I/O, etc.)
(How much cache on the disk controller? )
Also, what type of application is providing these inserts...
Is it ODBC? could the latency be on the client app?

__________________________________________________ __________

Why it is not consistently slow on the other hand, i'm not sure. We
have a DB2 UDB 8.2 box receiving up to about 120 inserts per second (on
busy days) and have to purge records with a timestamp over a few
days.... so i'm very interested in the eventual solution to this.
(Data warehousing project... etc.)
Michel Esber wrote:
Hello,

I have a Linux box (RH 4 Update 2 / kernel 2.6) running DB2 V8 FP 10.

My application is continuosly inserting data to a table. The statement
is a simple "insert into table values (a,b), ... (c,d)". 50 rows are
inserted per transaction, and a Commit is issued after the insert.

I created event monitor and got odd insert times. They vary from 0.5s
to 40+s !

I have taken snapshots and there does not seems to exist any lock-wait
that could explain this delay. Also, examining the operating system
performance counters, I can see that my CPU spends about 50% on iowait
operations. Memory is fairly constrained, but eventually there is about
1GB of free RAM available. (out of 6Gb + 2Gb/swap)

Can anyone suggest something that may be looked within DB2 to
understand why my system is spending too much time doing IO operations?
I have taken explain snapshots on the INSERT statement and all costs
seems very low.

I just need to make sure this is not a DB2 problem, before contacting
our system admins.

db2diag.log does not have a single error message.

Thanks in advance,


Nov 12 '05 #2
This may help:

http://www-128.ibm.com/developerwork...m-0403wilkins/

Larry Edelstein

Michel Esber wrote:
Hello,

I have a Linux box (RH 4 Update 2 / kernel 2.6) running DB2 V8 FP 10.

My application is continuosly inserting data to a table. The statement
is a simple "insert into table values (a,b), ... (c,d)". 50 rows are
inserted per transaction, and a Commit is issued after the insert.

I created event monitor and got odd insert times. They vary from 0.5s
to 40+s !

I have taken snapshots and there does not seems to exist any lock-wait
that could explain this delay. Also, examining the operating system
performance counters, I can see that my CPU spends about 50% on iowait
operations. Memory is fairly constrained, but eventually there is about
1GB of free RAM available. (out of 6Gb + 2Gb/swap)

Can anyone suggest something that may be looked within DB2 to
understand why my system is spending too much time doing IO operations?
I have taken explain snapshots on the INSERT statement and all costs
seems very low.

I just need to make sure this is not a DB2 problem, before contacting
our system admins.

db2diag.log does not have a single error message.

Thanks in advance,

Nov 12 '05 #3
Thanks for the input guys.

Working with the system admin, we found out that after Operating System
migration (RH 2.1 to RH 4.0) the daemon bdflush (deprecated on 4.0) was
still running and was the main responsible for IO usage. Fortunately,
it was not a DB2 problem.

Thanks again.
Larry escreveu:
This may help:

http://www-128.ibm.com/developerwork...m-0403wilkins/

Larry Edelstein

Michel Esber wrote:
Hello,

I have a Linux box (RH 4 Update 2 / kernel 2.6) running DB2 V8 FP 10.

My application is continuosly inserting data to a table. The statement
is a simple "insert into table values (a,b), ... (c,d)". 50 rows are
inserted per transaction, and a Commit is issued after the insert.

I created event monitor and got odd insert times. They vary from 0.5s
to 40+s !

I have taken snapshots and there does not seems to exist any lock-wait
that could explain this delay. Also, examining the operating system
performance counters, I can see that my CPU spends about 50% on iowait
operations. Memory is fairly constrained, but eventually there is about
1GB of free RAM available. (out of 6Gb + 2Gb/swap)

Can anyone suggest something that may be looked within DB2 to
understand why my system is spending too much time doing IO operations?
I have taken explain snapshots on the INSERT statement and all costs
seems very low.

I just need to make sure this is not a DB2 problem, before contacting
our system admins.

db2diag.log does not have a single error message.

Thanks in advance,


Nov 12 '05 #4

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
by: Murat Tasan | last post by:
hi, i have a java application that can be fairly memory intensive. so, when i run the program, i use the -Xmx option to prevent out of memory errors. in particular, i have been using -Xmx512m,...
26
by: Simon | last post by:
I'm doing a survey. When do you think GNU/Linux will be ready for the average Joe? What obstacles must it overcome first?
3
by: Ian Taite | last post by:
Hello, I'm exploring why one of my C# .NET apps has "high" memory usage, and whether I can reduce the memory usage. I have an app that wakes up and processes text files into a database...
1
by: Damien | last post by:
Hi guys, I'm looking for ideas for troubleshooting the following. We've tried some random things to try to treat the symptoms, but none seem robust enough to use when we go live, and we'd rather...
2
by: Mechul | last post by:
Hi people i need serious help here.. I have a forum and my hosting company suspended it cuz of the high usage of sql. We did everything to make lower the usage but its still high. it was ...
0
by: Learning.Net | last post by:
I have a window application that uses ActiveX browser component for testing web site automatically using mshtml. Though application is running fine but there is abnormally high page file usage....
1
by: santhescript01 | last post by:
I have a window application that uses ActiveX browser component for testing web site automatically using mshtml. Though application is running fine but there is abnormally high page file usage....
1
by: anjaliraman2 | last post by:
Hi All, I am facing a problem of writing into and reading from syslog in Linux Enviornment using C++. The CPU utilization is extremely high of about 55% and is creating problems for other...
2
jwwicks
by: jwwicks | last post by:
C/C++ Programs and Debugging in Linux This tutorial will give you a basic idea how to debug a program in Linux using GDB. As you are aware Visual Studio doesn’t run on Linux so you have to use...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.