473,399 Members | 2,159 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,399 software developers and data experts.

DB2 Linux - AIO and DIO questions

Hello,

After reading the fine article on the Stinger enhancements for Linux, I
have two questions. First, our application is in essence a warehouse,
with 100-400 million rows for various tables.

Having said that, the AIO enhancements seem to be geared to an OLTP
environment. Our environment is that we load MASSIVE amounts of data
every couple of months, and then run various queries against this massive
influx. Seems to me that our environment would not make that much use of
AIO? Most of the document that I read -
ftp://ftp.software.ibm.com/software/...ingerlinux.pdf
seems to indicate that I/O cleaners are made more efficient by the use of
AIO. Which, since we read but do not write, appears to be obviated.
Second : DIO. Again, some mention of OLTP workload was referenced, but
I wanted to know if the avoidance of file system caching would aid in our
throughput, since we are doing massive reads, but no writes. The article
didn't seem too clear on the nature of the benefits - i.e. read vs write.

Any help, discussion, etc. would be appreciated. We are somewhat limited
in our budgets, so any improvements would be looked upon with great
favor!

Thanks,

Mairhtin
Nov 12 '05 #1
1 4060
Don't see a response to this post, so here are my thoughts.

As you are probably aware, DB2 does its own "asynchronous" i/o using the
prefetchers (or io servers); "asynchronous" meaning separately from the
agent that needs the page. Currently db2 doesn't use the asynchronous
i/o api provided in linux for prefetching data.

Regarding direct i/o, the correct answer is it depends on the details of
the workload and your configuration. If you have set up DB2 such that a
large part of the memory is being utilized in bufferpool / sort areas
then perhaps filesystem caching doesn't give you anything. In other
words, turning it off may be useful.

Here is a paper on using direct i/o on aix, db2 usage is exactly the
same on linux.

http://www-128.ibm.com/developerwork...lee/index.html

"mairhtin o'feannag" <ir**********@rocketmaildot.com> writes:
Hello,

After reading the fine article on the Stinger enhancements for Linux, I have two
questions. First, our application is in essence a warehouse, with 100-400
million rows for various tables.

Having said that, the AIO enhancements seem to be geared to an OLTP environment.
Our environment is that we load MASSIVE amounts of data every couple of months,
and then run various queries against this massive influx. Seems to me that our
environment would not make that much use of AIO? Most of the document that I
read - ftp://ftp.software.ibm.com/software/...ingerlinux.pdf
seems to indicate that I/O cleaners are made more efficient by the use of AIO.
Which, since we read but do not write, appears to be obviated.
Second : DIO. Again, some mention of OLTP workload was referenced, but I wanted
to know if the avoidance of file system caching would aid in our throughput,
since we are doing massive reads, but no writes. The article didn't seem too
clear on the nature of the benefits - i.e. read vs write.

Any help, discussion, etc. would be appreciated. We are somewhat limited in our
budgets, so any improvements would be looked upon with great favor!

Thanks,

Mairhtin


--
Regards,
--
Haider
Nov 12 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
by: srihari | last post by:
Hai, I am trying to install IBM DB2 8.1 on Red Hat linux 8.0. My machine is Intel XEON 64bit. The installation went well except for the creation of tools catalog. When I tried to install the tools...
1
by: lineak | last post by:
Hi all, does anyone know how to compile with gcc using a different library from pthreads (for example libc clone() call)? if I type gcc -v I get: Reading specs from...
1
by: Sandeep | last post by:
Hi, I want to read & print a UTF-8 encoded characters stored in a file. I want to write a C program on Linux platform to achieve this. I am new to UTF-8. I will appreciate any sample...
3
by: ibwhoib | last post by:
Hey all, I caught a job where I have to write a linux daemon that communicates with a device connected to a serial port. Here are some details. I connect to the device in the standard fashion:...
5
by: Dave | last post by:
Compiled using g++ on linux and then I tried to execute it on Solaris. The error message was something like "can't execute a.out" - works ok on linux - ran chmod so Sun user has execute/read/etc...
9
by: jgcrawford | last post by:
G'day, I'm writing a ringtone manager for nokia ringtones and I'd like to be able to play the ringtone on the PC speaker. I've had some success in DOS with turbo C and its sound(), delay() and...
16
by: Dawn Minnis | last post by:
Hi I know you're not supposed to post OS specific questions on the newsgroup so does anyone know a good newsgroup - where there are actually people talking to eachother and not full of spam -...
4
by: insomniux | last post by:
Hi, I need to check if a kernel module is loaded on a linux box.My linux version 2.6. If the module is not loaded, I need to load it. Should I do that with a system command (modprobe) or is there...
15
by: David T. Ashley | last post by:
I'll be using gcc under Red Hat Enterprise Linux. Where do I find information about the low-level calls to the operating system from compiled 'C'? For example, if I want to cause a process to...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.