473,802 Members | 2,318 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

why DPF?

Hi gurus, I know many of you are very senior DBAs and experts from IBM
internal, so I really want to know your advice on this basic topic.
"why dpf?"

usually there's a rumor, em, I believe it's a rumor, that DPF can help
you get greater performance, so even only one server, many IBM
presales will sell DPF feature with the performance story. DPF
license is not a cheap one:)

I believe DPF is much more for scalability than performance.

I believe that only when your data/table is larger than non-DPF can
serve, or you have to use more than one server, you use DPF.

how about your opinion? can you list the reasons you use DPF? Thank
you.

May 8 '07 #1
10 10305
Hardy wrote:
Hi gurus, I know many of you are very senior DBAs and experts from IBM
internal, so I really want to know your advice on this basic topic.
"why dpf?"

usually there's a rumor, em, I believe it's a rumor, that DPF can help
you get greater performance, so even only one server, many IBM
presales will sell DPF feature with the performance story. DPF
license is not a cheap one:)

I believe DPF is much more for scalability than performance.

I believe that only when your data/table is larger than non-DPF can
serve, or you have to use more than one server, you use DPF.

how about your opinion? can you list the reasons you use DPF? Thank
you.
With DB2 9 and large rowids, large tablespaces and range partitioning
scalability is hardly and issue anymore.
It is still correct though that on an SMP box it can be beneficial to
have multiple logical data partitions, rather than using SMP parallelism.
To make a long story short for a warehouse that requires multiple CPUs
you will see the recommendation of DPF for performance.
For the best practices I recommend looking into Balanced Configuration
Units (BCU):
http://www.db2mag.com/story/showArti...leID=180206351

... oh.. and it's not a rumor... for a warehouse a well designed DPF
system will achieve near linear scalability compared to an SMP approach
which delivers diminishing returns.
Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
May 8 '07 #2
With DB2 9 and large rowids, large tablespaces and range partitioning
scalability is hardly and issue anymore.
It is still correct though that on an SMP box it can be beneficial to
have multiple logical data partitions, rather than using SMP parallelism.
To make a long story short for a warehouse that requires multiple CPUs
you will see the recommendation of DPF for performance.
For the best practices I recommend looking into Balanced Configuration
Units (BCU):http://www.db2mag.com/story/showArti...leID=180206351

.. oh.. and it's not a rumor... for a warehouse a well designed DPF
system will achieve near linear scalability compared to an SMP approach
which delivers diminishing returns.

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
yes, Serge. DPF need more experienced professional to keep the near
linear scalability. In my experience, every time customer complained
DPF delivers worse performance and I always tell them the need for
more design and tuning, then do sth. to fulfill their need.

Actually, we deliver system always according to the BCU methodology
and gain good feedback.

But the problem that if only one server with many CPU and memory, if
the data/table size is not a limit, then what's the best solution?

May 8 '07 #3
On May 8, 10:36 am, Hardy <wyh...@gmail.c omwrote:
With DB2 9 and large rowids, large tablespaces and range partitioning
scalability is hardly and issue anymore.
It is still correct though that on an SMP box it can be beneficial to
have multiple logical data partitions, rather than using SMP parallelism.
To make a long story short for a warehouse that requires multiple CPUs
you will see the recommendation of DPF for performance.
For the best practices I recommend looking into Balanced Configuration
Units (BCU):http://www.db2mag.com/story/showArti...leID=180206351
.. oh.. and it's not a rumor... for a warehouse a well designed DPF
system will achieve near linear scalability compared to an SMP approach
which delivers diminishing returns.
Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

yes, Serge. DPF need more experienced professional to keep the near
linear scalability. In my experience, every time customer complained
DPF delivers worse performance and I always tell them the need for
more design and tuning, then do sth. to fulfill their need.

Actually, we deliver system always according to the BCU methodology
and gain good feedback.

But the problem that if only one server with many CPU and memory, if
the data/table size is not a limit, then what's the best solution?
to keep simple, is the advantage for multi-partition over SMP
parallelism(sur e?,is there any direct data or material) is worth the
big effort on DPF design? especially for a firm without strong skill.

May 8 '07 #4
On May 8, 10:36 am, Hardy <wyh...@gmail.c omwrote:
With DB2 9 and large rowids, large tablespaces and range partitioning
scalability is hardly and issue anymore.
It is still correct though that on an SMP box it can be beneficial to
have multiple logical data partitions, rather than using SMP parallelism.
To make a long story short for a warehouse that requires multiple CPUs
you will see the recommendation of DPF for performance.
For the best practices I recommend looking into Balanced Configuration
Units (BCU):http://www.db2mag.com/story/showArti...leID=180206351
.. oh.. and it's not a rumor... for a warehouse a well designed DPF
system will achieve near linear scalability compared to an SMP approach
which delivers diminishing returns.
Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

yes, Serge. DPF need more experienced professional to keep the near
linear scalability. In my experience, every time customer complained
DPF delivers worse performance and I always tell them the need for
more design and tuning, then do sth. to fulfill their need.

Actually, we deliver system always according to the BCU methodology
and gain good feedback.

But the problem that if only one server with many CPU and memory, if
the data/table size is not a limit, then what's the best solution?
to keep simple, is the advantage for multi-partition over SMP
parallelism(sur e?,is there any direct data or material) is worth the
big effort on DPF design? especially for a firm without strong skill.

May 8 '07 #5
On May 8, 10:36 am, Hardy <wyh...@gmail.c omwrote:
With DB2 9 and large rowids, large tablespaces and range partitioning
scalability is hardly and issue anymore.
It is still correct though that on an SMP box it can be beneficial to
have multiple logical data partitions, rather than using SMP parallelism.
To make a long story short for a warehouse that requires multiple CPUs
you will see the recommendation of DPF for performance.
For the best practices I recommend looking into Balanced Configuration
Units (BCU):http://www.db2mag.com/story/showArti...leID=180206351
.. oh.. and it's not a rumor... for a warehouse a well designed DPF
system will achieve near linear scalability compared to an SMP approach
which delivers diminishing returns.
Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

yes, Serge. DPF need more experienced professional to keep the near
linear scalability. In my experience, every time customer complained
DPF delivers worse performance and I always tell them the need for
more design and tuning, then do sth. to fulfill their need.

Actually, we deliver system always according to the BCU methodology
and gain good feedback.

But the problem that if only one server with many CPU and memory, if
the data/table size is not a limit, then what's the best solution?
to keep simple, is the advantage for multi-partition over SMP
parallelism(sur e?,is there any direct data or material) is worth the
big effort on DPF design? especially for a firm without strong skill.

May 8 '07 #6
On May 8, 10:43 am, Hardy <wyh...@gmail.c omwrote:
On May 8, 10:36 am, Hardy <wyh...@gmail.c omwrote:
With DB2 9 and large rowids, large tablespaces and range partitioning
scalability is hardly and issue anymore.
It is still correct though that on an SMP box it can be beneficial to
have multiple logical data partitions, rather than using SMP parallelism.
To make a long story short for a warehouse that requires multiple CPUs
you will see the recommendation of DPF for performance.
For the best practices I recommend looking into Balanced Configuration
Units (BCU):http://www.db2mag.com/story/showArti...leID=180206351
.. oh.. and it's not a rumor... for a warehouse a well designed DPF
system will achieve near linear scalability compared to an SMP approach
which delivers diminishing returns.
Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
yes, Serge. DPF need more experienced professional to keep the near
linear scalability. In my experience, every time customer complained
DPF delivers worse performance and I always tell them the need for
more design and tuning, then do sth. to fulfill their need.
Actually, we deliver system always according to the BCU methodology
and gain good feedback.
But the problem that if only one server with many CPU and memory, if
the data/table size is not a limit, then what's the best solution?

to keep simple, is the advantage for multi-partition over SMP
parallelism(sur e?,is there any direct data or material) is worth the
big effort on DPF design? especially for a firm without strong skill.
sorry, I had a mistake with the submit page and then over-submit...

May 8 '07 #7
Hardy wrote:
to keep simple, is the advantage for multi-partition over SMP
parallelism(sur e?,is there any direct data or material) is worth the
big effort on DPF design? especially for a firm without strong skill.
Let's level set: You are talking about a warehouse/datamart, right?
For OLTP my answer to DPF will nearly always be no.

The next question is growth: Most warehouses keep growing and growing.
So you may start with a 4 way box and get away with it. But in two years
you need to double, etc, etc. The worst thing that can happen is that
your design is not suitable for DPF and you hit the wall because SMP
doesn't scale high enough to where you need to be in 2, 3, 5 years.

I will try to get an expert to post here. My expertise in designing
warehouses has limits.

Also feel free to email me and I'll pass you to the experts.
Cheers
Serge

--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
May 8 '07 #8
On May 8, 7:52 pm, Serge Rielau <srie...@ca.ibm .comwrote:
Hardy wrote:
to keep simple, is the advantage for multi-partition over SMP
parallelism(sur e?,is there any direct data or material) is worth the
big effort on DPF design? especially for a firm without strong skill.

Let's level set: You are talking about a warehouse/datamart, right?
For OLTP my answer to DPF will nearly always be no.

The next question is growth: Most warehouses keep growing and growing.
So you may start with a 4 way box and get away with it. But in two years
you need to double, etc, etc. The worst thing that can happen is that
your design is not suitable for DPF and you hit the wall because SMP
doesn't scale high enough to where you need to be in 2, 3, 5 years.

I will try to get an expert to post here. My expertise in designing
warehouses has limits.

Also feel free to email me and I'll pass you to the experts.
Cheers
Serge

--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
Serge, thank you. I'll write you soon.

May 8 '07 #9
Hardy wrote:
Serge, thank you. I'll write you soon.
Yeah, yeah.. that's what SHE said... ;-)

--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
May 8 '07 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
11250
by: William C. White | last post by:
Does anyone know of a way to use PHP /w Authorize.net AIM without using cURL? Our website is hosted on a shared drive and the webhost company doesn't installed additional software (such as cURL) on the server because of that. Our site will have an SSL certificate next week, so I would like to use AIM instead of SIM, however, I don't know how to send data via POST over https and recieve data from the Authorize.net server over an https...
2
5845
by: Albert Ahtenberg | last post by:
Hello, I don't know if it is only me but I was sure that header("Location:url") redirects the browser instantly to URL, or at least stops the execution of the code. But appearantely it continues to execute the code until the browser send his reply to the header instruction. So an exit(); after each redirection won't hurt at all
3
23041
by: James | last post by:
Hi, I have a form with 2 fields. 'A' 'B' The user completes one of the fields and the form is submitted. On the results page I want to run a query, but this will change subject to which field is completed.
0
8500
by: Ollivier Robert | last post by:
Hello, I'm trying to link PHP with Oracle 9.2.0/OCI8 with gcc 3.2.3 on a Solaris9 system. The link succeeds but everytime I try to run php, I get a SEGV from inside the libcnltsh.so library. 354 roberto@ausone:Build/php-4.3.2> ldd /opt/php4/bin/php libsablot.so.0 => /usr/local/lib/libsablot.so.0 libstdc++.so.5 => /usr/local/lib/libstdc++.so.5 libm.so.1 => /usr/lib/libm.so.1
1
8612
by: Richard Galli | last post by:
I want viewers to compare state laws on a single subject. Imagine a three-column table with a drop-down box on the top. A viewer selects a state from the list, and that state's text fills the column below. The viewer can select states from the drop down lists above the other two columns as well. If the viewer selects only one, only one column fills. If the viewer selects two states, two columns fill. Etc. I could, if appropriate, have...
4
18308
by: Albert Ahtenberg | last post by:
Hello, I have two questions. 1. When the user presses the back button and returns to a form he filled the form is reseted. How do I leave there the values he inserted? 2. When the user comes back to a page where he had a submitted POST data the browser keeps telling that the data has expired and asks if repost. How to avoid that? I tried registering all POST and GET vars as SESSION vars but
1
6873
by: inderjit S Gabrie | last post by:
Hi all Here is the scenerio ...is it possibly to do this... i am getting valid course dates output on to a web which i have designed ....all is okay so far , look at the following web url http://www.mis.gla.ac.uk/biquery/training/ but each of the courses held have maximum of 8 people that could be
2
31446
by: Jack | last post by:
Hi All, What is the PHP equivilent of Oracle bind variables in a SQL statement, e.g. select x from y where z=:parameter Which in asp/jsp would be followed by some statements to bind a value to :parameter I dont like the idea of making the SQL statement on the fly without binding parameters as I dont want a highly polluted SQL cache.
3
23605
by: Sandwick | last post by:
I am trying to change the size of a drawing so they are all 3x3. the script below is what i was trying to use to cut it in half ... I get errors. I can display the normal picture but not the results of the picture half the size. The PHP I have installed support 1.62 or higher. And all I would like to do is take and image and make it fit a 3x3. Any suggestions to where I should read or look would be appreciated.
0
9699
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10302
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
10281
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
10058
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
9111
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
7597
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6835
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
1
4270
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
3
2966
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.