473,811 Members | 3,424 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Large partitioned table issue

Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.

Any takers?

Regards,
Steve Keanie
Ministry of Transport, Ontario

Aug 22 '06 #1
11 1893
<st**********@r ogers.comwrote in message
news:11******** *************@i 42g2000cwa.goog legroups.com...
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.

Any takers?

Regards,
Steve Keanie
Ministry of Transport, Ontario
First of all, there is no product named DB/2. It is DB2. You must be an old
fart who remembers PS/2 and OS/2 and think that everything must end in /2
from IBM.

I would take a look at UNION ALL views, with constraints defined as to which
data goes into which table. If DB2 can identify where the data is located by
the constraint, it will only look at the table(s) necessary and ignore the
others. The UNION ALL view will shield the application from knowing which
tables to access.
Aug 22 '06 #2
st**********@ro gers.com wrote:
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.
Just to clarify you are talking about DB2 V8 for zOS, right?

--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ond...ness/conf2006/
Aug 22 '06 #3
st**********@ro gers.com wrote:
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8.
Are your NPIs unique? If not and if you are upgrading to V8, why not
use DPSI? That eliminates most of the problmes associated with NPIs.

P Adhia

Aug 22 '06 #4
Mark A wrote:
I would take a look at UNION ALL views, with constraints defined as to which
UNION ALL views are not updatable in z/OS DB2. So if you can isolate
coding changes that update/insert/delete to use the base tables and use
views for all queries, this would work. Also, if you design this in V7,
then have your system programmers to verify that they have applied
APARs that enable query pruning (equality predicates only though)

Regards

P Adhia

Aug 22 '06 #5
>
First of all, there is no product named DB/2. It is DB2. You must be an old
fart who remembers PS/2 and OS/2 and think that everything must end in /2
from IBM.
Actually, I'm a vintage fart with a somewhat nutty bouquet and a hint
of cheesiness, but I thought it was called DB/2 because it aspired to
one day perform half as well as IMS :-)
>
I would take a look at UNION ALL views, with constraints defined as to which
data goes into which table. If DB2 can identify where the data is located by
the constraint, it will only look at the table(s) necessary and ignore the
others. The UNION ALL view will shield the application from knowing which
tables to access.
Aug 23 '06 #6

Serge Rielau wrote:
Just to clarify you are talking about DB2 V8 for zOS, right?
Yes Serge, that is correct.

Aug 23 '06 #7
st**********@ro gers.com wrote:
Serge Rielau wrote:
>Just to clarify you are talking about DB2 V8 for zOS, right?
Yes Serge, that is correct.
OK, now keeping in mind that I'm ignorant to how the storage model works
on zOS, couldn't you just use a range partitioned table to achieve what
you want?

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ond...ness/conf2006/
Aug 23 '06 #8
<st**********@r ogers.comwrote in message
news:11******** **************@ m73g2000cwd.goo glegroups.com.. .
Actually, I'm a vintage fart with a somewhat nutty bouquet and a hint
of cheesiness, but I thought it was called DB/2 because it aspired to
one day perform half as well as IMS :-)
IMS was IBM's first database and Database 2 was IBM's second. Later the name
was officially shortened to DB2.

While it is true that IMS can perform faster than DB2 in certain situations
(although not as many as you think), many DB2 schema changes can be made
while the system is running in production (even changes to existing tables),
and users and programmers can access the data without a extensive knowledge
of programming or DL/I.
Aug 23 '06 #9
"Serge Rielau" <sr*****@ca.ibm .comwrote in message
news:4l******** ***@individual. net...
OK, now keeping in mind that I'm ignorant to how the storage model works
on zOS, couldn't you just use a range partitioned table to achieve what
you want?

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
In the OP, he said that:

"The DBA group would like us to put the "inactive" data into a separate
table because of the sort resource requirements to build the NPIs."

I don't know if that is a legitimate concern, but it was a constraint that I
was operating under when I suggested UNION ALL views.
Aug 23 '06 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

8
3851
by: robin | last post by:
I need to do a search through about 50 million records, each of which are less than 100 bytes wide. A database is actually too slow for this, so I thought of optimising the data and putting it all in memory. There is a single key field, so a dictionary is an obvious choice for a structure, since Python optimises these nicely. But is there a better choice? Is it worth building some sort of tree?
36
6414
by: Andrea Griffini | last post by:
I did it. I proposed python as the main language for our next CAD/CAM software because I think that it has all the potential needed for it. I'm not sure yet if the decision will get through, but something I'll need in this case is some experience-based set of rules about how to use python in this context. For example... is defining readonly attributes in classes worth the hassle ? Does duck-typing scale well in complex
1
3237
by: SM | last post by:
/* problem: Trying to get partitioned views to "prune" unneeded partitions from select statements against the partitioned view. There are 5 partitioned tables. Each with a check constraint based on a range of formula_id column. Test: Run this script to create the 5 partitioned tables and the partitioned view. Then
4
4147
by: jeff brubaker | last post by:
Hello, Currently we have a database, and it is our desire for it to be able to store millions of records. The data in the table can be divided up by client, and it stores nothing but about 7 integers. | table | | id | clientId | int1 | int2 | int 3 | ... | Right now, our benchmarks indicate a drastic increase in performance if we divide the data into different tables. For example,...
8
3704
by: Jack | last post by:
I have a test database that I have built in a 3 partition (and 3 node) environment. I have defined all the tables so they have the same partition key. The tables (7 of them) form a hierarchical arrangement. The data is all bogus, so I using the generate_unique function to come up with a partitioning key for each record. This is all done through a stored proc with will insert about 90 records in the heirarchy. The behavior that I am...
8
4081
by: Lee | last post by:
guys, I have a project need to move more than 100,000 records from one database table to another database table every week. Currently, users input date range from web UI, my store procedure will take those date ranges to INSERT records to a table in another database, then delete the records, but it will take really long time to finish this action (up to 1 or 2 hours). My question is if there is some other way I should do to speed up...
0
1681
by: Damir | last post by:
Hello all! I created a range-partitioned table, and noticed that indexes were created as "NOT PARTITIONED" (through db2look), even though I ran the index creating commands without this parameter. Not that I care too much now about it :-) But what will happen when once upon a time in the future I execute the "attach partition" command, and so add another partition to the existing (partitioned) table. Will the indexes then be automatically...
10
2872
by: nflacco | last post by:
I'm tinkering around with a data collection system, and have come up with a very hackish way to store my data- for reference, I'm anticipating collecting at least 100 million different dataId whatevers per year, possibly much more. ---366 data tables ( one for each day of the year ), each row being assigned a unique DataId ( unique across all 366 tables too ) ---100 data_map tables, table 0 having all DataIds ending in 00, table 99...
2
13627
by: eeriehunk | last post by:
Hi All, Is it possible to create a partitioned index on a table which is not partitioned? If so what is such a partition called and please explain? I have done some research on partitions and index partitions and this is where I hit the wall the 2nd time. As per my study there are 3 types of indexed partitions: Global index (which is on an entire partitioned table) then there is Local Index (on just the partition of the table) and then there...
0
9730
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10392
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
10403
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
10136
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
7671
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6893
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5693
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
3868
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
3020
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.