473,386 Members | 1,720 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,386 software developers and data experts.

Large partitioned table issue

Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.

Any takers?

Regards,
Steve Keanie
Ministry of Transport, Ontario

Aug 22 '06 #1
11 1861
<st**********@rogers.comwrote in message
news:11*********************@i42g2000cwa.googlegro ups.com...
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.

Any takers?

Regards,
Steve Keanie
Ministry of Transport, Ontario
First of all, there is no product named DB/2. It is DB2. You must be an old
fart who remembers PS/2 and OS/2 and think that everything must end in /2
from IBM.

I would take a look at UNION ALL views, with constraints defined as to which
data goes into which table. If DB2 can identify where the data is located by
the constraint, it will only look at the table(s) necessary and ignore the
others. The UNION ALL view will shield the application from knowing which
tables to access.
Aug 22 '06 #2
st**********@rogers.com wrote:
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.
Just to clarify you are talking about DB2 V8 for zOS, right?

--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ond...ness/conf2006/
Aug 22 '06 #3
st**********@rogers.com wrote:
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8.
Are your NPIs unique? If not and if you are upgrading to V8, why not
use DPSI? That eliminates most of the problmes associated with NPIs.

P Adhia

Aug 22 '06 #4
Mark A wrote:
I would take a look at UNION ALL views, with constraints defined as to which
UNION ALL views are not updatable in z/OS DB2. So if you can isolate
coding changes that update/insert/delete to use the base tables and use
views for all queries, this would work. Also, if you design this in V7,
then have your system programmers to verify that they have applied
APARs that enable query pruning (equality predicates only though)

Regards

P Adhia

Aug 22 '06 #5
>
First of all, there is no product named DB/2. It is DB2. You must be an old
fart who remembers PS/2 and OS/2 and think that everything must end in /2
from IBM.
Actually, I'm a vintage fart with a somewhat nutty bouquet and a hint
of cheesiness, but I thought it was called DB/2 because it aspired to
one day perform half as well as IMS :-)
>
I would take a look at UNION ALL views, with constraints defined as to which
data goes into which table. If DB2 can identify where the data is located by
the constraint, it will only look at the table(s) necessary and ignore the
others. The UNION ALL view will shield the application from knowing which
tables to access.
Aug 23 '06 #6

Serge Rielau wrote:
Just to clarify you are talking about DB2 V8 for zOS, right?
Yes Serge, that is correct.

Aug 23 '06 #7
st**********@rogers.com wrote:
Serge Rielau wrote:
>Just to clarify you are talking about DB2 V8 for zOS, right?
Yes Serge, that is correct.
OK, now keeping in mind that I'm ignorant to how the storage model works
on zOS, couldn't you just use a range partitioned table to achieve what
you want?

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ond...ness/conf2006/
Aug 23 '06 #8
<st**********@rogers.comwrote in message
news:11**********************@m73g2000cwd.googlegr oups.com...
Actually, I'm a vintage fart with a somewhat nutty bouquet and a hint
of cheesiness, but I thought it was called DB/2 because it aspired to
one day perform half as well as IMS :-)
IMS was IBM's first database and Database 2 was IBM's second. Later the name
was officially shortened to DB2.

While it is true that IMS can perform faster than DB2 in certain situations
(although not as many as you think), many DB2 schema changes can be made
while the system is running in production (even changes to existing tables),
and users and programmers can access the data without a extensive knowledge
of programming or DL/I.
Aug 23 '06 #9
"Serge Rielau" <sr*****@ca.ibm.comwrote in message
news:4l***********@individual.net...
OK, now keeping in mind that I'm ignorant to how the storage model works
on zOS, couldn't you just use a range partitioned table to achieve what
you want?

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
In the OP, he said that:

"The DBA group would like us to put the "inactive" data into a separate
table because of the sort resource requirements to build the NPIs."

I don't know if that is a legitimate concern, but it was a constraint that I
was operating under when I suggested UNION ALL views.
Aug 23 '06 #10

Mark A wrote:
While it is true that IMS can perform faster than DB2 in certain situations
(although not as many as you think), many DB2 schema changes can be made
while the system is running in production (even changes to existing tables),
and users and programmers can access the data without a extensive knowledge
of programming or DL/I.
Gee, I didn't realize DB2 could do all that ... is it, like, relational
too? Thanks for setting me straight, sonny! ;-)

Aug 23 '06 #11
<st**********@rogers.comwrote in message
news:11*********************@75g2000cwc.googlegrou ps.com...
>
Gee, I didn't realize DB2 could do all that ... is it, like, relational
too? Thanks for setting me straight, sonny! ;-)
You are welcome grandpa.
Aug 23 '06 #12

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

8
by: robin | last post by:
I need to do a search through about 50 million records, each of which are less than 100 bytes wide. A database is actually too slow for this, so I thought of optimising the data and putting it all...
36
by: Andrea Griffini | last post by:
I did it. I proposed python as the main language for our next CAD/CAM software because I think that it has all the potential needed for it. I'm not sure yet if the decision will get through, but...
1
by: SM | last post by:
/* problem: Trying to get partitioned views to "prune" unneeded partitions from select statements against the partitioned view. There are 5 partitioned tables. Each with a check constraint...
4
by: jeff brubaker | last post by:
Hello, Currently we have a database, and it is our desire for it to be able to store millions of records. The data in the table can be divided up by client, and it stores nothing but about 7...
8
by: Jack | last post by:
I have a test database that I have built in a 3 partition (and 3 node) environment. I have defined all the tables so they have the same partition key. The tables (7 of them) form a hierarchical...
8
by: Lee | last post by:
guys, I have a project need to move more than 100,000 records from one database table to another database table every week. Currently, users input date range from web UI, my store procedure will...
0
by: Damir | last post by:
Hello all! I created a range-partitioned table, and noticed that indexes were created as "NOT PARTITIONED" (through db2look), even though I ran the index creating commands without this parameter....
10
by: nflacco | last post by:
I'm tinkering around with a data collection system, and have come up with a very hackish way to store my data- for reference, I'm anticipating collecting at least 100 million different dataId...
2
by: eeriehunk | last post by:
Hi All, Is it possible to create a partitioned index on a table which is not partitioned? If so what is such a partition called and please explain? I have done some research on partitions and index...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.