473,705 Members | 2,446 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Large partitioned table issue

Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.

Any takers?

Regards,
Steve Keanie
Ministry of Transport, Ontario

Aug 22 '06 #1
11 1887
<st**********@r ogers.comwrote in message
news:11******** *************@i 42g2000cwa.goog legroups.com...
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.

Any takers?

Regards,
Steve Keanie
Ministry of Transport, Ontario
First of all, there is no product named DB/2. It is DB2. You must be an old
fart who remembers PS/2 and OS/2 and think that everything must end in /2
from IBM.

I would take a look at UNION ALL views, with constraints defined as to which
data goes into which table. If DB2 can identify where the data is located by
the constraint, it will only look at the table(s) necessary and ignore the
others. The UNION ALL view will shield the application from knowing which
tables to access.
Aug 22 '06 #2
st**********@ro gers.com wrote:
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8. My
application team is converting an IMS DB into a DB/2 table ...
approximately 40GB of uncompressed (~20 GB compressed) data spread over
10 partitions. Approximately 35% of the data is "inactive" (easily
identifiable as such) and of limited (but some) use. We require 2
non-partitioning indexes on the data. The DBA group would like us to
put the "inactive" data into a separate table because of the sort
resource requirements to build the NPIs. Separating the data into two
tables would require application code to decide which table needs to be
accessed. Before agreeing to make application changes based on
operational requirements, I'd like some informed decisions as to
whether this should really be necessary and whether it will achieve
what the DBA group says it will.
Just to clarify you are talking about DB2 V8 for zOS, right?

--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ond...ness/conf2006/
Aug 22 '06 #3
st**********@ro gers.com wrote:
Hi ... we're a mainframe V7 shop planning an imminent upgrade to V8.
Are your NPIs unique? If not and if you are upgrading to V8, why not
use DPSI? That eliminates most of the problmes associated with NPIs.

P Adhia

Aug 22 '06 #4
Mark A wrote:
I would take a look at UNION ALL views, with constraints defined as to which
UNION ALL views are not updatable in z/OS DB2. So if you can isolate
coding changes that update/insert/delete to use the base tables and use
views for all queries, this would work. Also, if you design this in V7,
then have your system programmers to verify that they have applied
APARs that enable query pruning (equality predicates only though)

Regards

P Adhia

Aug 22 '06 #5
>
First of all, there is no product named DB/2. It is DB2. You must be an old
fart who remembers PS/2 and OS/2 and think that everything must end in /2
from IBM.
Actually, I'm a vintage fart with a somewhat nutty bouquet and a hint
of cheesiness, but I thought it was called DB/2 because it aspired to
one day perform half as well as IMS :-)
>
I would take a look at UNION ALL views, with constraints defined as to which
data goes into which table. If DB2 can identify where the data is located by
the constraint, it will only look at the table(s) necessary and ignore the
others. The UNION ALL view will shield the application from knowing which
tables to access.
Aug 23 '06 #6

Serge Rielau wrote:
Just to clarify you are talking about DB2 V8 for zOS, right?
Yes Serge, that is correct.

Aug 23 '06 #7
st**********@ro gers.com wrote:
Serge Rielau wrote:
>Just to clarify you are talking about DB2 V8 for zOS, right?
Yes Serge, that is correct.
OK, now keeping in mind that I'm ignorant to how the storage model works
on zOS, couldn't you just use a range partitioned table to achieve what
you want?

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ond...ness/conf2006/
Aug 23 '06 #8
<st**********@r ogers.comwrote in message
news:11******** **************@ m73g2000cwd.goo glegroups.com.. .
Actually, I'm a vintage fart with a somewhat nutty bouquet and a hint
of cheesiness, but I thought it was called DB/2 because it aspired to
one day perform half as well as IMS :-)
IMS was IBM's first database and Database 2 was IBM's second. Later the name
was officially shortened to DB2.

While it is true that IMS can perform faster than DB2 in certain situations
(although not as many as you think), many DB2 schema changes can be made
while the system is running in production (even changes to existing tables),
and users and programmers can access the data without a extensive knowledge
of programming or DL/I.
Aug 23 '06 #9
"Serge Rielau" <sr*****@ca.ibm .comwrote in message
news:4l******** ***@individual. net...
OK, now keeping in mind that I'm ignorant to how the storage model works
on zOS, couldn't you just use a range partitioned table to achieve what
you want?

Cheers
Serge
--
Serge Rielau
DB2 Solutions Development
IBM Toronto Lab
In the OP, he said that:

"The DBA group would like us to put the "inactive" data into a separate
table because of the sort resource requirements to build the NPIs."

I don't know if that is a legitimate concern, but it was a constraint that I
was operating under when I suggested UNION ALL views.
Aug 23 '06 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

8
3848
by: robin | last post by:
I need to do a search through about 50 million records, each of which are less than 100 bytes wide. A database is actually too slow for this, so I thought of optimising the data and putting it all in memory. There is a single key field, so a dictionary is an obvious choice for a structure, since Python optimises these nicely. But is there a better choice? Is it worth building some sort of tree?
36
6389
by: Andrea Griffini | last post by:
I did it. I proposed python as the main language for our next CAD/CAM software because I think that it has all the potential needed for it. I'm not sure yet if the decision will get through, but something I'll need in this case is some experience-based set of rules about how to use python in this context. For example... is defining readonly attributes in classes worth the hassle ? Does duck-typing scale well in complex
1
3233
by: SM | last post by:
/* problem: Trying to get partitioned views to "prune" unneeded partitions from select statements against the partitioned view. There are 5 partitioned tables. Each with a check constraint based on a range of formula_id column. Test: Run this script to create the 5 partitioned tables and the partitioned view. Then
4
4142
by: jeff brubaker | last post by:
Hello, Currently we have a database, and it is our desire for it to be able to store millions of records. The data in the table can be divided up by client, and it stores nothing but about 7 integers. | table | | id | clientId | int1 | int2 | int 3 | ... | Right now, our benchmarks indicate a drastic increase in performance if we divide the data into different tables. For example,...
8
3696
by: Jack | last post by:
I have a test database that I have built in a 3 partition (and 3 node) environment. I have defined all the tables so they have the same partition key. The tables (7 of them) form a hierarchical arrangement. The data is all bogus, so I using the generate_unique function to come up with a partitioning key for each record. This is all done through a stored proc with will insert about 90 records in the heirarchy. The behavior that I am...
8
4079
by: Lee | last post by:
guys, I have a project need to move more than 100,000 records from one database table to another database table every week. Currently, users input date range from web UI, my store procedure will take those date ranges to INSERT records to a table in another database, then delete the records, but it will take really long time to finish this action (up to 1 or 2 hours). My question is if there is some other way I should do to speed up...
0
1670
by: Damir | last post by:
Hello all! I created a range-partitioned table, and noticed that indexes were created as "NOT PARTITIONED" (through db2look), even though I ran the index creating commands without this parameter. Not that I care too much now about it :-) But what will happen when once upon a time in the future I execute the "attach partition" command, and so add another partition to the existing (partitioned) table. Will the indexes then be automatically...
10
2864
by: nflacco | last post by:
I'm tinkering around with a data collection system, and have come up with a very hackish way to store my data- for reference, I'm anticipating collecting at least 100 million different dataId whatevers per year, possibly much more. ---366 data tables ( one for each day of the year ), each row being assigned a unique DataId ( unique across all 366 tables too ) ---100 data_map tables, table 0 having all DataIds ending in 00, table 99...
2
13607
by: eeriehunk | last post by:
Hi All, Is it possible to create a partitioned index on a table which is not partitioned? If so what is such a partition called and please explain? I have done some research on partitions and index partitions and this is where I hit the wall the 2nd time. As per my study there are 3 types of indexed partitions: Global index (which is on an entire partitioned table) then there is Local Index (on just the partition of the table) and then there...
0
8767
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
8689
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
8979
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
7893
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
6605
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
5933
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
4439
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
4703
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
2486
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.