Any designs required to enhance PARALLEL load

lambert101

All,

Running environment is non-partition database for datawarehouse with
DB2 V8.2 on AIX.

We have a few logical grouping of tables that we would like to load in
parallel to save time. Each grouping may load up more than 10 GB of
data.

Are there any (physical) designs that may enhance loading tables in
parallel?

Thanks!

Feb 2 '07 #1

Subscribe Post Reply

1840

lambert101

On Feb 3, 10:03 am, lambert...@gmail.com wrote:

All,

Running environment is non-partition database for datawarehouse with
DB2 V8.2 on AIX.

We have a few logical grouping of tables that we would like to load in
parallel to save time. Each grouping may load up more than 10 GB of
data.

Are there any (physical) designs that may enhance loading tables in
parallel?

Thanks!

Just want to clear one uncertainty: would placing tables to be loaded
in separate tablespaces help? Thanks!

Feb 5 '07 #2

Knut Stolze

la********@gmail.com wrote:

On Feb 3, 10:03 am, lambert...@gmail.com wrote:
>Running environment is non-partition database for datawarehouse with
DB2 V8.2 on AIX.

We have a few logical grouping of tables that we would like to load in
parallel to save time. Each grouping may load up more than 10 GB of
data.

Are there any (physical) designs that may enhance loading tables in
parallel?

Just want to clear one uncertainty: would placing tables to be loaded
in separate tablespaces help? Thanks!

Placing the data on multiple disks could take advantage of parallel I/O
operations for sure.

--
Knut Stolze
DB2 z/OS Utilities Development
IBM Germany

Feb 6 '07 #3

Ian

la********@gmail.com wrote:

All,

Running environment is non-partition database for datawarehouse with
DB2 V8.2 on AIX.

We have a few logical grouping of tables that we would like to load in
parallel to save time. Each grouping may load up more than 10 GB of
data.

There's nothing in DB2 that *prevents* you from loading 2 tables at the
same time. Performance may not be great if all data is on the same
disks (regardless of whether the tables are in separate tablespaces), or
if you have CPU utilization issues. But it will work.

Feb 6 '07 #4

Similar topics

Loading websites in parallel

by: Markus Franz | last post by:

Hi. I have a difficult problem: An array contains several different URLs. I want to load these websites in parallel by using a HTTP-Request. How can I do this in PHP? Up to now I did this...

PHP

Parallel execution (CGI)

by: mmf | last post by:

Hi! I am using Python for CGI scripting. I had the following script: #!/usr/bin/python import sys print 'Content-type: text/html\r\n\r\n' print 'starting...' sys.stdout.flush() x = 999999

Python

145

What are the best css designs?

by: Mark Johnson | last post by:

Oddly enough, I found it difficult, using Google, to find a list of best-of sites based on the quality of their css packages. So I'd ask. Does anyone know of particularly good sites which are in...

HTML / CSS

Threads: Issue and suggestion required

by: Sandeep Arya | last post by:

Hello I am developing an application using PyQT. My application scenario is:: "At any instance one socket is open in my application. Now if user wants to execute some command on another...

Python

Can not run DB2LOAD in parallel

by: nekiv90 | last post by:

Greetings, We need to initial load hundreds of tables from within programs. We try to run several programs that call the DB2LOAD in parallel (to load different tables of course) in order to...

DB2 Database

code using more memory than required

by: Sourin | last post by:

Hi all, I am trying to write code for my experiments. My work involves huge datasets, and as such my code needs to be memory efficient. I did some hand calculations regarding the amount of...

C / C++

Thousands of parallel connections

by: Peter Eisentraut | last post by:

Is there any practical limit on the number of parallel connections that a PostgreSQL server can service? We're in the process of setting up a system that will require up to 10000 connections open...

PostgreSQL Database

Workaround for WaitHandle limitation?

by: Dave Booker | last post by:

I'm doing some analysis that is readily broken up into many independent pieces, on a multicore machine. I thought it would be best to just queue like 1000 of these pieces in the ThreadPool, and...

C# / C Sharp

How to turn on java script in a villaon keypad mobile phone

by: Charles Arthur | last post by:

How do i turn on java script on a villaon, callus and itel keypad mobile phone

Java

Batch import of multiple excel files into the database

by: ryjfgjl | last post by:

If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...

Data Management

Migrating Website to Cloud - Emmanuel Katto

by: emmanuelkatto | last post by:

Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel

General

Navigating the Data Structures and Algorithms (DSA)

by: BarryA | last post by:

What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...

Algorithms / Advanced Math

Is that possible of reading the .csv file in column wise and the column have different lengths ?

by: Sonnysonu | last post by:

This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...

C / C++

How to build RAID in BIOS?

by: Hystou | last post by:

There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...

Computer Hardware

What is ONU?

by: marktang | last post by:

ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...

General

Problem With Comparison Operator <=> in G++

by: Oralloy | last post by:

Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...

C / C++

Maximizing Business Potential: The Nexus of Website Design and Digital Marketing

by: jinu1996 | last post by:

In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

Online Marketing