XML, ETL tool and db2 Version 8.2 FP13 on AIX

[bernard.charriere]

Hello,

We have to load and store datas in format XML in a Database DB2 V8.1
FP13, instance 64 bits with DataPartitionned Feature, around 3 Tb of
datas stored in the DB ( 6 Generations of 500 Gb ). Platform is an AIX
5.3.0 64 bits.

The version DB2 9.1 allows to store XML format, it would help us but we
can not use this version because the ETL tool ( Powercenter 8.1.0 )
wich will extract the Datas from DB source Oracle does not support DB2
V9.1, this tool will also extract and transform the data since our
DB2UDB to prepare the continuation of the Workflow.
As input for the DB2 we wouldlike to receive flat files to load into
the DB2 DB, we hope to load those Files with good performances.

For the version DB2 V8.1 FP 13 : as I know, is it possible to store XML
datas under the format of CLOB's or under another pseudo-format XML
with the XML Extenders

I have 3 questions :
1) Have somebody of you already installed a same kind of system with
success ?
2) Have somedody of you already tryed to install a same kind of system
without success, if yes what kind of problem did you met ?
3) XML Extenders are included in DB2 V8.1, have you already used them
in a Data Partionned Feature environment ?

All kinds of remarqs and suggestions are welcome.

Regards.
Bernard

[Joachim Müller]

be***************@swisscom.com schrieb:

Hello,

We have to load and store datas in format XML in a Database DB2 V8.1
FP13, instance 64 bits with DataPartitionned Feature, around 3 Tb of
datas stored in the DB ( 6 Generations of 500 Gb ). Platform is an AIX
5.3.0 64 bits.

The version DB2 9.1 allows to store XML format, it would help us but we
can not use this version because the ETL tool ( Powercenter 8.1.0 )
wich will extract the Datas from DB source Oracle does not support DB2
V9.1, this tool will also extract and transform the data since our
DB2UDB to prepare the continuation of the Workflow.
As input for the DB2 we wouldlike to receive flat files to load into
the DB2 DB, we hope to load those Files with good performances.

For the version DB2 V8.1 FP 13 : as I know, is it possible to store XML
datas under the format of CLOB's or under another pseudo-format XML
with the XML Extenders

I have 3 questions :
1) Have somebody of you already installed a same kind of system with
success ?
2) Have somedody of you already tryed to install a same kind of system
without success, if yes what kind of problem did you met ?
3) XML Extenders are included in DB2 V8.1, have you already used them
in a Data Partionned Feature environment ?

All kinds of remarqs and suggestions are welcome.

Regards.
Bernard

Hello Bernhard,

we are using the XML Extender only for shredding the data into
relational tables. But you can only use 32bit, because the XML Extender
works only in 32bit. Now we have to migrate to DB2 Version 9.1 for the
new xml datatype to store and for the new shredder, which is 8 times faster.

Best regards,
Joachim Müller

[Vijay Bommireddipalli]

hi Bernard,

While I have never tried PowerCenter or installed a similar system...
Regarding your comment about the support of PowerCenter for DB2 9. -
Most ETL tools allow you to write and run scripts. Have you considering
running db2 scripts (via PowerCenter) that will load XML data from
files into DB2 9 ?
But before recommending DB2 9's native XML capabilities. I have a
couple of questions.

What is the size of the XML documents that you are planning to insert ?
What are you planning to do with the inserted XML ?

Also note that in DB2 9 , you still have the shredding option, and the
shredding performance is much improved in comparison to v8.x

Do feel free to get in touch via email if you choose.

Vijay Bommireddipalli
vi*****@us.ibm.com

be***************@swisscom.com wrote:

Hello,

We have to load and store datas in format XML in a Database DB2 V8.1
FP13, instance 64 bits with DataPartitionned Feature, around 3 Tb of
datas stored in the DB ( 6 Generations of 500 Gb ). Platform is an AIX
5.3.0 64 bits.

The version DB2 9.1 allows to store XML format, it would help us but we
can not use this version because the ETL tool ( Powercenter 8.1.0 )
wich will extract the Datas from DB source Oracle does not support DB2
V9.1, this tool will also extract and transform the data since our
DB2UDB to prepare the continuation of the Workflow.
As input for the DB2 we wouldlike to receive flat files to load into
the DB2 DB, we hope to load those Files with good performances.

For the version DB2 V8.1 FP 13 : as I know, is it possible to store XML
datas under the format of CLOB's or under another pseudo-format XML
with the XML Extenders

I have 3 questions :
1) Have somebody of you already installed a same kind of system with
success ?
2) Have somedody of you already tryed to install a same kind of system
without success, if yes what kind of problem did you met ?
3) XML Extenders are included in DB2 V8.1, have you already used them
in a Data Partionned Feature environment ?

All kinds of remarqs and suggestions are welcome.

Regards.
Bernard

[bernard.charriere]

Hi Vijay,

Thanks for your Answer,
I still have a couple of things to clarify with the developpers.
I know now,that they will use Powercenter to insert Datas ( not in
Format XML and no load ) into DB2 V8.1 FP13 DB from an existing Oracle
Database; then extract the Data and formatting in XML docs. If it's
real so, the datas will not be store in XML format.
They also talk about a Scheduler (UC4 )to run scripts.

As I know, the next Version of ETL ( Powercenter 8.1.1) will probably
support DB2 V9.1

Anyway, thanks for your answer and support.

Bernard
Vijay Bommireddipalli a écrit :

hi Bernard,

While I have never tried PowerCenter or installed a similar system...
Regarding your comment about the support of PowerCenter for DB2 9. -
Most ETL tools allow you to write and run scripts. Have you considering
running db2 scripts (via PowerCenter) that will load XML data from
files into DB2 9 ?
But before recommending DB2 9's native XML capabilities. I have a
couple of questions.

What is the size of the XML documents that you are planning to insert ?
What are you planning to do with the inserted XML ?

Also note that in DB2 9 , you still have the shredding option, and the
shredding performance is much improved in comparison to v8.x

Do feel free to get in touch via email if you choose.

Vijay Bommireddipalli
vi*****@us.ibm.com

be***************@swisscom.com wrote:

Hello,

We have to load and store datas in format XML in a Database DB2 V8.1
FP13, instance 64 bits with DataPartitionned Feature, around 3 Tb of
datas stored in the DB ( 6 Generations of 500 Gb ). Platform is an AIX
5.3.0 64 bits.

The version DB2 9.1 allows to store XML format, it would help us but we
can not use this version because the ETL tool ( Powercenter 8.1.0 )
wich will extract the Datas from DB source Oracle does not support DB2
V9.1, this tool will also extract and transform the data since our
DB2UDB to prepare the continuation of the Workflow.
As input for the DB2 we wouldlike to receive flat files to load into
the DB2 DB, we hope to load those Files with good performances.

For the version DB2 V8.1 FP 13 : as I know, is it possible to store XML
datas under the format of CLOB's or under another pseudo-format XML
with the XML Extenders

I have 3 questions :
1) Have somebody of you already installed a same kind of system with
success ?
2) Have somedody of you already tryed to install a same kind of system
without success, if yes what kind of problem did you met ?
3) XML Extenders are included in DB2 V8.1, have you already used them
in a Data Partionned Feature environment ?

All kinds of remarqs and suggestions are welcome.

Regards.
Bernard