Connecting Tech Pros Worldwide Help | Site Map
 
 
LinkBack Thread Tools Search this Thread
  #1  
Old November 12th, 2005, 06:25 AM
maricel
Guest
 
Posts: n/a
Default db2 export - how to make it faster

Is there anybody out there who have any idea why EXPORT is relatively slower
when putting the output file on a network drive - map drive from onother PC
compared to putting it on my local PC drive (faster). Is there any
workaround or tuning config that is available?

Your help would be highly appreciated.

maricel


  #2  
Old November 12th, 2005, 06:25 AM
Jan M. Nelken
Guest
 
Posts: n/a
Default Re: db2 export - how to make it faster

maricel wrote:[color=blue]
> Is there anybody out there who have any idea why EXPORT is relatively slower
> when putting the output file on a network drive - map drive from onother PC
> compared to putting it on my local PC drive (faster). Is there any
> workaround or tuning config that is available?
>
> Your help would be highly appreciated.
>
> maricel
>
>[/color]

*BEFORE* I would start looking into DB2 tuning - I would verify that I
am really describing correctly the problem:

Run a benchmark writing a relatively large file - (say 10Mb) with a
relativel small records (say 100b) on local drive - at least 10 times.

Repeat the same using networked drive.

Have a DB2 export command creating on local drive result file of the
same size as benchmark above - also at least 10 times.

Repeat the same using networked drive.


Now you have a base to compare results - assuming that environment for
all 4 benchmark runs above was consistently the same.


Jan M. Nelken

  #3  
Old November 12th, 2005, 06:25 AM
maricel
Guest
 
Posts: n/a
Default Re: db2 export - how to make it faster

Hi Jan,

Thanks for this. Actually, i'm the only one connected to the network, so, I
guess network load should not be the problem.
I have noted that the EXPORT IXF file type takes relatively longer to
transport via a network drive compared to export DEL file type.

Any idea on this?

maricel

"Jan M. Nelken" <Unknown.User@Invalid.Domain> wrote in message
news:ZIQSb.72657$9Ce1.22499@news04.bloor.is.net.ca ble.rogers.com...[color=blue]
> maricel wrote:[color=green]
> > Is there anybody out there who have any idea why EXPORT is relatively[/color][/color]
slower[color=blue][color=green]
> > when putting the output file on a network drive - map drive from onother[/color][/color]
PC[color=blue][color=green]
> > compared to putting it on my local PC drive (faster). Is there any
> > workaround or tuning config that is available?
> >
> > Your help would be highly appreciated.
> >
> > maricel
> >
> >[/color]
>
> *BEFORE* I would start looking into DB2 tuning - I would verify that I
> am really describing correctly the problem:
>
> Run a benchmark writing a relatively large file - (say 10Mb) with a
> relativel small records (say 100b) on local drive - at least 10 times.
>
> Repeat the same using networked drive.
>
> Have a DB2 export command creating on local drive result file of the
> same size as benchmark above - also at least 10 times.
>
> Repeat the same using networked drive.
>
>
> Now you have a base to compare results - assuming that environment for
> all 4 benchmark runs above was consistently the same.
>
>
> Jan M. Nelken
>[/color]


  #4  
Old November 12th, 2005, 06:25 AM
Jan M. Nelken
Guest
 
Posts: n/a
Default Re: db2 export - how to make it faster

maricel wrote:[color=blue]
> Hi Jan,
>
> Thanks for this. Actually, i'm the only one connected to the network, so, I
> guess network load should not be the problem.
> I have noted that the EXPORT IXF file type takes relatively longer to
> transport via a network drive compared to export DEL file type.
>
> Any idea on this?
>
> maricel[/color]

I was not thinking about network load. You do go through significantly
different code path of the underlying components of operating system
when writing to redirected drive.

As for second question:

D:\>db2 connect to sample

Database Connection Information

Database server = DB2/NT 8.1.4
SQL authorization ID = DB2ADMIN
Local database alias = SAMPLE


D:\>db2 export to employee.del of del select * from employee
SQL3104N The Export utility is beginning to export data to file
"employee.del".

SQL3105N The Export utility has finished exporting "32" rows.
Number of rows exported: 32

D:\>db2 export to employee.ixf of ixf select * from employee
SQL3104N The Export utility is beginning to export data to file
"employee.ixf".

SQL3105N The Export utility has finished exporting "32" rows.
Number of rows exported: 32

D:\>dir employee.*
Volume in drive D is Data Disk 1
Volume Serial Number is 7FEA-930E

Directory of D:\

31/01/2004 20:20 3,761 employee.del
31/01/2004 20:21 17,929 employee.ixf
2 File(s) 21,690 bytes

any thoughts about those results?
  #5  
Old November 12th, 2005, 06:25 AM
Anton Versteeg
Guest
 
Posts: n/a
Default Re: db2 export - how to make it faster

Have a look at the file sizes:
IXF export files are usually bigger than DEL export files, so that might
explain the difference.



maricel wrote:
[color=blue]
>Hi Jan,
>
>Thanks for this. Actually, i'm the only one connected to the network, so, I
>guess network load should not be the problem.
>I have noted that the EXPORT IXF file type takes relatively longer to
>transport via a network drive compared to export DEL file type.
>
>Any idea on this?
>
>maricel
>
>"Jan M. Nelken" <Unknown.User@Invalid.Domain> wrote in message
>news:ZIQSb.72657$9Ce1.22499@news04.bloor.is.net.c able.rogers.com...
>
>[color=green]
>>maricel wrote:
>>
>>[color=darkred]
>>>Is there anybody out there who have any idea why EXPORT is relatively
>>>
>>>[/color][/color]
>slower
>
>[color=green][color=darkred]
>>>when putting the output file on a network drive - map drive from onother
>>>
>>>[/color][/color]
>PC
>
>[color=green][color=darkred]
>>>compared to putting it on my local PC drive (faster). Is there any
>>>workaround or tuning config that is available?
>>>
>>>Your help would be highly appreciated.
>>>
>>>maricel
>>>
>>>
>>>
>>>[/color]
>>*BEFORE* I would start looking into DB2 tuning - I would verify that I
>>am really describing correctly the problem:
>>
>>Run a benchmark writing a relatively large file - (say 10Mb) with a
>>relativel small records (say 100b) on local drive - at least 10 times.
>>
>>Repeat the same using networked drive.
>>
>>Have a DB2 export command creating on local drive result file of the
>>same size as benchmark above - also at least 10 times.
>>
>>Repeat the same using networked drive.
>>
>>
>>Now you have a base to compare results - assuming that environment for
>>all 4 benchmark runs above was consistently the same.
>>
>>
>>Jan M. Nelken
>>
>>
>>[/color]
>
>
>
>[/color]

--
Anton Versteeg
IBM Certified DB2 Specialist
IBM Netherlands


  #6  
Old November 12th, 2005, 06:26 AM
PM \(pm3iinc-nospam\)
Guest
 
Posts: n/a
Default Re: db2 export - how to make it faster

If you search the net for windows and io performance, you'll find that
windows is slower when accessing shares, etc.
I guess that ntfs junctions and reparse points or pipes also suffer some
degradation.

Just for testing purpose, copy a big file to d:\ then on \\yourhost\d$\.
You'll notice a difference even if it's the same local location.

ex :
260mb
32 vs 36 sec

I can't provide you registry keys or any trick to improve this.
I'd have to check for myself first.

PM

"maricel" <maricel@xtra.co.nz> a écrit dans le message de
news:%7KSb.29342$9k7.554543@news.xtra.co.nz...[color=blue]
> Is there anybody out there who have any idea why EXPORT is relatively[/color]
slower[color=blue]
> when putting the output file on a network drive - map drive from onother[/color]
PC[color=blue]
> compared to putting it on my local PC drive (faster). Is there any
> workaround or tuning config that is available?
>
> Your help would be highly appreciated.
>
> maricel
>
>[/color]


  #7  
Old November 12th, 2005, 06:26 AM
maricel
Guest
 
Posts: n/a
Default Re: db2 export - how to make it faster

I can see the big difference. It shows that IXF file format is at least 5x
bigger than DEL.
Any other thoughts on why IXF file export is slower on Network Drive
compared to IXF export on local drive?

"Jan M. Nelken" <Unknown.User@Invalid.Domain> wrote in message
news:LzYSb.56200$ef.9332@twister01.bloor.is.net.ca ble.rogers.com...[color=blue]
> maricel wrote:[color=green]
> > Hi Jan,
> >
> > Thanks for this. Actually, i'm the only one connected to the network,[/color][/color]
so, I[color=blue][color=green]
> > guess network load should not be the problem.
> > I have noted that the EXPORT IXF file type takes relatively longer to
> > transport via a network drive compared to export DEL file type.
> >
> > Any idea on this?
> >
> > maricel[/color]
>
> I was not thinking about network load. You do go through significantly
> different code path of the underlying components of operating system
> when writing to redirected drive.
>
> As for second question:
>
> D:\>db2 connect to sample
>
> Database Connection Information
>
> Database server = DB2/NT 8.1.4
> SQL authorization ID = DB2ADMIN
> Local database alias = SAMPLE
>
>
> D:\>db2 export to employee.del of del select * from employee
> SQL3104N The Export utility is beginning to export data to file
> "employee.del".
>
> SQL3105N The Export utility has finished exporting "32" rows.
> Number of rows exported: 32
>
> D:\>db2 export to employee.ixf of ixf select * from employee
> SQL3104N The Export utility is beginning to export data to file
> "employee.ixf".
>
> SQL3105N The Export utility has finished exporting "32" rows.
> Number of rows exported: 32
>
> D:\>dir employee.*
> Volume in drive D is Data Disk 1
> Volume Serial Number is 7FEA-930E
>
> Directory of D:\
>
> 31/01/2004 20:20 3,761 employee.del
> 31/01/2004 20:21 17,929 employee.ixf
> 2 File(s) 21,690 bytes
>
> any thoughts about those results?[/color]


 

Bookmarks

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Popular Articles

What is Bytes?

We are a network of experts and professionals in IT and software development that help one another with answers to tough questions and share insights. Get the best answers to your questions from over 205,335 network members.