Bulk data transfer from csv file to Pervasive SQL (using .net framework 1.1)

[01423481d]

Hi All

I have created an interface to insert 70000 records from a csv file to
the Pervasive database one by one using ordinary sql statement, but
the performance is not satisfactory (it takes about 2 hrs to complete
the job). I just wonder if someone has experience on such case and can
share how to improve the performance?

Thanks
KC

[Cor Ligthert [MVP]]

Probably by bringing the file first to the server and process it from there.

Cor

<01*******@gmail.comschreef in bericht
news:11**********************@n15g2000prd.googlegr oups.com...

Hi All

I have created an interface to insert 70000 records from a csv file to
the Pervasive database one by one using ordinary sql statement, but
the performance is not satisfactory (it takes about 2 hrs to complete
the job). I just wonder if someone has experience on such case and can
share how to improve the performance?

Thanks
KC

[=?Utf-8?B?SHV0Y2g=?=]

Try using SqlBulkCopy from the framework.
Its pretty simple. Set up your source, destination, batch size, and map
columns if needed. Its the fastest you're going to get from .net. You could
also try creating an SSIS package and executing that from .net.

- Hutch
"01*******@gmail.com" wrote:

Hi All

I have created an interface to insert 70000 records from a csv file to
the Pervasive database one by one using ordinary sql statement, but
the performance is not satisfactory (it takes about 2 hrs to complete
the job). I just wonder if someone has experience on such case and can
share how to improve the performance?

Thanks
KC

[=?Utf-8?B?S2VycnkgTW9vcm1hbg==?=]

Hutch,

The SqlBulkCopy class can be used to write data only to SQL Server tables.

Kerry Moorman
"Hutch" wrote:

Try using SqlBulkCopy from the framework.
Its pretty simple. Set up your source, destination, batch size, and map
columns if needed. Its the fastest you're going to get from .net. You could
also try creating an SSIS package and executing that from .net.

- Hutch
"01*******@gmail.com" wrote:

Hi All

I have created an interface to insert 70000 records from a csv file to
the Pervasive database one by one using ordinary sql statement, but
the performance is not satisfactory (it takes about 2 hrs to complete
the job). I just wonder if someone has experience on such case and can
share how to improve the performance?

Thanks
KC