473,387 Members | 1,891 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,387 software developers and data experts.

Oracle dataload very slow

132 100+
Hi there.

I have written an application in ASP.Net / C# which has to load some of the contents of a CSV file, which contains up to 30million lines in it.

To do this I am using a StreamReader to pass through the file and use a string split() to break the record lines into individual parts and into an array, which are then chosen to be inserted into an Oracle database table.

I am utilising stored procedures within the Oracle database and hence invoking these stored procedures from within the C# code.

With my current test file of just 750,000 lines the process takes around 25 minutes so I am wondering if anybody has had similar issues with loading CSV files and whether or not they were able to obtain a much more efficient and quick way of loading the lines, please?

Thank you.

Mark :)
Nov 29 '08 #1
0 826

Sign in to post your reply or Sign up for a free account.

Similar topics

3
by: Harry | last post by:
Using Oracle 8i enterprise on win 2000 (sp3) Installed the standard configuration & whenever I make a connection it takes about 10 secs. It's running on a P1900 with 1gb Ram so no reason there...
0
by: Harshal | last post by:
Hi all, we are trying to load Korean data from a Excel Sheet in to Oracle Database (8.1.7.3 with NLS_LANG=American_America.UTF8) We successfully transferred the Unicode file to our Unix...
9
by: AnandaSim | last post by:
Hi All, I've had Access 97, 2000 connections to the corporate Oracle database for a few years now - but seldom use it. When I did use it years ago, performance was not fast but the features were...
0
by: Frank M | last post by:
I am writing an application with a dataload class. The development is done in Windows XP, and on the development Pc I can do a dataload and export without any problems if I use...
2
by: egoldthwait | last post by:
I need to convert a 17mb access 2000 db to Oracle and house it in a Citrix farm. The issue: we have never converted an Access Db to Oracle but can probably use Oracle's Workbench to assist with...
0
by: saleng | last post by:
Any idea? I have Exam.vb and aspx page: <!------------ Exam.vb start //----------------------------> Imports System.Data Module Exam Public Function DataLoad() As ICollection Dim...
11
by: funky | last post by:
hello, I've got a big problem ad i'm not able to resolve it. We have a server running oracle 10g version 10.1.0. We usually use access as front end and connect database tables for data extraction....
2
by: dineshchand | last post by:
I m working on a application importing data into oracle.But after few import into Oracle DB my import process is taking so long time.My oracle is getting slow after running import few times.Can...
3
by: techquest | last post by:
Hi, I want to connect into oracle database and export the table data into a flat file using UNIX shell scripts. I cant use other GUI tools to do this, as the dataload will be in millions. hence if...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.