473,396 Members | 1,774 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

Import data to SQL DB Using Bulk Upload

Upload Data from CSV File to SQL Server 2005 DB using Bulk Upload is slow process.Record are present aroung 2.5 Lakhs record in CSV Files. i have return procedure for uploading data to DB. Automatic File and Table mapping using information_Schema.columns.

How to improve performance.Can any help or provide solutions.
May 22 '12 #1
5 2529
ck9663
2,878 Expert 2GB
How many records? How many rows? Does your table has index? Check the size of your database. Is it too small and needs to grow multiple times in a single load?

Good Luck!!!


~~ CK
May 22 '12 #2
More 2.5 Lakhs Data ,15 to 20 rows .No Index is present that table.Daily upload table..Datsbase size is 1.5 TB..
May 29 '12 #3
ck9663
2,878 Expert 2GB
How fast does your upload take?


~~ CK
May 29 '12 #4
It take more 1 Hrs for each tables
Jun 6 '12 #5
ck9663
2,878 Expert 2GB
Wait, am confused.

There are 15-20 records per file and there are about 250,000 files per day and each file takes 1 hr?

Did I have it right?


~~ CK
Jun 6 '12 #6

Sign in to post your reply or Sign up for a free account.

Similar topics

0
by: Tuhin Kumar | last post by:
Hi, I would like to know how to perform the bulk insertion of binary data using the OCI. Thanks, Tuhin
1
by: Azkaban | last post by:
Hi, are there someone who know what kind of control or component Share Point Portal Server use to make bulk upload documents? Thanks. -- --------------------------------- Filippo Macchi...
3
by: Schultz | last post by:
I would like to know if it is possible to import data from MS Excel 2000 to a dataset using asp.net. The excel file would need to be uploaded to the server from a web page first, before the loaded...
0
by: tezza98 | last post by:
HI i am using BULK INSERT to copy data from a text file into a table that already exists BULK INSERT dbo.TRANStemp FROM 'D:\MSSQL\Data\TRANS.csv' WHERE dbo.TRANStemp.DateTime <> ...
1
by: InvestorTrade | last post by:
Hi, I've been trying to export/import a table from a DB with Chinese_PRC_CI_AS collation, and I can't seem to get it working at all - the export seems rather simple, it is the import that is not...
0
by: nuray | last post by:
I have a spreadsheet where I run a query in Access and copy it into the specific spreadsheets. I was trying to use Data->import external data->import data tool in excel to get the data automaticly...
2
Inbaraj
by: Inbaraj | last post by:
HI.. I want to perform Bulk Insert of data using C# and oracle can any one help me how to perform this operation.... Plz help me with sample code..... with reg Inba
1
by: silpa | last post by:
I have a comma delimited text file which has data like this. 1, 11, "abc" ,False 2, 12, "def" ,False 3, 13, "ghi" ,False 4, 14, "jkl" ,False The name of this file is somedata.txt. Only one...
9
by: a | last post by:
Dear friends I want import data from CSV file to mdb file How can I do that in vb.net?
1
by: ozchadl | last post by:
I wish to import some data I have in some (tab delited) files that I would like to import into certain tables in my access database. I would like to import them using SQL only. I know there are...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.