473,386 Members | 1,796 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,386 software developers and data experts.

SQL Import of LArge Amount of Data

This is a general question on the best way to import a large amount of data
to a MS-SQL DB.

I can have the data in just about any format I need to, I just don't know
how to import the data. I some experience with SQL but not much.

There is about 1500 to 2000 lines of data. I am looking for the best way to
get this amount of data in on a monthly basis.

Any help is greatly thanked!!

Mike Charney
Oct 7 '05 #1
5 2159
SQL
2000 lines is far from large but anyway use DTS, if the files get
bigger (50000 lines+) use BCP or BULK INSERT
http://sqlservercode.blogspot.com/

Oct 7 '05 #2
Sorry my mistake, it is 150,000 to 200,000 lines.

Where could I find information using BCP or BULK INSERT?

Mike Charney

"SQL" <de********@gmail.com> wrote in message
news:11*********************@o13g2000cwo.googlegro ups.com...
2000 lines is far from large but anyway use DTS, if the files get
bigger (50000 lines+) use BCP or BULK INSERT
http://sqlservercode.blogspot.com/

Oct 7 '05 #3
SQL
In Books on line, do a search for bcp or BULK INSERT

http://sqlservercode.blogspot.com/

Oct 7 '05 #4
Using DTS is very good idea but there is a import/export wizard
(something like building dts wizard). It is very simply.

Oct 7 '05 #5

"Mike" <no***@forgetit.com> wrote in message
news:I%***************@newssvr30.news.prodigy.com. ..
Sorry my mistake, it is 150,000 to 200,000 lines.

Where could I find information using BCP or BULK INSERT?
Books Online that comes with SQL Server.

For reference, I just imported 700,000+ records yesterday, with several text
fields in each.

Took less than 15 minutes.

Fortunately this was in native format and already sorted. But you get the
idea.

I used BULK INSERT.


Mike Charney

"SQL" <de********@gmail.com> wrote in message
news:11*********************@o13g2000cwo.googlegro ups.com...
2000 lines is far from large but anyway use DTS, if the files get
bigger (50000 lines+) use BCP or BULK INSERT
http://sqlservercode.blogspot.com/


Oct 8 '05 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

1
by: Robert May | last post by:
Hi, I am trying to execute some code compiled by g++ on Linux and have found that after some time, the program allocates a huge amount of swap space (250MB on my machine which has 512MB...
13
by: usenet | last post by:
Hi. Can any of you explain the major differences in LOAD and IMPORT in laymen terms? I've read the DB2 docs: " Inserts data from an external file with a supported file format into a table,...
20
by: Steve Jorgensen | last post by:
Hi all, I've just finished almost all of what has turned out to be a real bear of a project. It has to import data from a monthly spreadsheet export from another program, and convert that into...
11
by: Macca | last post by:
Hi, I'm writing an application that will pass a large amount of data between classes/functions. In C++ it was more efficient to send a pointer to the object, e.g structure rather than passing...
2
by: Gaz | last post by:
I am currently developing an ASP.NET 2.0 app part of the app will involve collecting a large amount of data offline and then importing this data into the system My question is what will be more...
3
by: ninrulz | last post by:
I will try to explain my situation. I know that it is hard to offers solutions without fully understanding what people would like to achieve. I receive 2 csv files every month. The csv files...
7
by: =?Utf-8?B?TW9iaWxlTWFu?= | last post by:
Hello everyone: I am looking for everyone's thoughts on moving large amounts (actually, not very large, but large enough that I'm throwing exceptions using the default configurations). We're...
16
by: Jack | last post by:
I need to process large amount of data. The data structure fits well in a dictionary but the amount is large - close to or more than the size of physical memory. I wonder what will happen if I try...
0
by: jcatubay | last post by:
I have a function that returns a list more than 200000 objects and the object has 37 fields. I added the wcf as a web reference so i dont have to add any configuration item in my web apps config...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: aa123db | last post by:
Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.