473,461 Members | 2,001 Online
Bytes | Software Development & Data Engineering Community
Create Post

Home Posts Topics Members FAQ

how to automate the data load

ddtpmyra
333 100+
Hi!
I dont have any scripts to add right now. But I need help to give me idea how to do automated one. I used to do it on Oracle on Unix using .bat file and calling the text file containing my sqlloader command.

Now Im facing MS SQL Server 2003 ofcourse on Windows. Anybody can share a thoughts on this or a sample step by step on how to do it?

thanks!
Oct 26 '10 #1
3 2017
ck9663
2,878 Expert 2GB
There are a lot of factors to consider regarding your question.

1. Frequency of execution. Since you're asking about automation, I assume this will be executed more than once, in some defined frequency.

2. File size.

3. File type.

There are a number of options to automate your process.

1. Develop an external module (VB, Java, C, etc). Parse the file, connect to db and insert record. Use a scheduler if necessary.

2. Create a package in SSIS. Create a job to call the package.

3. Script it. Create T-SQLs, create a job to call the SP.

4. Buy an Integration Software, aka ETL Tool.

Good Luck!!!

~~ CK
Oct 26 '10 #2
ddtpmyra
333 100+
CK,
do you have sample code on VB?
Oct 27 '10 #3
ck9663
2,878 Expert 2GB
No. Try posting this on the VB/ASP/.Net forum. They might be able to help you more...

Good Luck!!!

~~ CK
Oct 27 '10 #4

Sign in to post your reply or Sign up for a free account.

Similar topics

0
by: Harshal | last post by:
Hi all, we are trying to load Korean data from a Excel Sheet in to Oracle Database (8.1.7.3 with NLS_LANG=American_America.UTF8) We successfully transferred the Unicode file to our Unix...
1
by: Catch_22 | last post by:
Hi, I'm extracting data from a mainframe application with a view to loading it into a MS SQL database. I'm trying to determine the most efficient way to format the mainframe extract file to make...
4
by: Frank | last post by:
I am loading data through a OleDbDatareader. The load is started from a form by the user, but the actual load is done in a separate class, which is accessed from my form. Now, I want the user to...
6
by: Frank | last post by:
I have made an application that loads data through an OleDbDatareader. I would like the user to be able to interupt the load. Now, I could of course include an interrupt button in the form....
0
by: asheesh.rastogi | last post by:
Hi, I am running DB2 UDB 8.2.4 on AIX 5.3. We are in process of migrating huge chunks of data as part of benchmarking exercise. I need to collect statistics like CPU time and total time taken to...
2
by: Rick Shaw | last post by:
Hi, I have a problem with the datagridview not refreshed when the application first appear on the screen. The datagridview display data from a table in the dataset. At the same time, I've added...
0
by: akp123 | last post by:
Hi I have a flat file with BLOB data that I want to load into DB2 running on AS400 V5R3. I tried to use iSeries navigator import function but it gives me a warning saying I don't have the...
0
by: akp123 | last post by:
Hi I was wondering if anybody knows how to use CPYFRMIMPF command to load BLOB data from a flat file.
5
by: orabalu | last post by:
Hi Guys, Can you give me some examples for Incremental load in PL/SQL for Datawarehouse projects. Regards, Balu
10
by: sai1001 | last post by:
Hi, my job is converting informix queries to db2. There is a load function in informix to load the data from flat file to sql file. Can you please any body help how load function works in db2. ...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...
0
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and...
0
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The...
0
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.