473,230 Members | 1,807 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,230 software developers and data experts.

SSIS - convert dbf to sql server

My goal is to convert dbf to sql server database using SSIS. The package will run periodically say once in 24 hrs. and again update the data in sql server from dbf file. For this is need to create package and schedule a job using job agent. As I am new to SSIS, my question is like I don't want to overwrite the records everytime the package runs, it means I m required to check which records are alredy existing in the database. So do I need to program for that in SSIS? Also, can someone tell in brief that what all I need to do accomplish this task. Please let me know the steps in short.
thks
Apr 14 '08 #1
3 6105
ck9663
2,878 Expert 2GB
I've never used SSIS yet so I'll just describe how I would do it if am in your shoes.

1. Upload the DBF into a monthly table. Name the table appropriately. This will be handy in tracing if there are errors and you need to go back to the actual data that you uploaded.

2. Create a stored proc that will handle your insert-if-not-exist requirement. You might want to add a field on your MASTER table to indicate when the record was inserted. A string YYYYMM could be fine or a complete date.

3. It'll be up to you if you will delete the monthly table after processing or not. I'd keep for a while. It's easier to drop tables than to recreate them.

-- CK
Apr 14 '08 #2
thks for answering question. suppose, I don't want to check for existing entries and everytime drop the existing table and create new one,so how long will it take to create such package? what do u think?
Apr 15 '08 #3
ck9663
2,878 Expert 2GB
For sure it would be faster than the code with checking for existence.

There are processing that would require that you check for existence. There are others that you can just truncate the existing table and load the new data. There are others that you need to create a table every month, and check a master table for existence and add those that are not existing on the same master table.

Each of these have their own pros and cons. That'll be up to you and would depend, greatly, on your process flow.

-- CK
Apr 15 '08 #4

Sign in to post your reply or Sign up for a free account.

Similar topics

1
by: oregondba | last post by:
We are attempting to load a DB2 v9 table with SQL Server Integration Services. The DB2 data exists on AIX and is built with a codeset of 1252. The SSIS server has the DB2 V9 client and we are...
0
by: Neff | last post by:
I have a clustered installation of SQL Server 2005 with SSIS installed on the cluster. I'm running SQL Server Management Server on one of the cluster nodes and trying to connect to the...
1
by: rmsterling | last post by:
All, Subject : SQL Server 2005 SSIS Script Help - XML Secure Pull in to DB table I was wondering if any of you could help me with something..... I want to design a SSIS script that will pull...
0
by: dharper | last post by:
Hi! I'm new to sql 2005 and need to run an automated report that is a fairly simple fixed width ragged right report. Problem is I need a header in the report that has static text, plus the rowcount...
9
by: gelangov | last post by:
I have 2 variables, one is the column name of the table and the other one is the table name and I need to write this in the "Execute SQL task" of a "For each loop" container in a ssis package like...
6
by: jags_32 | last post by:
We have spent days trying to perform a proof of concept and I am dissappointed with SSIS to say the least. We are trying to connect and fetch data from a Double Byte Progress database and the...
0
by: paririps | last post by:
HI, I m using SSIS in sql server 2005 and i want SSIS to generate my code in c# . can you help me?
5
TonFrere
by: TonFrere | last post by:
Hello, I must convert a CSV file which is simply hexadecimal words. There is a SSIS function to convert from decimal to hex but none for either hex to decimal or hex to ASCII. Here is what my...
2
by: karen.google | last post by:
I have an SSIS package that I'm converting from DTS (SQLServer 2005), and the ActiveX Script Task (in VBScript) is deprecated, so I'm trying to convert things to Script tasks (in VB .net). I...
0
by: VivesProcSPL | last post by:
Obviously, one of the original purposes of SQL is to make data query processing easy. The language uses many English-like terms and syntax in an effort to make it easy to learn, particularly for...
0
by: jianzs | last post by:
Introduction Cloud-native applications are conventionally identified as those designed and nurtured on cloud infrastructure. Such applications, rooted in cloud technologies, skillfully benefit from...
2
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 7 Feb 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:30 (7.30PM). In this month's session, the creator of the excellent VBE...
0
by: fareedcanada | last post by:
Hello I am trying to split number on their count. suppose i have 121314151617 (12cnt) then number should be split like 12,13,14,15,16,17 and if 11314151617 (11cnt) then should be split like...
0
by: stefan129 | last post by:
Hey forum members, I'm exploring options for SSL certificates for multiple domains. Has anyone had experience with multi-domain SSL certificates? Any recommendations on reliable providers or specific...
1
by: davi5007 | last post by:
Hi, Basically, I am trying to automate a field named TraceabilityNo into a web page from an access form. I've got the serial held in the variable strSearchString. How can I get this into the...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: Aftab Ahmad | last post by:
Hello Experts! I have written a code in MS Access for a cmd called "WhatsApp Message" to open WhatsApp using that very code but the problem is that it gives a popup message everytime I clicked on...
0
by: Aftab Ahmad | last post by:
So, I have written a code for a cmd called "Send WhatsApp Message" to open and send WhatsApp messaage. The code is given below. Dim IE As Object Set IE =...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.