471,059 Members | 1,400 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 471,059 software developers and data experts.

SSIS - convert dbf to sql server

My goal is to convert dbf to sql server database using SSIS. The package will run periodically say once in 24 hrs. and again update the data in sql server from dbf file. For this is need to create package and schedule a job using job agent. As I am new to SSIS, my question is like I don't want to overwrite the records everytime the package runs, it means I m required to check which records are alredy existing in the database. So do I need to program for that in SSIS? Also, can someone tell in brief that what all I need to do accomplish this task. Please let me know the steps in short.
thks
Apr 14 '08 #1
3 5729
ck9663
2,878 Expert 2GB
I've never used SSIS yet so I'll just describe how I would do it if am in your shoes.

1. Upload the DBF into a monthly table. Name the table appropriately. This will be handy in tracing if there are errors and you need to go back to the actual data that you uploaded.

2. Create a stored proc that will handle your insert-if-not-exist requirement. You might want to add a field on your MASTER table to indicate when the record was inserted. A string YYYYMM could be fine or a complete date.

3. It'll be up to you if you will delete the monthly table after processing or not. I'd keep for a while. It's easier to drop tables than to recreate them.

-- CK
Apr 14 '08 #2
thks for answering question. suppose, I don't want to check for existing entries and everytime drop the existing table and create new one,so how long will it take to create such package? what do u think?
Apr 15 '08 #3
ck9663
2,878 Expert 2GB
For sure it would be faster than the code with checking for existence.

There are processing that would require that you check for existence. There are others that you can just truncate the existing table and load the new data. There are others that you need to create a table every month, and check a master table for existence and add those that are not existing on the same master table.

Each of these have their own pros and cons. That'll be up to you and would depend, greatly, on your process flow.

-- CK
Apr 15 '08 #4

Post your reply

Sign in to post your reply or Sign up for a free account.

Similar topics

1 post views Thread by oregondba | last post: by
reply views Thread by Neff | last post: by
9 posts views Thread by gelangov | last post: by
2 posts views Thread by karen.google | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.