473,406 Members | 2,387 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,406 software developers and data experts.

ETL library

We are looking for an ETL library or callable application that would
allow us to transfer and transform data between platforms but mainly
into a SQL server database. We would be calling this tool from
javascript programs. Is there something out there in the midrange
price-wise? So far I am finding just high-end ETL tools that are a
little over kill for us.
Thanks.
Jul 20 '05 #1
4 2523

"elizabeth" <ez******@hotmail.com> wrote in message
news:78*************************@posting.google.co m...
We are looking for an ETL library or callable application that would
allow us to transfer and transform data between platforms but mainly
into a SQL server database. We would be calling this tool from
javascript programs. Is there something out there in the midrange
price-wise? So far I am finding just high-end ETL tools that are a
little over kill for us.
Thanks.


Have you looked at DTS, which is included with MSSQL? It has a command-line
executable and a COM interface available. See "Data Transformation Services"
in Books Online for more details.

If DTS isn't suitable for you, you might want to be more specific about what
features you require.

Simon
Jul 20 '05 #2
Folks here felt that DTS was slow (copied record by record) and buggy
that is why I was asked to search for something else. What we need is
fairly basic....to be able to move large amounts of data (in some
cases > 2 gigs) between a variety of sources (flat files, FoxPro &
Dbase) into a SQL Server database. We need to be able to set or
specify the table structure "on-the-fly" thus the reason for calling
it from a scripting environment or another environment.

Thanks.

Have you looked at DTS, which is included with MSSQL? It has a command-line
executable and a COM interface available. See "Data Transformation Services"
in Books Online for more details.

If DTS isn't suitable for you, you might want to be more specific about what
features you require.

Simon

Jul 20 '05 #3
DTS can use 'fast load' bulk insert techniques to import data. This is the
fastest way to get data into SQL Server. You can create DTS packages 'on
the fly' programmatically and have control over the object model.

--
Hope this helps.

Dan Guzman
SQL Server MVP

"elizabeth" <ez******@hotmail.com> wrote in message
news:78**************************@posting.google.c om...
Folks here felt that DTS was slow (copied record by record) and buggy
that is why I was asked to search for something else. What we need is
fairly basic....to be able to move large amounts of data (in some
cases > 2 gigs) between a variety of sources (flat files, FoxPro &
Dbase) into a SQL Server database. We need to be able to set or
specify the table structure "on-the-fly" thus the reason for calling
it from a scripting environment or another environment.

Thanks.

Have you looked at DTS, which is included with MSSQL? It has a
command-line
executable and a COM interface available. See "Data Transformation
Services"
in Books Online for more details.

If DTS isn't suitable for you, you might want to be more specific about
what
features you require.

Simon

Jul 20 '05 #4
One alternative is a "roll your own" solution. Create linked servers and
just run UPDATE/INSERT/ SELECT INTO statements. The problem is always
making sure you have the relevant drivers on th dev and production
enviroments. The enclosed link gives most of the connection strings needed.

http://www.able-consulting.com/ADO_Conn.htm

I'll warn you before you start this can get messy.

Regards

Adrian

elizabeth wrote:
Folks here felt that DTS was slow (copied record by record) and buggy
that is why I was asked to search for something else. What we need is
fairly basic....to be able to move large amounts of data (in some
cases > 2 gigs) between a variety of sources (flat files, FoxPro &
Dbase) into a SQL Server database. We need to be able to set or
specify the table structure "on-the-fly" thus the reason for calling
it from a scripting environment or another environment.

Thanks.
Have you looked at DTS, which is included with MSSQL? It has a command-line
executable and a COM interface available. See "Data Transformation Services"
in Books Online for more details.

If DTS isn't suitable for you, you might want to be more specific about what
features you require.

Simon

Jul 20 '05 #5

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

2
by: pieter.breed | last post by:
Hi All, The company I work for has traditionally used COM/ActiveX for the solutions that it provides. We are in the process of moving to .NET and a few applications have been written in VB.NET...
3
by: K.S.Liang | last post by:
Hi all, 1> If there are more than one dynamic linking libraries in the file system, how do I know which one is loaded into system? Any C library or system call can tell me which *.so or *.sl is...
1
by: Jim | last post by:
Have fully operational software package developed on VB.NET that worked until Jan 1 2003, with early stage deployments on Oct 10, Oct 23, Nov 11, Dec 12 and Dec 30. When attempted final...
10
by: mwt | last post by:
So in a further attempt to learn some Python, I've taken the little Library program (http://groups.google.com/group/comp.lang.python/browse_thread/thread/f6a9ccf1bc136f84) I wrote and added...
10
by: Julian | last post by:
I get the following error when i try to link a fortran library to a c++ code in .NET 2005. LINK : fatal error LNK1104: cannot open file 'libc.lib' the code was working fine when built using...
20
by: Frank-O | last post by:
Hi , Recently I have been commited to the task of "translating" some complex statistical algorithms from Matlab to C++. The goal is to be three times as fast as matlab ( the latest) . I've...
6
by: =?Utf-8?B?WW9naSBXYXRjaGVy?= | last post by:
Hello, I am using Visual Studio-2003. I created a project to build my library. Since I am using third party libraries as well, I have specified those additional library dependencies in project...
0
by: JosAH | last post by:
Greetings, the last two article parts described the design and implementation of the text Processor which spoonfeeds paragraphs of text to the LibraryBuilder. The latter object organizes, cleans...
0
by: JosAH | last post by:
Greetings, welcome back; above we discussed the peripherals of the Library class: loading and saving such an instantiation of it, the BookMark interface and then some. This part of the article...
16
by: Xiaoxiao | last post by:
Hi, I got a C library, is there a way to view the public function names in this library so that I can use in my C program? Thanks.
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.