Hello!
I have been assigned to bulk-load data into several typed tables of our ODS. I am not clear as to whether it can be done.
Here's my homework ===>>>
The easy way is to perform INSERT statements manually, like this - insert into
-
callbacks
-
(
-
account_info, nbr_clbk, load_date
-
)
-
values (
-
account_obj() ..account_number('123456') ..account_status('ACTV') ..dma_id('803') ..dma_name('Los Angeles') ..state('CA') ..zipcode('90245')
-
, 1, '2007-02-20');
This works fine. The challenge is that I have to load about 500K rows daily for about 23 tables. The other challenge is that the source data I have to load is contained in "flat", normal tables.
I have tried several things. My first approach was to dump data from one of the flat tables and import/load back:
a) Import utility - IMPORT FROM "Z:\clbk_data.del"
-
OF DEL MODIFIED BY COLDEL, DATESISO METHOD P (2, 3, 4)
-
MESSAGES "Z:\clbk_data_load.out"
-
replace into callbacks (account_info, nbr_clbk, load_date);
It fails: - SQL3037N An SQL error "-408" occurred during Import processing.
b) Load utility - LOAD CLIENT FROM "Z:\clbk_data.del" OF DEL MESSAGES "Z:\clbk_data_load.out" INSERT INTO callbacks COPY NO INDEXING MODE AUTOSELECT
It fails: - SQL3529N The "LOAD" operation encountered the unsupported data type "Structured Data Type" in column "1".
c) I also tried (what I call) "derived" INSERT. - insert into
-
callbacks (account_info, nbr_clbk, load_date)
-
select
-
account_number, account_status, dma_id, dma_name, state, zipcode, nbr_clbk, load_date from flat_table.
It fails....
Can somebody please help? If I have to write a program, I will but I'd like to know if this can be avoided...
My apologies for the long message. TIA for helping,
Al.
PS: My configuration is:
IBM DB v9.1
Linux RH
0 1711 Sign in to post your reply or Sign up for a free account.
Similar topics |
by: jason |
last post by:
What are the technical challenges in getting a local SMTP email server set
up on a win3k system or alternatively on a win2k pro local work statation.
We are on the verge of acquiring a new win3k system for local asp testing
development purposes and to allow satellite branches to ftp-in and grab
images.
I need to utilize the bulk emailing facility to send up to 20,000 emails a
day after looping through my customer list which resides in...
|
by: Jim Geissman |
last post by:
I am trying to bulk insert a text file. The file has fixed-length fields
with no field terminators. BOL says that field terminators are only
needed when the data does *not* contain fixed-length fields, which
implies they are optional -- so I made a format file without any (two
consecutive tabs with nothing between them). The following message
resulted:
Server: Msg 4827, Level 16, State 1, Line 1
Could not bulk insert. Invalid column...
|
by: gchavez |
last post by:
I'm running MSSQL 2K on Win 2k and just upgraded SQL Server from SP3
to SP4 (that's when my problem started). I have a procedure that bulk
inserts from a text file that is located on a Netware 4.11 file server.
The procedure actually references the file using the UNC path to a
share on a NT 4 server that is connected to the novel server using
gateway services for NetWare. Now when it tries to reference the file I
get:
Server: Msg 4861,...
|
by: Daniel P. |
last post by:
How can I use ADO.NET to insert lots of records in a very fast way?
Thanks!
|
by: Metal Dave |
last post by:
I do not understand the error handling of SQL Server here. Any error in
bulk insert seems to halt the current T-SQL statement entirely, rendering
it impossible to log an error. The first statement below executes as
expected, and were I to replace "print" with something meaningful I could
do some useful error handling. The second statement just seems to totally
bail out after the error, preventing me from doing any useful error
handling....
| |
by: Tim Satterwhite |
last post by:
Hi All,
I think this is a thorny problem, and I'm hoping you can help. I've not
found this exact issue described anywhere yet.
I have a stored procedure that calls BULK INSERT on a set of text files.
These files are FTP'd from a legacy system (a mainframe running MVS).
Sometimes, the process steps on iteslf, whereby the bulk insert is attempted
on a file whose FTP is still in progress; it's not fully written to disk on
the SQL box...
|
by: Jennifer |
last post by:
I'm trying to do an insert using Bulk Insert with a fixed length file.
I'm using a format file.
I'm getting the following error message:
Cannot perform bulk insert. Invalid collation name for source column 16
in format file '\\wbhq.com\dfsdv\iDataInt\GOPFiles\GOPFormatFile.txt'.
Any suggestions are appreciated.
Thanks!
Jennifer
|
by: ozkhillscovington |
last post by:
We have sp's in place that do BULK INSERTS from txt files into the tables. This works fine, however they have asked us to add a field that identifies accounting ctr. The only thing that identifies accounting ctr is the last three letters of the text file being used for the BULK INSERT.
How would you suggest that I do this? Is there a way to add a default value to the .fmt or schema files for the text fields, or in the BULK INSERT...
|
by: bob laughland |
last post by:
Hi All,
I am using a combination of LINQ to SQL and bulk insert. In the
process of performing 'one unit of work' I will be doing things like
reading, and deleting records using LINQ to SQL and then inserting new
records using bulk insert.
One problem I am having is trying to use a 'transaction' to wrap
around the whole thing.
|
by: bob laughland |
last post by:
Hi All,
I am using a combination of LINQ to SQL and bulk insert. In the
process of performing 'one unit of work' I will be doing things like
reading, and deleting records using LINQ to SQL and then inserting new
records using bulk insert.
One problem I am having is trying to use a 'transaction' to wrap
around the whole thing.
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
| |
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
| |
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
|
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |