473,657 Members | 2,283 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

How can I bulk-load a typed table?

DTV12345
5 New Member
Hello!

I have been assigned to bulk-load data into several typed tables of our ODS. I am not clear as to whether it can be done.

Here's my homework ===>>>

The easy way is to perform INSERT statements manually, like this

Expand|Select|Wrap|Line Numbers
  1. insert into 
  2. callbacks
  3. (
  4. account_info, nbr_clbk, load_date
  5. values (
  6. account_obj() ..account_number('123456') ..account_status('ACTV') ..dma_id('803') ..dma_name('Los Angeles') ..state('CA') ..zipcode('90245') 
  7. , 1, '2007-02-20');
This works fine. The challenge is that I have to load about 500K rows daily for about 23 tables. The other challenge is that the source data I have to load is contained in "flat", normal tables.

I have tried several things. My first approach was to dump data from one of the flat tables and import/load back:

a) Import utility
Expand|Select|Wrap|Line Numbers
  1. IMPORT FROM "Z:\clbk_data.del" 
  2. OF DEL MODIFIED BY COLDEL, DATESISO METHOD P (2, 3, 4) 
  3. MESSAGES "Z:\clbk_data_load.out" 
  4. replace into callbacks  (account_info, nbr_clbk, load_date);
It fails:
Expand|Select|Wrap|Line Numbers
  1. SQL3037N  An SQL error "-408" occurred during Import processing.
b) Load utility
Expand|Select|Wrap|Line Numbers
  1. LOAD CLIENT FROM "Z:\clbk_data.del" OF DEL MESSAGES "Z:\clbk_data_load.out" INSERT INTO callbacks COPY NO INDEXING MODE AUTOSELECT
It fails:
Expand|Select|Wrap|Line Numbers
  1. SQL3529N  The "LOAD" operation encountered the unsupported data type "Structured Data Type" in column "1".
c) I also tried (what I call) "derived" INSERT.

Expand|Select|Wrap|Line Numbers
  1. insert into 
  2. callbacks (account_info, nbr_clbk, load_date) 
  3. select 
  4. account_number, account_status, dma_id, dma_name, state, zipcode, nbr_clbk, load_date from flat_table.
It fails....

Can somebody please help? If I have to write a program, I will but I'd like to know if this can be avoided...

My apologies for the long message. TIA for helping,

Al.

PS: My configuration is:
IBM DB v9.1
Linux RH
Jun 14 '07 #1
0 1711

Sign in to post your reply or Sign up for a free account.

Similar topics

2
2998
by: jason | last post by:
What are the technical challenges in getting a local SMTP email server set up on a win3k system or alternatively on a win2k pro local work statation. We are on the verge of acquiring a new win3k system for local asp testing development purposes and to allow satellite branches to ftp-in and grab images. I need to utilize the bulk emailing facility to send up to 20,000 emails a day after looping through my customer list which resides in...
3
9204
by: Jim Geissman | last post by:
I am trying to bulk insert a text file. The file has fixed-length fields with no field terminators. BOL says that field terminators are only needed when the data does *not* contain fixed-length fields, which implies they are optional -- so I made a format file without any (two consecutive tabs with nothing between them). The following message resulted: Server: Msg 4827, Level 16, State 1, Line 1 Could not bulk insert. Invalid column...
1
2964
by: gchavez | last post by:
I'm running MSSQL 2K on Win 2k and just upgraded SQL Server from SP3 to SP4 (that's when my problem started). I have a procedure that bulk inserts from a text file that is located on a Netware 4.11 file server. The procedure actually references the file using the UNC path to a share on a NT 4 server that is connected to the novel server using gateway services for NetWare. Now when it tries to reference the file I get: Server: Msg 4861,...
10
31692
by: Daniel P. | last post by:
How can I use ADO.NET to insert lots of records in a very fast way? Thanks!
1
9918
by: Metal Dave | last post by:
I do not understand the error handling of SQL Server here. Any error in bulk insert seems to halt the current T-SQL statement entirely, rendering it impossible to log an error. The first statement below executes as expected, and were I to replace "print" with something meaningful I could do some useful error handling. The second statement just seems to totally bail out after the error, preventing me from doing any useful error handling....
3
3452
by: Tim Satterwhite | last post by:
Hi All, I think this is a thorny problem, and I'm hoping you can help. I've not found this exact issue described anywhere yet. I have a stored procedure that calls BULK INSERT on a set of text files. These files are FTP'd from a legacy system (a mainframe running MVS). Sometimes, the process steps on iteslf, whereby the bulk insert is attempted on a file whose FTP is still in progress; it's not fully written to disk on the SQL box...
1
8935
by: Jennifer | last post by:
I'm trying to do an insert using Bulk Insert with a fixed length file. I'm using a format file. I'm getting the following error message: Cannot perform bulk insert. Invalid collation name for source column 16 in format file '\\wbhq.com\dfsdv\iDataInt\GOPFiles\GOPFormatFile.txt'. Any suggestions are appreciated. Thanks! Jennifer
0
3007
by: ozkhillscovington | last post by:
We have sp's in place that do BULK INSERTS from txt files into the tables. This works fine, however they have asked us to add a field that identifies accounting ctr. The only thing that identifies accounting ctr is the last three letters of the text file being used for the BULK INSERT. How would you suggest that I do this? Is there a way to add a default value to the .fmt or schema files for the text fields, or in the BULK INSERT...
0
4394
by: bob laughland | last post by:
Hi All, I am using a combination of LINQ to SQL and bulk insert. In the process of performing 'one unit of work' I will be doing things like reading, and deleting records using LINQ to SQL and then inserting new records using bulk insert. One problem I am having is trying to use a 'transaction' to wrap around the whole thing.
3
10903
by: bob laughland | last post by:
Hi All, I am using a combination of LINQ to SQL and bulk insert. In the process of performing 'one unit of work' I will be doing things like reading, and deleting records using LINQ to SQL and then inserting new records using bulk insert. One problem I am having is trying to use a 'transaction' to wrap around the whole thing.
0
8838
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
8739
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
8513
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
7351
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
6176
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
4173
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
4329
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
2740
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
1969
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.