473,399 Members | 4,254 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,399 software developers and data experts.

PG_BULKLOAD data loading issue with index

Hi,
I am facing the below issue on pg_bulkloader.
for better understanding...
I created the below table with index and then loaded data, as the log file shows everything is success but i don't find that amount of record on the loaded table.

see the below exact commands...

Expand|Select|Wrap|Line Numbers
  1. CREATE TABLE  quovaadm.SATYA_GEOIP
  2. (
  3.      START_IP_INT            bigint,
  4.      END_IP_INT              bigint,
  5.      CIDR                    integer,
  6.      CONTINENT               character varying(128),
  7.      COUNTRY                 character varying(128),
  8.      COUNTRY_ISO2            character varying(2),
  9.      COUNTRY_CF              integer,
  10.      REGION                  character varying(128),
  11.      STATE                   character varying(128),
  12.      STATE_CF                integer,
  13.      CITY                    character varying(128),
  14.      CITY_CF                 integer,
  15.      POSTAL_CODE             character varying(128),
  16.      PHONE_NUMBER_PREFIX     character varying(64),
  17.      TIMEZONE                numeric(5,2),
  18.      LATITUDE                numeric(12,6),
  19.      LONGITUDE               numeric(12,6),
  20.      DMA                     integer,
  21.      MSA                     character varying(10),
  22.      PMSA                    integer,
  23.      CONNECTIONTYPE          character varying(32),
  24.      LINESPEED               character varying(32),
  25.      IP_ROUTINGTYPE          character varying(32),
  26.      AOL                     character varying(1),
  27.      ASN                     integer,
  28.      SLD_ID                  integer,
  29.      TLD_ID                  integer,
  30.      REG_ORG_ID              integer,
  31.      CARRIER_ID              integer
  32. );
  33.  
  34.  
  35.  
  36. create index satya_idx_quova on quovaadm.SATYA_GEOIP (country_iso2);
  37.  
  38.  
  39.  
  40. dw_dev1=# SELECT pg_bulkload(ARRAY['TABLE=quovaadm.SATYA_GEOIP','INFILE=/transfer/inbound/geoip/quova/geoip_data.dat','TYPE=CSV','DELIMITER=|','LOGFILE=/transfer/inbound/geoip/quova/satya_quova.log','PARSE_BADFILE=/transfer/inbound/geoip/quova/satya_quova.bad','PARSE_ERRORS=999999','DUPLICATE_ERRORS=999999','ON_DUPLICATE_KEEP=OLD','WRITER=BUFFERED','MULTI_PROCESS=YES']);
  41.  
pg_bulkload
---------------------------------------------------
(0,11614864,0,0,0,1.640751,154.681485,203.964952)
(1 row)

dw_dev1=# select count(1) from quovaadm.SATYA_GEOIP;
count
---------
8048890
(1 row)
Dec 21 '12 #1
2 3159
Rabbit
12,516 Expert Mod 8TB
What amount of records are you expecting to see?
Dec 21 '12 #2
As the log shows 11614864 records loaded.

So count of the records in table should be 11614864.
Dec 24 '12 #3

Sign in to post your reply or Sign up for a free account.

Similar topics

3
by: GQ | last post by:
We have a Web page that at load time will execute and build: a DHTML Menu/Data Driven, an Iframe with Detail Data, an Iframe to display Progress Information and another iframe with totals...
1
by: Sunny | last post by:
Hi, I am using Databases in my applications, i have a table with an average of 3.5 million records, i am trying to show the search results in a DataGrid from that table, but the results take a very...
2
by: Stephen Costanzo | last post by:
I have a control table that lists the columns to pull from the associated data table. If there is a column name in the control table that doesn't exist in the data table, it generates a...
1
by: stabbert | last post by:
We are on DB2 UDB 8.2.2 on AIX. I know this question has been asked many times on the ng but I am just not finding a real good answer. I need to be able to not only determine existing table data...
3
by: NuB | last post by:
I have a C# program that is reading text files and uploading the data into SQL. The issue I'm noticing is that if i have money such as 1253.22 in the file, is loading in the table as 1253.22 but...
0
by: michael lam | last post by:
Hi, I have a question on data uploading process. In fact, on a daily basis, a csv file (same file name) is generated from a data vendor and automaticallly put into a public folder. Then, the...
4
by: Andy | last post by:
I created a Windows application that is having an odd issue. The application starts for a split second, but then closes. I cannot get any error messages to display as to what causes the program...
1
by: anjanareddy | last post by:
Hai, i am unable to inserting duplicate data into UNIQUE index column, Is there any other process, to insert duplicate data into UNIQUE index column? plz let me know.. Thanks & Regards...
3
by: suresh_nsnguys | last post by:
Respected sir/madam, right now i am displaying movie (.wmv) file using <embed> and <object> tags inside <div> tag. Everything is working fine. ...
13
by: Tom Andrecht | last post by:
I'm trying to get some encryption/decryption routines going to take care of my data, and while the encryption is working great, I keep running into the message "Padding is invalid and cannot be...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.