473,396 Members | 1,813 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

Checking for duplicate entries in large table

Hi,

I have a database composed of a single table composed of 2 columns, an
auto-numbered ID column and a column which contains 30 million random
numbers. All I want to Access to do is check the numbers and let me
know if there are any duplicates. Ideally I'd like Access to flag the
duplicates if they exist. The easy approach that I thought would work
is to go to Design view and select Indexed table, No Duplicates. This
doesn't work however, as Access won't save the table after I change
the Indexed setting from No duplicates to Duplicates allowed, or from
Duplicates allowed to No Duplicates. Each time I try to save the table
I got a message saying invalid argument.

Any suggestions on how I can accomplish what I want with minimal
effort?

Thanks.

--Brian
Nov 12 '05 #1
5 1885
SELECT Count(AutoNumberColumn) AS HowMany, OtherColumn
FROM tblWhatever
GROUP BY OtherColumn
HAVING Count(AutoNumberColumn)>1;
--
Jeremy Wallace
AlphaBet City Dataworks
http://www.ABCDataworks.com
"Jermin" <ju*********@hotmail.com> wrote in message
news:2b*************************@posting.google.co m...
Hi,

I have a database composed of a single table composed of 2 columns, an
auto-numbered ID column and a column which contains 30 million random
numbers. All I want to Access to do is check the numbers and let me
know if there are any duplicates. Ideally I'd like Access to flag the
duplicates if they exist. The easy approach that I thought would work
is to go to Design view and select Indexed table, No Duplicates. This
doesn't work however, as Access won't save the table after I change
the Indexed setting from No duplicates to Duplicates allowed, or from
Duplicates allowed to No Duplicates. Each time I try to save the table
I got a message saying invalid argument.

Any suggestions on how I can accomplish what I want with minimal
effort?

Thanks.

--Brian

Nov 12 '05 #2
Minimal effort:

1. go to the Queries group...
2. click New...
3. One of the options listed is what you want to do.

-Paul

ju*********@hotmail.com (Jermin) wrote in message news:<2b*************************@posting.google.c om>...
Hi,

I have a database composed of a single table composed of 2 columns, an
auto-numbered ID column and a column which contains 30 million random
numbers. All I want to Access to do is check the numbers and let me
know if there are any duplicates. Ideally I'd like Access to flag the
duplicates if they exist. The easy approach that I thought would work
is to go to Design view and select Indexed table, No Duplicates. This
doesn't work however, as Access won't save the table after I change
the Indexed setting from No duplicates to Duplicates allowed, or from
Duplicates allowed to No Duplicates. Each time I try to save the table
I got a message saying invalid argument.

Any suggestions on how I can accomplish what I want with minimal
effort?

Thanks.

--Brian

Nov 12 '05 #3
Beautiful - exactly what i was looking for. Fast, easy & powerful. Thank you!
Minimal effort:

1. go to the Queries group...
2. click New...
3. One of the options listed is what you want to do.

-Paul

Nov 12 '05 #4
Encountered a new problem when running the query. I get a message
stating that there is not enough space on the temporary disk. This of
course is nonsense as I have gigs of free space on the drive and a
completely empty temp folder. Doing a newsgroup search others have had
the same problem as well, with far fewer records than I. I'm guessing
the message is implying that Access can't handle running the query on
so many records (30 million). Any suggestions for how I can run this
query succesfully, or do i need to go to a SQL box?

THanks!
pt******@spsu.edu (PaulT) wrote in message news:<81*************************@posting.google.c om>...
Minimal effort:

1. go to the Queries group...
2. click New...
3. One of the options listed is what you want to do.

-Paul

Nov 12 '05 #5
(I may not offer the easiest choice, so check back for other
responses...)

If you have access to an SQL box, and can link to that table, then
that would probably be easiest; otherwise, you'd be stuck dividing the
table into smaller "chunks" and have to do quite a bit of
cross-checking depending on how many 'chunks' you have.

Or you could possibly try to run Jeremy's example and see if you can
get any count quantities.

Also, I don't know what version of access you have, but if it's 97,
check this too:
http://support.microsoft.com/default...29&Product=acc

-Paul

ju*********@hotmail.com (Jermin) wrote in message news:<2b*************************@posting.google.c om>...
Encountered a new problem when running the query. I get a message
stating that there is not enough space on the temporary disk. This of
course is nonsense as I have gigs of free space on the drive and a
completely empty temp folder. Doing a newsgroup search others have had
the same problem as well, with far fewer records than I. I'm guessing
the message is implying that Access can't handle running the query on
so many records (30 million). Any suggestions for how I can run this
query succesfully, or do i need to go to a SQL box?

THanks!
pt******@spsu.edu (PaulT) wrote in message news:<81*************************@posting.google.c om>...
Minimal effort:

1. go to the Queries group...
2. click New...
3. One of the options listed is what you want to do.

-Paul

Nov 12 '05 #6

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

2
by: Francesco Moi | last post by:
Hello. I've got a 'books' table with 'id', 'name', 'author' and 'isbn' fields. Due to an error, my books are duplicated, so I've got (e.g.): 430 - Moby Dick - Herman Melville - 0192833855...
3
by: andreas.maurer1971 | last post by:
Hi all, since a few years I use the following statement to find duplicate entries in a table: SELECT t1.id, t2.id,... FROM table AS t1 INNER JOIN table AS t2 ON t1.field = t2.field WHERE...
0
by: Cyberwolf | last post by:
OK, how to explain this. I have a table that will feed into another table using an append query. What I want to do is look at the table I am appending the record to to check for a duplicate...
5
by: Manish | last post by:
The topic is related to MySQL database. Suppose a table "address" contains the following records ------------------------------------------------------- | name | address | phone |...
4
by: m.wanstall | last post by:
Hi there, I have a large table based around a CustomerNumber with various details about that customer (originally imported and augmented from an Exchange Server)...now, a single customer can...
2
by: mivey4 | last post by:
Okay I have 2 tables: Table A - holds a list of new hardware serial numbers and their corresponding model (no constraints or indexes) Table B - holds a distinct list of current serial numbers...
1
by: JJ | last post by:
What's best practise in this situation: Upon submitting data input on a detailsview (bound to an objectdatasource), I need to check for a duplicate email address (in an sql database) and present...
4
by: ramdil | last post by:
Hi All I have table and it have around 90000 records.Its primary key is autonumber field and it has also have date column and name, then some other columns Now i have problem with the table,as my...
7
by: php_mysql_beginer911 | last post by:
Hi .. i am trying to update a table where if field contents any duplictaed entries than one of the field should be updated with random number which is unique so i can make all entries unique i...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.