Connecting Tech Pros Worldwide Forums | Help | Site Map

fastest way to deduplicate a list

Michael Evanchik
Guest
 
Posts: n/a
#1: Oct 21 '07
Im trying to dedupe a table with only one field on it. The table has
40 million records in it. What is the fastest way?

1) create a table with a unque constraint on it insert into that
table?

2) create a table without a unique constraint on it and use insert
into table select distinct un from table2?

3) another way?

Michael


Erland Sommarskog
Guest
 
Posts: n/a
#2: Oct 21 '07

re: fastest way to deduplicate a list


Michael Evanchik (mre224@yahoo.com) writes:
Quote:
Im trying to dedupe a table with only one field on it. The table has
40 million records in it. What is the fastest way?
>
1) create a table with a unque constraint on it insert into that
table?
I assume that you would use the IGNORE_DUP_KEY option? Else the scheme
wouldn't work. That could very well be the fastest method.



--
Erland Sommarskog, SQL Server MVP, esquel@sommarskog.se

Books Online for SQL Server 2005 at
http://www.microsoft.com/technet/pro...ads/books.mspx
Books Online for SQL Server 2000 at
http://www.microsoft.com/sql/prodinf...ons/books.mspx
Closed Thread