469,579 Members | 1,059 Online
Bytes | Developer Community
New Post

Home Posts Topics Members FAQ

Post your question to a community of 469,579 developers. It's quick & easy.

duplicate rows but no key on the tables


Dear All,

I have a table with 10 billion records but there are no key on it. I cannot
build a key on it as it is the data source.

However, the data source exits the duplicated rows.

I have used the DTS to transform the data into a new table and delete the
duplicated rows. As there are 10 billion records, i need to divide it into 3
parts and also the process lasts for 6 hours each part.

I want to ask is there any other good methods to slove my problem??

Thx
Esther
Jul 23 '05 #1
1 1338
esther s via SQLMonster.com (fo***@SQLMonster.com) writes:
I have a table with 10 billion records but there are no key on it. I
cannot build a key on it as it is the data source.

However, the data source exits the duplicated rows.

I have used the DTS to transform the data into a new table and delete
the duplicated rows. As there are 10 billion records, i need to divide
it into 3 parts and also the process lasts for 6 hours each part.

I want to ask is there any other good methods to slove my problem??


Eliminating duplicates from 10 milliard(*) rows is nothing for the
impatient. I'm happy that I don't have to play that game.

(*) I assume. 10 billion rows as in what I mean with billion would be
really dauting...

--
Erland Sommarskog, SQL Server MVP, es****@sommarskog.se

Books Online for SQL Server SP3 at
http://www.microsoft.com/sql/techinf...2000/books.asp
Jul 23 '05 #2

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

2 posts views Thread by John Steen | last post: by
18 posts views Thread by Elroyskimms | last post: by
reply views Thread by Chris Becker | last post: by
12 posts views Thread by Jared Carr | last post: by
reply views Thread by phillip.s.powell | last post: by
5 posts views Thread by dale.zjc | last post: by
4 posts views Thread by guiromero | last post: by
By using this site, you agree to our Privacy Policy and Terms of Use.