473,395 Members | 1,783 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,395 software developers and data experts.

Tool to merge duplicate rows with slightly different data in some fields?

I have a number of spreadsheets, each with between 1000-6000 rows (each row
is a property) and they all need to be combined into a single database. Each
spreadsheet contains slightly different information and 80% of the
properties in spreadsheet_01 also appear spreadsheet_02. Spreadsheet_03
contains slightly different information again and perhaps has 60% of
properties in this one also appear in other spreadsheets. The problem is not
straightforward as data such as an address in Spreadsheet_01 may be written
slightly different to Spreadsheet_02.

My initial thought is to make all the spreadsheets the same structure (which
will be then be the database schema), cut and paste to create one large
table and then find some tool that will find possible duplicate rows and
merge the data into one.

Does such a tool exist? I could even set ODBC connection if I need to use a
non-Access database to sort this mess out.

Any advice would be gratefully received.

Cheers

Phil

Dec 6 '07 #1
1 2478

"Phil Latio" <ph********@f-in-stupid.co.ukwrote in message
news:xB*******************@fe01.news.easynews.com. ..
>I have a number of spreadsheets, each with between 1000-6000 rows (each row
is a property) and they all need to be combined into a single database.
Each spreadsheet contains slightly different information and 80% of the
properties in spreadsheet_01 also appear spreadsheet_02. Spreadsheet_03
contains slightly different information again and perhaps has 60% of
properties in this one also appear in other spreadsheets. The problem is
not straightforward as data such as an address in Spreadsheet_01 may be
written slightly different to Spreadsheet_02.

My initial thought is to make all the spreadsheets the same structure
(which will be then be the database schema), cut and paste to create one
large table and then find some tool that will find possible duplicate rows
and merge the data into one.

Does such a tool exist? I could even set ODBC connection if I need to use
a non-Access database to sort this mess out.

Any advice would be gratefully received.

Cheers

Phil
Don't worry, I've found the "dupicates query wizard". Might take some
fiddling but looks like it should get me 90% and I can handle a bit of
manual editing.

Cheers

Phil

Dec 6 '07 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
by: webtrack+googlegroups | last post by:
I'm trying automate a mail merge in VB.Net as a spike/proof-of-concept. The resulting mail merge document should look very roughly like this: <<Customer FullName>> <<Customer Address>> Dear...
4
by: John Smith | last post by:
..Net 2003 C# I get xml from a sql database pull. I put the data into a XMLDomDocument and then the user changes it. I now need to update the database correctly. I need to be able to get the data...
8
by: Darryl Kerkeslager | last post by:
I hope that although this is 25% Access and 75% Word, that someone will know ... The whole problem here arises because 1) Microsoft acknowledges an 'issue' wherein TextInput type FormFields are...
3
by: Andy Davis | last post by:
I have set up a mail merge document in Word 2003 which gets its data from my Access 2000 database. I want to set up a button on a form that: 1. runs the query to provide the dat for the merge...
0
by: bettervssremoting | last post by:
To view the full article, please visit http://www.BetterVssRemoting.com Better VSS Remote Access Tool including SourceOffSite, SourceAnyWhere and VSS Remoting This article makes a detailed...
1
by: Joey Lee | last post by:
Hi, I am confused as what the DataSet Merge() function does. Currently I have two datatable which was selected from different table in mssql. Now with both different datatable. there are...
0
by: kiki | last post by:
I have two datasets with the same schema,each of which has some datarows.After i merge them into one datset i found that there were some duplicate rows in these rows.then how can i remove the...
5
by: Manish | last post by:
The topic is related to MySQL database. Suppose a table "address" contains the following records ------------------------------------------------------- | name | address | phone |...
4
by: Thomas Arthur Seidel | last post by:
Hello to all, I have a small or big problem with a customer data base, where during a change of system we might have created duplicate records. This should be easy to find, you might think, but,...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.