Approximate String Searches - Microsoft SQL Server

boblotz2001

For anybody that implemented fuzzy searches in SQL Server or any other
database for that matter. I have implemented edit distance algorithm,
specifically q-grams, in SQL Server and wanted to get some opinions
from anyone who used a similar algorithm in a DBMS.

We are looking to implement fuzzy address search and are employing
number of different techniques including synonyms for strings like
"drive", "dr", "drv", etc... Number expansion, so 6 ave = Six Ave =
6th Ave = 6... Now, we also have an implementation of edit distance
algorithm, which would cover misspellings and similar sounding words.
One of the challenges is putting various techniques together. Synonyms
and number expansion techniques go well together but no edit distance.
Also, I am trying to figure out how to leverage edit distance
implementation for 'contains' searches. So if a string like
'Mississippi Municipal Building' would be returned if the Search is for
'Misisipi Municipal'.

Any thoughts?

Nov 2 '05 #1

Subscribe Post Reply

2512

Tony Rogerson

Have you checked out the text extraction and fuzzy grouping stuff in SQL
Server Integration Services in SQL Server 2005, I've not used it on
addresses yet, but keyword searches and posts from these forums - quite
interesting results too!

Give it a wurl, its not got the options but it does work.

--
Tony Rogerson
SQL Server MVP
http://sqlserverfaq.com - free video tutorials
<bo*********@yahoo.com> wrote in message
news:11*********************@g49g2000cwa.googlegro ups.com...

For anybody that implemented fuzzy searches in SQL Server or any other
database for that matter. I have implemented edit distance algorithm,
specifically q-grams, in SQL Server and wanted to get some opinions
from anyone who used a similar algorithm in a DBMS.

We are looking to implement fuzzy address search and are employing
number of different techniques including synonyms for strings like
"drive", "dr", "drv", etc... Number expansion, so 6 ave = Six Ave =
6th Ave = 6... Now, we also have an implementation of edit distance
algorithm, which would cover misspellings and similar sounding words.
One of the challenges is putting various techniques together. Synonyms
and number expansion techniques go well together but no edit distance.
Also, I am trying to figure out how to leverage edit distance
implementation for 'contains' searches. So if a string like
'Mississippi Municipal Building' would be returned if the Search is for
'Misisipi Municipal'.

Any thoughts?

Nov 3 '05 #2

Similar topics

String search vs regexp search

by: Anand Pillai | last post by:

To search a word in a group of words, say a paragraph or a web page, would a string search or a regexp search be faster? The string search would of course be, if str.find(substr) != -1:...

Python

Build SQL search string

by: JP SIngh | last post by:

Hi There I am creating a search page and need help writing the code to build the sql string. I have 3 fields on the main page which a user can choose to enter search terms in any of the 3...

ASP / Active Server Pages

Script to search for a string in all varchar columns in all tables in a database?

by: Tony | last post by:

I have a string which I need to know where it came from in a database. I don't want to spend time coding this so is there a ready made script which takes a string as a parameter and searches all...

Microsoft SQL Server

Find a string in another string

by: MM | last post by:

Hello there I need a way to efficiently check if a string I specify can be found in another string. For example, if I look for the string "searchString" in the string "jlh ahs dalskd" then it...

C / C++

How can i Right Trim all the spaces of a very long (2000 chars) Charecter string ?

by: Durgesh Sharma | last post by:

Hi All, Pleas help me .I am a starter as far as C Language is concerned . How can i Right Trim all the white spaces of a very long (2000 chars) Charecter string ( from the Right Side ) ? or how...

C / C++

How can I create a 2D ArrayList? String usually.

by: Dan V. | last post by:

I would like to create a 2D string list (2D ArrayList ???). I would like to pass in a table or query as a parameter and have both columns transform into a 2D ArrayList. When I sort the one...

C# / C Sharp

"Google Like" with weighted searches project

by: DQ dont quit | last post by:

I'm currently working on a ASP.Net / C# / SQL 2000 project that involves the entering of keywords, that a web user enters, and then searching MSWord documents for those words. This information...

.NET Framework

Question about find_first_of of the STL string class

by: Allerdyce.John | last post by:

I have my source string like this: As i step thru the debugger, I can't understand why namePosStart is 2 namePosEnd is 15 I expect: namePosStart is 9 namePosStart is 11

C / C++

return the start of a substring in a string in c

by: yinglcs | last post by:

Hi, In java, there is an 'indexOf' function in String which does this: indexOf(String str) Returns the index within this string of the first occurrence of the specified substring. is there...

C / C++

How to turn on java script in a villaon keypad mobile phone

by: Charles Arthur | last post by:

How do i turn on java script on a villaon, callus and itel keypad mobile phone

Java

Navigating the Data Structures and Algorithms (DSA)

by: BarryA | last post by:

What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...

Algorithms / Advanced Math

Looking to do Android software development, any suggestions? Is flutter better?

by: nemocccc | last post by:

hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?

General

Is that possible of reading the .csv file in column wise and the column have different lengths ?

by: Sonnysonu | last post by:

This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...

C / C++

How to build RAID in BIOS?

by: Hystou | last post by:

There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...

Computer Hardware

Problem With Comparison Operator <=> in G++

by: Oralloy | last post by:

Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...

C / C++

Discussion: How does Zigbee compare with other wireless protocols in smart home applications?

by: tracyyun | last post by:

Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...

General

AI Job Threat for Devs

by: agi2029 | last post by:

Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

Career Advice

Access Europe - Using VBA to create a class based on a table - Wed 1 May

by: isladogs | last post by:

The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...

Microsoft Access / VBA