473,406 Members | 2,867 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,406 software developers and data experts.

Search Text in Multiple Documents

Hi All,
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.

I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?

Kindly Have a discussion.
Regards and thanks

Shantanu

Apr 23 '07 #1
6 4632
"shantanu" <sh***********@gmail.comwrote in message
news:11**********************@y5g2000hsa.googlegro ups.com...
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.

I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?

Kindly Have a discussion.
You could use the Index Server that comes with Windows. Basically, you
set up Index Server on Windows pointing it to the physical directory where
your documents reside. Index Server will build an index that will later
enable it to do fast searches in the documents.
When you want to do a search, you send the query to Index Server in a
language that is similar to SQL. You can do this from your code by means of
OleDb and the OleDb driver for Index Server. You get back the list of
documents that satisfy the search criteria.

An alternative would be to save all documents as BLOBs in a SQL Server
database, and then use Full-Text Search to locate docuents that satisfy the
search criteria. If your database can handle the load, this will work very
nicely. If you don't want to duplicate the documents on the database and the
filesystem, you can write a single GetDocument.aspx page that will take a
document ID as a parameter and then write onto the Response the content of
the document extracted from the database. It could also highlight the
matches on the fly.
Apr 23 '07 #2
To add to Alberto:

SQL Server provides search filters for xls, doc, html, ppt and text files.

"shantanu" wrote:
Hi All,
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.

I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?

Kindly Have a discussion.
Regards and thanks

Shantanu

Apr 23 '07 #3
On Apr 23, 10:42 am, "Alberto Poblacion" <earthling-
quitaestoparacontes...@poblacion.orgwrote:
"shantanu" <shantanuse...@gmail.comwrote in message

news:11**********************@y5g2000hsa.googlegro ups.com...
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.
I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?
Kindly Have a discussion.

You could use the Index Server that comes with Windows. Basically, you
set up Index Server on Windows pointing it to the physical directory where
your documents reside. Index Server will build an index that will later
enable it to do fast searches in the documents.
When you want to do a search, you send the query to Index Server in a
language that is similar to SQL. You can do this from your code by means of
OleDb and the OleDb driver for Index Server. You get back the list of
documents that satisfy the search criteria.

An alternative would be to save all documents as BLOBs in a SQL Server
database, and then use Full-Text Search to locate docuents that satisfy the
search criteria. If your database can handle the load, this will work very
nicely. If you don't want to duplicate the documents on the database and the
filesystem, you can write a single GetDocument.aspx page that will take a
document ID as a parameter and then write onto the Response the content of
the document extracted from the database. It could also highlight the
matches on the fly.

The second option is good, that was my idea too, i have to check the
feasability once. But if the database thing is not feasible and if the
documents are stored in a directory structure, then how will the
search criteria work. You told Index Server is a option, but how will
this technique interact with my website, where i am using ASP.net and
C#. Are there any help available to use the meathods of Index server
from C#.

regards
shantanu

Apr 23 '07 #4
As Alberto mentioned, Index Service is a separate OS component and you use
ADO.NET to interact with it. What this means is that you have to store the
uploaded documents in a physical folder on the server and have Index service
create a searchable index of that folder. A sample is here:
http://www.codeproject.com/aspnet/search.asp

"shantanu" wrote:
On Apr 23, 10:42 am, "Alberto Poblacion" <earthling-
quitaestoparacontes...@poblacion.orgwrote:
"shantanu" <shantanuse...@gmail.comwrote in message

news:11**********************@y5g2000hsa.googlegro ups.com...
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.
I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?
Kindly Have a discussion.
You could use the Index Server that comes with Windows. Basically, you
set up Index Server on Windows pointing it to the physical directory where
your documents reside. Index Server will build an index that will later
enable it to do fast searches in the documents.
When you want to do a search, you send the query to Index Server in a
language that is similar to SQL. You can do this from your code by means of
OleDb and the OleDb driver for Index Server. You get back the list of
documents that satisfy the search criteria.

An alternative would be to save all documents as BLOBs in a SQL Server
database, and then use Full-Text Search to locate docuents that satisfy the
search criteria. If your database can handle the load, this will work very
nicely. If you don't want to duplicate the documents on the database and the
filesystem, you can write a single GetDocument.aspx page that will take a
document ID as a parameter and then write onto the Response the content of
the document extracted from the database. It could also highlight the
matches on the fly.


The second option is good, that was my idea too, i have to check the
feasability once. But if the database thing is not feasible and if the
documents are stored in a directory structure, then how will the
search criteria work. You told Index Server is a option, but how will
this technique interact with my website, where i am using ASP.net and
C#. Are there any help available to use the meathods of Index server
from C#.

regards
shantanu

Apr 23 '07 #5
On Apr 23, 11:54 am, Siva M <shiva...@online.excite.comwrote:
As Alberto mentioned, Index Service is a separate OS component and you use
ADO.NET to interact with it. What this means is that you have to store the
uploaded documents in a physical folder on the server and have Index service
create a searchable index of that folder. A sample is here:http://www.codeproject.com/aspnet/search.asp

"shantanu" wrote:
On Apr 23, 10:42 am, "Alberto Poblacion" <earthling-
quitaestoparacontes...@poblacion.orgwrote:
"shantanu" <shantanuse...@gmail.comwrote in message
>news:11**********************@y5g2000hsa.googlegr oups.com...
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.
I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?
Kindly Have a discussion.
You could use the Index Server that comes with Windows. Basically, you
set up Index Server on Windows pointing it to the physical directory where
your documents reside. Index Server will build an index that will later
enable it to do fast searches in the documents.
When you want to do a search, you send the query to Index Server in a
language that is similar to SQL. You can do this from your code by means of
OleDb and the OleDb driver for Index Server. You get back the list of
documents that satisfy the search criteria.
An alternative would be to save all documents as BLOBs in a SQL Server
database, and then use Full-Text Search to locate docuents that satisfy the
search criteria. If your database can handle the load, this will work very
nicely. If you don't want to duplicate the documents on the database and the
filesystem, you can write a single GetDocument.aspx page that will take a
document ID as a parameter and then write onto the Response the content of
the document extracted from the database. It could also highlight the
matches on the fly.
The second option is good, that was my idea too, i have to check the
feasability once. But if the database thing is not feasible and if the
documents are stored in a directory structure, then how will the
search criteria work. You told Index Server is a option, but how will
this technique interact with my website, where i am using ASP.net and
C#. Are there any help available to use the meathods of Index server
from C#.
regards
shantanu- Hide quoted text -

- Show quoted text -
Thanx Siva
I am going tru the link.
regards
shantanu

Apr 23 '07 #6
On Apr 23, 1:51 pm, shantanu <shantanuse...@gmail.comwrote:
On Apr 23, 11:54 am, Siva M <shiva...@online.excite.comwrote:


As Alberto mentioned, Index Service is a separate OS component and you use
ADO.NET to interact with it. What this means is that you have to store the
uploaded documents in a physical folder on the server and have Index service
create a searchable index of that folder. A sample is here:http://www.codeproject.com/aspnet/search.asp
"shantanu" wrote:
On Apr 23, 10:42 am, "Alberto Poblacion" <earthling-
quitaestoparacontes...@poblacion.orgwrote:
"shantanu" <shantanuse...@gmail.comwrote in message
news:11**********************@y5g2000hsa.googlegro ups.com...
I have a requirement to develop a search engine based on
some search criteria that will search for the string or statement in
all the documents uploaded in the website. The search result will be
displayed same as the Google Group search, with highlighted texts.
I have few questions:
1. What will be the logic to implement?
2. The documents that will be uploaded in the website will be saved in
the datbase or not?
3. If the document contents are not saved in the database and stored
as links of the files,
then how will the search take place
4. What will be the concept i should follow?
Kindly Have a discussion.
You could use the Index Server that comes with Windows. Basically, you
set up Index Server on Windows pointing it to the physical directory where
your documents reside. Index Server will build an index that will later
enable it to do fast searches in the documents.
When you want to do a search, you send the query to Index Server in a
language that is similar to SQL. You can do this from your code by means of
OleDb and the OleDb driver for Index Server. You get back the list of
documents that satisfy the search criteria.
An alternative would be to save all documents as BLOBs in a SQL Server
database, and then use Full-Text Search to locate docuents that satisfy the
search criteria. If your database can handle the load, this will work very
nicely. If you don't want to duplicate the documents on the database and the
filesystem, you can write a single GetDocument.aspx page that will take a
document ID as a parameter and then write onto the Response the content of
the document extracted from the database. It could also highlight the
matches on the fly.
The second option is good, that was my idea too, i have to check the
feasability once. But if the database thing is not feasible and if the
documents are stored in a directory structure, then how will the
search criteria work. You told Index Server is a option, but how will
this technique interact with my website, where i am using ASP.net and
C#. Are there any help available to use the meathods of Index server
from C#.
regards
shantanu- Hide quoted text -
- Show quoted text -

Thanx Siva
I am going tru the link.
regards
shantanu- Hide quoted text -

- Show quoted text -
I got a very good link that tells everything
http://support.microsoft.com/default...b;en-us;820105
Regards
shantanu

Apr 24 '07 #7

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
by: Alan | last post by:
I'm just about to start a project that needs to combine the results of a SQL Server query with the results of an Index Server query. The basic idea is that the user enters/selects a bunch of search...
8
by: Chris Beall | last post by:
I'm struggling with how to handle, on a web page, images that contain text that the user must be able to read. Examples: tombstone photos, photos or scans of historic documents (handwritten or...
83
by: D. Dante Lorenso | last post by:
Trying to use the 'search' in the docs section of PostgreSQL.org is extremely SLOW. Considering this is a website for a database and databases are supposed to be good for indexing content, I'd...
2
by: Samuel R. Neff | last post by:
What options are available for doing full-text searches of database data without using a database-specific full-text engine? The only option I've found is Google's Search Appliance but it's an...
1
by: simon | last post by:
hi, I have the directory with files with doc or txt or similar extensions. Now I would like to create a text search (something similar like find text ALT+F7 in windows commander): user inputs...
1
by: Roel Korsten | last post by:
Hi all, I keep uploaded documents (DOC / XLS / PDF / ...) in a SQL2000/2005-database as a binary in an image data-typed field. Now I want to search within these documents from my ASP.NET app....
5
by: Carstonio | last post by:
I use ASP to display links to Word documents on an intranet. Is there a way in ASP to do text searches on the documents' contents? I want the results to have the link to the Word document plus two...
5
by: Mark | last post by:
Hi I have an application (in vb.NET 2005) which holds data in SQL Server and some of the SQL records are simply paths to related files. I would like to be able to do a text search on both the...
16
by: Neil | last post by:
I posted a few days ago that it seems to me that the Access 2007 rich text feature does not support: a) full text justification; b) programmatic manipulation. I was hoping that someone might...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.