Creating my own localised search engine

[Laphan]

Hi Guys

Wonder if you can help.

I know there are quite a few out there, FusionBot being one that I have
taken a shine to, but if not just for the challenge I want to create my own
localised search engine that allows me to put search across say 5 - 10 of my
web sites.

Now these sites are on different servers and most are not ASP hosted, but as
FusionBot seems to be able to index remote sites and then give you a bit of
code to query it's own DB, it must be possible to do.

Can anybody give me any pointers on what seems to be a brute force approach.

Many thanks.

Rgds

Laphan

[William Tasso]

Laphan wrote:

I want to
create my own localised search engine that allows me to put search
across say 5 - 10 of my web sites.

http://www.perl.com/pub/a/2003/02/19/engine.html
--
William Tasso - http://WilliamTasso.com

[Jeff Cochran]

On Tue, 21 Oct 2003 22:58:25 +0100, "Laphan" <ne**@DoNotEmailMe.co.uk>
wrote:

I know there are quite a few out there, FusionBot being one that I have
taken a shine to, but if not just for the challenge I want to create my own
localised search engine that allows me to put search across say 5 - 10 of my
web sites.

Have you looked at Indexing Services?

Jeff

[Laphan]

Thanks for the info guys.

Not too sure about the indexing services, but my plan was as follows:

1) client goes to my site and enters their web sites.

2) My site, which is ASP based, basically spiders their pages into a DB (?).

3) Client puts a bit of code on each of their sites, which a form to
basically query my site's DB.

The reason I was thinking of a DB was that I could give a unique ID to each
of their sites so that they could either search web site no. 1 of Joe Bloggs
or all of Joe Bloggs' web sites.

Only bit that's got me stuck (which is the major part!!!) is how to do the
spidering.

Any ideas in light of the above??

Rgds

Laphan

Jeff Cochran <jc*************@naplesgov.com> wrote in message
news:3f****************@msnews.microsoft.com...
On Tue, 21 Oct 2003 22:58:25 +0100, "Laphan" <ne**@DoNotEmailMe.co.uk>
wrote:

I know there are quite a few out there, FusionBot being one that I have
taken a shine to, but if not just for the challenge I want to create my own
localised search engine that allows me to put search across say 5 - 10 of myweb sites.

Have you looked at Indexing Services?

Jeff

[Jeff Cochran]

On Wed, 22 Oct 2003 19:54:04 +0100, "Laphan" <ne**@DoNotEmailMe.co.uk>
wrote:

Thanks for the info guys.

Not too sure about the indexing services, but my plan was as follows:

1) client goes to my site and enters their web sites.

2) My site, which is ASP based, basically spiders their pages into a DB (?).

3) Client puts a bit of code on each of their sites, which a form to
basically query my site's DB.

The reason I was thinking of a DB was that I could give a unique ID to each
of their sites so that they could either search web site no. 1 of Joe Bloggs
or all of Joe Bloggs' web sites.

Only bit that's got me stuck (which is the major part!!!) is how to do the
spidering.

Any ideas in light of the above??
Indexing Services is out then, I read this as the client sites being
physically on your server, not remote. The spidering isn't an ASP
issue, you might want to ask in a programming group. Or Google for a
spidering solution, I know I've seen them in Perl.

Jeff

Jeff Cochran <jc*************@naplesgov.com> wrote in message
news:3f****************@msnews.microsoft.com...
On Tue, 21 Oct 2003 22:58:25 +0100, "Laphan" <ne**@DoNotEmailMe.co.uk>
wrote:

I know there are quite a few out there, FusionBot being one that I have
taken a shine to, but if not just for the challenge I want to create my own
localised search engine that allows me to put search across say 5 - 10 of

my

web sites.

Have you looked at Indexing Services?

Jeff