Hi Guys
Wonder if you can help.
I know there are quite a few out there, FusionBot being one that I have
taken a shine to, but if not just for the challenge I want to create my own
localised search engine that allows me to put search across say 5 - 10 of my
web sites.
Now these sites are on different servers and most are not ASP hosted, but as
FusionBot seems to be able to index remote sites and then give you a bit of
code to query it's own DB, it must be possible to do.
Can anybody give me any pointers on what seems to be a brute force approach.
Many thanks.
Rgds
Laphan 4 1907
On Tue, 21 Oct 2003 22:58:25 +0100, "Laphan" <ne**@DoNotEmai lMe.co.uk>
wrote: I know there are quite a few out there, FusionBot being one that I have taken a shine to, but if not just for the challenge I want to create my own localised search engine that allows me to put search across say 5 - 10 of my web sites.
Have you looked at Indexing Services?
Jeff
Thanks for the info guys.
Not too sure about the indexing services, but my plan was as follows:
1) client goes to my site and enters their web sites.
2) My site, which is ASP based, basically spiders their pages into a DB (?).
3) Client puts a bit of code on each of their sites, which a form to
basically query my site's DB.
The reason I was thinking of a DB was that I could give a unique ID to each
of their sites so that they could either search web site no. 1 of Joe Bloggs
or all of Joe Bloggs' web sites.
Only bit that's got me stuck (which is the major part!!!) is how to do the
spidering.
Any ideas in light of the above??
Rgds
Laphan
Jeff Cochran <jc************ *@naplesgov.com > wrote in message
news:3f******** ********@msnews .microsoft.com. ..
On Tue, 21 Oct 2003 22:58:25 +0100, "Laphan" <ne**@DoNotEmai lMe.co.uk>
wrote: I know there are quite a few out there, FusionBot being one that I have taken a shine to, but if not just for the challenge I want to create my own localised search engine that allows me to put search across say 5 - 10 of
myweb sites.
Have you looked at Indexing Services?
Jeff
On Wed, 22 Oct 2003 19:54:04 +0100, "Laphan" <ne**@DoNotEmai lMe.co.uk>
wrote: Thanks for the info guys.
Not too sure about the indexing services, but my plan was as follows:
1) client goes to my site and enters their web sites.
2) My site, which is ASP based, basically spiders their pages into a DB (?).
3) Client puts a bit of code on each of their sites, which a form to basically query my site's DB.
The reason I was thinking of a DB was that I could give a unique ID to each of their sites so that they could either search web site no. 1 of Joe Bloggs or all of Joe Bloggs' web sites.
Only bit that's got me stuck (which is the major part!!!) is how to do the spidering.
Any ideas in light of the above??
Indexing Services is out then, I read this as the client sites being
physically on your server, not remote. The spidering isn't an ASP
issue, you might want to ask in a programming group. Or Google for a
spidering solution, I know I've seen them in Perl.
Jeff
Jeff Cochran <jc************ *@naplesgov.com > wrote in message news:3f******* *********@msnew s.microsoft.com ... On Tue, 21 Oct 2003 22:58:25 +0100, "Laphan" <ne**@DoNotEmai lMe.co.uk> wrote:
I know there are quite a few out there, FusionBot being one that I have taken a shine to, but if not just for the challenge I want to create my own localised search engine that allows me to put search across say 5 - 10 of myweb sites.
Have you looked at Indexing Services?
Jeff This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics |
by: R. Rajesh Jeba Anbiah |
last post by:
Q: Is PHP search engine friendly?
Q: Will search engine spiders crawl my PHP pages?
A:
Spiders should crawl anything provided they're accessible. Since,
nowadays most of the websites are been developed with PHP, you are not
supposed to doubt that.
As a proof that PHP pages could be crawled and indexed, refer this
Google search
|
by: Laphan |
last post by:
Hi All
I know I've asked about this in the past, but my ISP has confirmed that it
supports the XMLhttp object on their servers.
My idea is that I want to be able to create a localised search engine for
people, but I don't want to put my code on their sites. My idea was like
how FusionBot do it, in that they use ASP and I think the XMLhttp object to
basically drag all of the info out a remote site and store it into a DB on
their web...
|
by: Petre Huile |
last post by:
I have designed a site for a client, but they have hired an internet
marketing person to incrase their search engine ranking and traffic.
He wants to put extra-large fonts on every page which will make the
design looks a bit rediculous. He also said that the big text cannot
be hidden. I am just trying to find a compromise. Here are the
questions:
(1) Is it true that a page with an <H1> tag and very big font size
will make a search...
|
by: George |
last post by:
Hi,
Anyone has the background for explaining?
I have made a search on my name and I have got a link to another
search engine.
The link's title was the search phrase for the other search engine (a
wicked phrase). Some but not all of the words of that phrase exist in
my website.
I reported it and they removed the link but did not give explanations.
|
by: Patrick |
last post by:
Are the differences between a search engine, a subject directory and a
meta search engine significant for an ebusiness web site owner?
A meta search engine merely uses ordinary existing search engines.
A subject directory classifies websites into some category.
Could anyone point me towards the differences between these three that
are significant for an ebusiness web site owner?
| |
by: Sam |
last post by:
Does anyone know of a way to create a search page under ASP.NET 2.0?
I have started out by configuring a catalog in Index Server,
registering the aspx, ascx extensions in the registry to allow them to
be indexed and built the catalog as per KB article, but I've run into
an interesting problem.
When you publish a website from Whidbey, it precompiles everything and
strips out the searchable details of the page (metadata, html, etc)...
|
by: MDW |
last post by:
Posted this on another board, but evidently it was off-topic there...hope you
folks will be able to provide some guidance.
I've been working on a Web site for a business (my first non-personal site)
and I want to help my client get the best search engine listing. Because this
is my first for-profit site, I'm not sure what I need to do for optimal
search engine placement. I've been poking around the Web, and I think I have
a good start,...
|
by: richard_b_lloyd |
last post by:
I've noticed that there are tons of tutories for creating search
engines / search pages using vb.net. What all of these tutorials don't
cover is how to parse the search text the user has enetered to handle
complex boolean searches such as, e.g. "Animal AND NOT (Cat OR Dog)"
Does anyone know of any good (Free) tutorials on text parsing that
could help me create a more complex parser than the normal and
restrictive boolean AND search on...
|
by: Richard |
last post by:
Hi folks, thanks for taking the time to read this (and hopefully point
our where I'm going wrong).
The scenario:
I have a local Access2007 database which links in several read only
mySql tables via ODBC.
The problem:
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
| |
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
by: 6302768590 |
last post by:
Hai team
i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
|
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
| |