473,503 Members | 1,647 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Can you use web search engines as front ends to your database?

2 problems:

Example: If a person types in a part number into Yahoo:

1. Is there a way for Yahoo to list your web site as one of the
results.

2. If the user clicks on your link, can your web application know the
part number the user typed into the Yahoo search box. I would like to
use that part number to query our database and present a dynamic web
page with the details of that part number.
I know one way to solve this is to create a web page for every part
number, but since there are over 10 million part numbers it wouldn't be
the best solution. I need a way to dynamically generate that web page
(hopefully with VB.NET, my prefered language).
Thanks,
Dominic Isaia
di****@earthlink.net

Jul 21 '05 #1
1 1773
Search engines crawl each web site, often months after they "discover" their
existence (which they do when you tell them about you, by listing on one of
the listing services). The Microsoft Small Business Center has a nice
registration service that informs search engines of the existence of your
site (see http://www.microsoft.com/smallbusiness/bc/default.mspx )

So, if you want a search engine to return a hit when a part number is
entered, you need to make sure that that:

a) your web site has a complete, navigable, tree containing your entire
catalog, with part numbers and complete descriptions of the product on every
page. Crawlers will not run your Search function, nor will they run
Javascript, nor will they follow a link that varies from another link only
by a parameter, so it has to be straight-out-navigation. This usually
requires you to implement an HTTPModule
(http://www.devx.com/vb2themax/Article/19901) so that you can embed the
parameters directly into the name of the "resource".

For example, browse over to Amazon. Drill down from the menus. You will
find that, technically, you can get to EVERY product in the Amazon catalog
without using Javascript and by simply linking from one page to another.
After you've found a book, look at the URL. It will be a long custom string
(they invented their own page engine called obidos). Select all parts of
the string BEFORE the ?. (That is the only part that a crawler will keep).
Now, copy that into another browser window. You will find the exact same
book. In other words, the crawler needs to find the part by urls that look
like this:
http://site.example.com/catalog/part42134321
and not a url that looks like this
http://site.example.com/showpage.aspx?part=42134321

b) you should find a way to increase your link visibility, by getting as
many other sites to link to yours as possible. Crawlers find you that way
too. I recommend that you look at partnerships and relationships with other
sites, so that they will link you frequently. Once again, the links should
be as specific as possible and must not rely on parameters to find the part.

c) pray that your part numbers are relatively unique compared to part
numbers from other products or from other companies.

Good Luck,

--
--- Nick Malik [Microsoft]
MCSD, CFPS, Certified Scrummaster
http://blogs.msdn.com/nickmalik

Disclaimer: Opinions expressed in this forum are my own, and not
representative of my employer.
I do not answer questions on behalf of my employer. I'm just a
programmer helping programmers.
--
<di****@earthlink.net> wrote in message
news:11**********************@z14g2000cwz.googlegr oups.com...
2 problems:

Example: If a person types in a part number into Yahoo:

1. Is there a way for Yahoo to list your web site as one of the
results.

2. If the user clicks on your link, can your web application know the
part number the user typed into the Yahoo search box. I would like to
use that part number to query our database and present a dynamic web
page with the details of that part number.
I know one way to solve this is to create a web page for every part
number, but since there are over 10 million part numbers it wouldn't be
the best solution. I need a way to dynamically generate that web page
(hopefully with VB.NET, my prefered language).
Thanks,
Dominic Isaia
di****@earthlink.net

Jul 21 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

8
2599
by: Rod | last post by:
Hi, i am doing a ecommerce website and would like to implement a search engine to find products. All the serach engine I have found on the web are parsing html page! This is not what i want. i...
0
4118
by: R. Rajesh Jeba Anbiah | last post by:
Q: Is PHP search engine friendly? Q: Will search engine spiders crawl my PHP pages? A: Spiders should crawl anything provided they're accessible. Since, nowadays most of the websites are been...
8
2708
by: Stromboli | last post by:
Hi, I have my site available in a couple of languages most of the files are indexf.html (french), indexi.html (italian) and indexde.html (german).. I'd like to start using multiviews but I've...
83
5843
by: D. Dante Lorenso | last post by:
Trying to use the 'search' in the docs section of PostgreSQL.org is extremely SLOW. Considering this is a website for a database and databases are supposed to be good for indexing content, I'd...
7
2323
by: http://vmdd.tech.mylinuxisp.com/catalog/ | last post by:
After having seen my co-worker reinventing the wheel when he busily labored to build MS Access framework, I want to share my perspective. Having experienced with Access, Visual Basic, Visual...
1
245
by: disaia | last post by:
2 problems: Example: If a person types in a part number into Yahoo: 1. Is there a way for Yahoo to list your web site as one of the results. 2. If the user clicks on your link, can your web...
4
2157
by: MDW | last post by:
Posted this on another board, but evidently it was off-topic there...hope you folks will be able to provide some guidance. I've been working on a Web site for a business (my first non-personal...
1
2708
by: Eric | last post by:
Hi: I have two files. I search pattern ":" from emails text file and save email contents into a database. Another search pattern " field is blank. Please try again.", vbExclamation + vbOKOnly...
0
2428
by: passion | last post by:
"Specialized Search Engines" along with Google Search Capability (2 in 1): http://specialized-search-engines.blogspot.com/ Billions of websites are available on the web and plenty of extremely...
0
7316
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
5566
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
1
4993
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...
0
4666
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and...
0
3160
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The...
0
3148
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
0
1495
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated ...
1
729
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
0
372
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.