467,074 Members | 933 Online
Bytes | Developer Community
Ask Question

Home New Posts Topics Members FAQ

Post your question to a community of 467,074 developers. It's quick & easy.

Python script not mapping our site correctly?

We have been using the Google recommended python script for about a
year. We recently realized that the script was not crawling our sites
url's, but just our folders which reside on the server. The python
script seems to be designed for 'non database' sites, not a site which
is using .asp, and has dynamic pages.

We are an ecommerce site. What are other ecommerce sites using to
create an xml file?

Are they using the python script?

Thank you for your help.

Michael

May 24 '07 #1
  • viewed: 1372
Share:
1 Reply
mi*************@gmail.com wrote:
We have been using the Google recommended python script for about a
year.
Which script would that be? Googling for 'python script' yields approx.
27 million hits.
We recently realized that the script was not crawling our sites
url's, but just our folders which reside on the server.
The behavior of the script recently changed, or you were running the
script for a year not realizing what its purpose was?
The python
script seems to be designed for 'non database' sites, not a site which
is using .asp, and has dynamic pages.
It sounds like your script is just traversing a directory structure on
disk, presumably indexing the text in the files found there. I think it
sounds like (but I'm guessing, here) that you want what is known as a
web crawler, that communicates via http with your site, follows links,
and indexes the resulting pages.
We are an ecommerce site. What are other ecommerce sites using to
create an xml file?
XML is mostly used to persist data of one sort or another. What kind of
XML file do you want to create?
Are they using the python script?
We aren't going to be able to help you with this question until you
become *much more specific*:

+ Which python script? Where did you download it from and what is it called?

+ What is the purpose of the XML you want generated? (WAG: Submit to
Froogle?)

+ What pages do you want indexed?

Usually, for database-driven ecommerce sites, for developing lists of
products for submission to places like Froogle, I don't go via the web
interface at all: I write python scripts (there's that word again!) to
connect to the database, and run queries to determine the results, run
that through a template for each line that figures out things such as
the URL of the page that represents the product, etc.)

But I hesitate to say much more until we understand what you want your
python script to do.
--
pkm ~ http://paulmcnett.com
May 24 '07 #2

This discussion thread is closed

Replies have been disabled for this discussion.

Similar topics

2 posts views Thread by ben moretti | last post: by
2 posts views Thread by Jorgen Grahn | last post: by
13 posts views Thread by Jon Cosby | last post: by
37 posts views Thread by John Salerno | last post: by
By using this site, you agree to our Privacy Policy and Terms of Use.