Google Bot problems?

[Steve]

I have worked on a couple of sites which google's bot visits, partially lists
and then goes away again.

MSN and Yahoo are fine and working.

Can anyone please suggest what, if anything, is wrong with these sites? Frankly
I am a bit baffled at the moment! I am wondering if there is a problem with the
page headers and googlebot?

All suggestions appreciated.

Thanks in advance,


Steve

Sites & Google results are:-

http://tinyurl.com/6tr2b

http://tinyurl.com/5dj6w

[Steve]

me wrote:

"Steve" <pl************ ***@ireland.com > wrote in message
news:_m******** ***********@new s.indigo.ie...

I have worked on a couple of sites which google's bot visits, partially

lists

and then goes away again.

MSN and Yahoo are fine and working.

Can anyone please suggest what, if anything, is wrong with these sites?

Frankly

I am a bit baffled at the moment! I am wondering if there is a problem

with the

page headers and googlebot?
All suggestions appreciated.
Thanks in advance,

Steve

Sites & Google results are:-

http://tinyurl.com/6tr2b

http://tinyurl.com/5dj6w

Don't assume that if you submit your site to one engine the others will also
pick it up (unless it's Google). Submit your site to Google directly:

http://www.google.com/addurl/

Incidentally the others search engines do eventually pick up any site that
Google lists, they know who the top search engine is even if MS *still*
doesn't. ;-)

This page still does not have <meta name="robots" content="ALL"> in the head
so I assume there may be others that don't. It may not be absolute necessity
to have this tag on every page but what can it hurt? I always plan for the
worst and hope for the best.

http://www.stevenhenson.com/spider_map.htm

There's also a trailing slash after the word "ALL" in the tag you're using.
I don't know if this will cause a problem but I would omit it just in case.

If you have submitted your site recently it may (surely?) take two weeks to
several months before it gets listed.
Good Luck,
me

Thank you!

I have added the robots ALL tag to the spider_map page and submitted that page
to Google. Not sure if this will work but the spider_map page is a page
deliberately designed to make life easy for the spiders...so hopefully we might
make some headway!

Google keeps visiting the sites, looks at one or two pages (according to the
logs) and then goes away again.

Every now and then Google shows the sites as having a couple of pages listed -
and then reduces then down to the minimum information (i.e. just one page). Its
rather like Google cannot make its mind up to include the site and keeps coming
back for a nibble!
Steve

[Big Bill]

On Thu, 10 Mar 2005 07:22:54 GMT, Adrienne <ar********@sbc global.net>
wrote:

Gazing into my crystal ball I observed Big Bill <kr***@cityscap e.co.uk>
writing in news:18******** *************** *********@4ax.c om:

On Wed, 9 Mar 2005 09:01:36 -0600, "me" <anonymous@_.co m> wrote:

"Steve" <pl************ ***@ireland.com > wrote in message
news:_m***** **************@ news.indigo.ie. ..
I have worked on a couple of sites which google's bot visits, partially
lists and then goes away again.

MSN and Yahoo are fine and working.

Can anyone please suggest what, if anything, is wrong with these sites?
Frankly I am a bit baffled at the moment! I am wondering if there is a
problem with the page headers and googlebot?
All suggestions appreciated.
Thanks in advance,
Steve

Sites & Google results are:-

http://tinyurl.com/6tr2b

http://tinyurl.com/5dj6w

Place this in the head of every page:

<meta name="robots" content="ALL">

IIRC bots may enter from any page so this may help.
Good Luck,
me

It won't do anything. Robots ignore meta tags like that as they index
what they can anyway by default. It would be useful if the relevant
robots.txts were displayed here.

BB.

--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--

1. http://www.barrabooks.com/robots.txt

User-agent: *
Disallow: /picture_library/
Disallow: /Store/
Disallow: /CCS/
Disallow: /webstat/
Disallow: /plesk-stat/
Disallow: /php/

2. http://www.stevenhenson.com/robots.txt

User-agent: *
Disallow: /picture_library/
Disallow: /Store/
Disallow: /CCS/
Disallow: /webstat/
Disallow: /plesk-stat/
Disallow: /php/

I don't see anything unusual do you?

No but something's somewhere. I'll have to come back to this as I'm
trying to download a windows update and watch Zev fron Lexx in the
shower just at the mo.

BB
--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--

[Big Bill]

On Thu, 10 Mar 2005 21:24:11 +0000, Steve
<pl************ ***@ireland.com > wrote:

me wrote:

"Steve" <pl************ ***@ireland.com > wrote in message
news:_m******** ***********@new s.indigo.ie...

I have worked on a couple of sites which google's bot visits, partially
lists

and then goes away again.

MSN and Yahoo are fine and working.

Can anyone please suggest what, if anything, is wrong with these sites?

Frankly

I am a bit baffled at the moment! I am wondering if there is a problem

with the

page headers and googlebot?
All suggestions appreciated.
Thanks in advance,

Steve

Sites & Google results are:-

http://tinyurl.com/6tr2b

http://tinyurl.com/5dj6w

Don't assume that if you submit your site to one engine the others will also
pick it up (unless it's Google). Submit your site to Google directly:

http://www.google.com/addurl/

Incidentally the others search engines do eventually pick up any site that
Google lists, they know who the top search engine is even if MS *still*
doesn't. ;-)

This page still does not have <meta name="robots" content="ALL"> in the head
so I assume there may be others that don't. It may not be absolute necessity
to have this tag on every page but what can it hurt? I always plan for the
worst and hope for the best.

http://www.stevenhenson.com/spider_map.htm

There's also a trailing slash after the word "ALL" in the tag you're using.
I don't know if this will cause a problem but I would omit it just in case.

If you have submitted your site recently it may (surely?) take two weeks to
several months before it gets listed.
Good Luck,
me

Thank you!

I have added the robots ALL tag to the spider_map page and submitted that page
to Google. Not sure if this will work

It won't. It's pointless other than it takes up space.
but the spider_map page is a page
deliberately designed to make life easy for the spiders...so hopefully we might
make some headway!

How many links on it, by the way?

BB
--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--

[Big Bill]

On Thu, 10 Mar 2005 08:23:50 -0600, "me" <anonymous@_.co m> wrote:

"Steve" <pl************ ***@ireland.com > wrote in message
news:_m******* ************@ne ws.indigo.ie...

I have worked on a couple of sites which google's bot visits, partially

lists

and then goes away again.

MSN and Yahoo are fine and working.

Can anyone please suggest what, if anything, is wrong with these sites?

Frankly

I am a bit baffled at the moment! I am wondering if there is a problem

with the

page headers and googlebot?
All suggestions appreciated.
Thanks in advance,

Steve

Sites & Google results are:-

http://tinyurl.com/6tr2b

http://tinyurl.com/5dj6w

Don't assume that if you submit your site to one engine the others will also
pick it up (unless it's Google). Submit your site to Google directly:

http://www.google.com/addurl/

Incidentally the others search engines do eventually pick up any site that
Google lists, they know who the top search engine is even if MS *still*
doesn't. ;-)

This page still does not have <meta name="robots" content="ALL"> in the head
so I assume there may be others that don't. It may not be absolute necessity
to have this tag on every page but what can it hurt? I always plan for the
worst and hope for the best.

http://www.stevenhenson.com/spider_map.htm

There's also a trailing slash after the word "ALL" in the tag you're using.
I don't know if this will cause a problem but I would omit it just in case.

If you have submitted your site recently it may (surely?) take two weeks to
several months before it gets listed.
Good Luck,
me

(?)

BB
--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--

[Tim]

"me" <anonymous@_.co m> wrote:

Place this in the head of every page:

<meta name="robots" content="ALL">

Big Bill <kr***@cityscap e.co.uk> posted:
It won't do anything. Robots ignore meta tags like that as they index
what they can anyway by default.

Perhaps that particular example might be ignored, but some robots do pay
attention to robot meta statements in the HTML head. Mostly about what
they should ignore, in some way, rather than what they should look at.

I recommend having a look through <http://www.google.com/webmasters/> for
more information about the robots, as well as why Google might be ignoring
the site. For instance, your wad of meta keywords might be doing you more
harm than good.

--
If you insist on e-mailing me, use the reply-to address (it's real but
temporary). But please reply to the group, like you're supposed to.

This message was sent without a virus, please delete some files yourself.

[Tim]

On Thu, 10 Mar 2005 08:23:50 -0600,
"me" <anonymous@_.co m> posted:

There's also a trailing slash after the word "ALL" in the tag you're using.
I don't know if this will cause a problem but I would omit it just in case.

If the page really is the XHTML that it claims to be, the slash at the end
of the meta element belongs where it is, and should *not* be removed.

--
If you insist on e-mailing me, use the reply-to address (it's real but
temporary). But please reply to the group, like you're supposed to.

This message was sent without a virus, please delete some files yourself.

[Steve]

Tim wrote:

I recommend having a look through <http://www.google.com/webmasters/> for
more information about the robots, as well as why Google might be ignoring
the site. For instance, your wad of meta keywords might be doing you more
harm than good.

Thanks Tim. I am going to slim down the meta keywords just as soon as I can get
the PR people to agree to this........I never wanted that many in the first place!

Have checked out the webmasters stuff from Google site. At the moment I do not
see anything that stands out as being a glaring error.

Regards,

Steve

[Steve]

Tim wrote:

On Thu, 10 Mar 2005 08:23:50 -0600,
"me" <anonymous@_.co m> posted:

There's also a trailing slash after the word "ALL" in the tag you're using.
I don't know if this will cause a problem but I would omit it just in case.

If the page really is the XHTML that it claims to be, the slash at the end
of the meta element belongs where it is, and should *not* be removed.

It was set-up at XHTML 1.0 Transitional. Point noted.

[Steve]

> How many links on it, by the way?

BB
--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--

Bill,

Its all links and page title information. Is that an issue?

Steve

[me]

"Steve" <pl************ ***@ireland.com > wrote in message
news:Ln******** ***********@new s.indigo.ie...

Tim wrote:

On Thu, 10 Mar 2005 08:23:50 -0600,
"me" <anonymous@_.co m> posted:

There's also a trailing slash after the word "ALL" in the tag you're using.I don't know if this will cause a problem but I would omit it just in

case.

If the page really is the XHTML that it claims to be, the slash at the end of the meta element belongs where it is, and should *not* be removed.

It was set-up at XHTML 1.0 Transitional. Point noted.

I'm curious, how does setting up that page as XHTML benefit you, what
specifically does it do?
Signed,
me