473,808 Members | 2,807 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Google Bot problems?

I have worked on a couple of sites which google's bot visits, partially lists
and then goes away again.

MSN and Yahoo are fine and working.

Can anyone please suggest what, if anything, is wrong with these sites? Frankly
I am a bit baffled at the moment! I am wondering if there is a problem with the
page headers and googlebot?

All suggestions appreciated.

Thanks in advance,


Steve

Sites & Google results are:-

http://tinyurl.com/6tr2b

http://tinyurl.com/5dj6w
Jul 23 '05
29 3280
>>It was set-up at XHTML 1.0 Transitional. Point noted.


I'm curious, how does setting up that page as XHTML benefit you, what
specifically does it do?
Signed,
me

I am not sure - that is the way the guy before me had set the whole thing up in,
dare I say it, dreamweaver.

As I understand it XHTML 1.0 trans is just a reformulation of HTML 4.0 - but in
XML. This page explains....its been out for about 3 years now I beleive!

http://www.w3.org/TR/xhtml1/#diffs

Steve
Jul 23 '05 #21
Tim
Tim wrote:
I recommend having a look through <http://www.google.com/webmasters/>
for more information about the robots, as well as why Google might be
ignoring the site. For instance, your wad of meta keywords might be
doing you more harm than good.

Steve wrote:
Thanks Tim. I am going to slim down the meta keywords just as soon as I
can get the PR people to agree to this........I never wanted that many in
the first place!


They're mostly useless, anyway. None of the worthwhile search engines pay
any attention to them, now (so most people say). And search engines will
eventually get better at relating terms against queries (i.e. they'll have
a table of alternatives for the same things).

But really, keywords and descriptions should be about the page that
they're on, not about other pages within the website. Search engines will
find them, by themselves. And no matter what you do, people will arrive
via a search engine directly at the page that seems most appropriate to
the search, not the homepage.

--
If you insist on e-mailing me, use the reply-to address (it's real but
temporary). But please reply to the group, like you're supposed to.

This message was sent without a virus, please delete some files yourself.

Jul 23 '05 #22
Tim
On Fri, 11 Mar 2005 08:28:21 -0600, me wrote:
I'm curious, how does setting up that page as XHTML benefit you


It doesn't benefit anyone. XHTML offers nothing as an improvement at this
stage, except more authoring, webserving, and browsing problems.

--
If you insist on e-mailing me, use the reply-to address (it's real but
temporary). But please reply to the group, like you're supposed to.

This message was sent without a virus, please delete some files yourself.

Jul 23 '05 #23
On Fri, 11 Mar 2005 05:36:45 GMT, Big Bill <kr***@cityscap e.co.uk>
wrote:
On Thu, 10 Mar 2005 07:22:54 GMT, Adrienne <ar********@sbc global.net>
wrote:
Gazing into my crystal ball I observed Big Bill <kr***@cityscap e.co.uk>
writing in news:18******** *************** *********@4ax.c om:
On Wed, 9 Mar 2005 09:01:36 -0600, "me" <anonymous@_.co m> wrote:

"Steve" <pl************ ***@ireland.com > wrote in message
news:_m**** *************** @news.indigo.ie ...
> I have worked on a couple of sites which google's bot visits, partially
> lists and then goes away again.
>
> MSN and Yahoo are fine and working.
>
> Can anyone please suggest what, if anything, is wrong with these sites?
> Frankly I am a bit baffled at the moment! I am wondering if there is a
> problem with the page headers and googlebot?
> All suggestions appreciated.
> Thanks in advance,
> Steve
>
> Sites & Google results are:-
>
> http://tinyurl.com/6tr2b
>
> http://tinyurl.com/5dj6w

Place this in the head of every page:

<meta name="robots" content="ALL">

IIRC bots may enter from any page so this may help.
Good Luck,
me

It won't do anything. Robots ignore meta tags like that as they index
what they can anyway by default. It would be useful if the relevant
robots.txts were displayed here.

BB.

--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--


1. http://www.barrabooks.com/robots.txt

User-agent: *
Disallow: /picture_library/
Disallow: /Store/
Disallow: /CCS/
Disallow: /webstat/
Disallow: /plesk-stat/
Disallow: /php/

2. http://www.stevenhenson.com/robots.txt

User-agent: *
Disallow: /picture_library/
Disallow: /Store/
Disallow: /CCS/
Disallow: /webstat/
Disallow: /plesk-stat/
Disallow: /php/

I don't see anything unusual do you?


No but something's somewhere. I'll have to come back to this as I'm
trying to download a windows update and watch Zev fron Lexx in the
shower just at the mo.

BB


Phew! Well, they both validate ok.

BB
--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--
Jul 23 '05 #24
On Fri, 11 Mar 2005 20:42:36 +1030, Tim <ti*@mail.local host.invalid>
wrote:
"me" <anonymous@_.co m> wrote:
Place this in the head of every page:

<meta name="robots" content="ALL">

Big Bill <kr***@cityscap e.co.uk> posted:
It won't do anything. Robots ignore meta tags like that as they index
what they can anyway by default.


Perhaps that particular example might be ignored, but some robots do pay
attention to robot meta statements in the HTML head. Mostly about what
they should ignore, in some way, rather than what they should look at.

I recommend having a look through <http://www.google.com/webmasters/> for
more information about the robots,


Have done. Every now and then though, out in the real world away from
what engines fondly imagine is determined by their guidelines, you
hear from reputable sources of instances where robots meta tags are
blindly ignored.

BB
as well as why Google might be ignoring
the site. For instance, your wad of meta keywords might be doing you more
harm than good.


--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--
Jul 23 '05 #25
On Fri, 11 Mar 2005 10:28:15 +0000, Steve
<pl************ ***@ireland.com > wrote:
How many links on it, by the way?

BB
--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--


Bill,

Its all links and page title information. Is that an issue?


How many though? Google doesn't seem too keen on monster links pages,
site maps or not.

BB

--
www.kruse.co.uk/ SE*@kruse.demon .co.uk
Affordable SEO!
--
Jul 23 '05 #26
Tim
Tim wrote:
I recommend having a look through <http://www.google.com/webmasters/> for
more information about the robots,


Big Bill <kr***@cityscap e.co.uk> posted:
Have done. Every now and then though, out in the real world away from
what engines fondly imagine is determined by their guidelines, you
hear from reputable sources of instances where robots meta tags are
blindly ignored.


Since the question was about the Googlebot, it's probably going to be the
first place to look, though, to find out why Google mightn't be indexing
pages that it's apparently had the chance to (i.e. it's probably more to do
with the contents, e.g. bad HTML authoring techiques and search engine
scamming methods, than messing with robot instructions).

Yes, there's robots which ignore instructions to ignore parts of sites
because there might be something juicy there if the webmaster's trying to
hide it. But you've got Buckley's chance of inducing a robot to look at a
page that it'd already ignored, merely by putting tempting robot
instructions on a page.

--
If you insist on e-mailing me, use the reply-to address (it's real but
temporary). But please reply to the group, like you're supposed to.

This message was sent without a virus, please delete some files yourself.
Jul 23 '05 #27
me
"Tim" <ti*@mail.local host.invalid> wrote in message
news:pa******** *************** *****@mail.loca lhost.invalid.. .
On Fri, 11 Mar 2005 08:28:21 -0600, me wrote:
I'm curious, how does setting up that page as XHTML benefit you


It doesn't benefit anyone. XHTML offers nothing as an improvement at this
stage, except more authoring, webserving, and browsing problems.


Then why bother?
Signed,
me
Jul 23 '05 #28
In article <11************ *@corp.supernew s.com>, anonymous@_.com enlightened
us with...

It doesn't benefit anyone. XHTML offers nothing as an improvement at this
stage, except more authoring, webserving, and browsing problems.


Then why bother?
Signed,
me


To look cool? ;)
--
--
~kaeli~
Hey, if you got it flaunt it! If you don't, stare at
someone who does. Just don't lick the TV screen, it leaves
streaks.
http://www.ipwebdesign.net/wildAtHeart
http://www.ipwebdesign.net/kaelisSpace

Jul 23 '05 #29
Tim
me wrote:
I'm curious, how does setting up that page as XHTML benefit you

"Tim" <ti*@mail.local host.invalid> wrote
It doesn't benefit anyone. XHTML offers nothing as an improvement at this
stage, except more authoring, webserving, and browsing problems.

"me" <anonymous@_.co m> posted:
Then why bother?


Good question. Usually people do it without any real clue about why.

At this stage in the game few browsers support it properly, so it's bad
news to publish pages that are going to get mangled by some browsers even
worse than they're already mangling ordinary HTML. To minimise this,
people serve it out as if it were HTML, hoping that it'll work in more
browsers. As such, it holds no advantages over serving it *as* HTML.

In the future it holds the *potential* for better authored webpages, when
more browsers support it better. *BUT* it looks highly likely that
browsers will be kludged to bits to support badly written XHTML, so that it
doesn't hold any advantage at all. It'll be just the same mess as current
tag-soup HTML parsing.

And even if browsers did manage to use HTML properly, authors do not. Just
ensuring that you've put your li tags properly within your ul tags, and so
on, is only half the task. You've actually got to use HTML elements for
their proper uses so that user-agents can make full use of the information
contained in them. Until people do that, they're still writing gibberish.

--
If you insist on e-mailing me, use the reply-to address (it's real but
temporary). But please reply to the group, like you're supposed to.

This message was sent without a virus, please delete some files yourself.
Jul 23 '05 #30

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
1910
by: Stephen Ferg | last post by:
I use the newsgroup mainly via my Web browser and Google. Over the last few days, when I click on a link to a thread, I've been frequently getting the message "Unable to find thread." Does anybody know what's going on?
13
2375
by: Mario | last post by:
Hello everybody, I am looking for a good script to work a searchprogram for Google .... How can tel me? Not with a logo from google THnx -- -------"""------- ---()--- °?----(_)-----?° | Greetz Mario|
3
4210
by: Alastair | last post by:
Hello guys, I've been building a search facility for an intranet site I'm part of developing and we've been building a search engine using Index Server. It mostly works, however there have been a few niggling problems and fixing it seems to be a case of patching errors as we find them so I'm thinking that it might be worth starting the logic from scratch and rebuilding this again. Basically we have a simple search, which is simply a...
87
5270
by: ziliath | last post by:
I recently tried out the Google "top coder" contest, as a C++ coder. I noticed immediately that they expected me to know STL. To which I say, what the fuck?! I may be missing something, but at what point when learning C++ was I supposed to have picked up STL? I ask because at every job I've had, and every job interview for that matter, whenever STL comes up it's not I, but a manager who says effectively yuck, we don't use that crap.
18
3868
by: smileplzz | last post by:
r there any files which we can download from this group. can we only ask questions in this group? no files stored like it is there in yahoo groups. i think it should be there in group services. ur new group member Ram 20/m/India
3
3363
by: Johann Blake | last post by:
This aticle presents factual evidence that Google's PageRank, inbound links and keywords are irrelevent to your placement in the search results. It presents several case studies that show conclusively that the algorithm used by Google's search engine is flawed with serious "bugs" that deny many websites the high ranking that they should otherwise be granted while granting it to those who shouldn't have it. The article is entitled...
36
1837
by: ern | last post by:
I inherited a huge C application and most of it is in one file. I'd like to modularize it into several different files. Is there a good resource for learning the best way to link C files together... and maybe some good conventions to use? Thanks,
0
1313
by: Andrew_Vodo | last post by:
Hi, I'm developning ASP.Net 2.0 application which will use Google Map. The page with Google Map uses master page. As Google map uses client-side script, the first problem is where do I have to run Google Map creation and population script? I can't run it in master page on load, as this master page is used by another pages, which do not use Google map.
0
9721
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
9600
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
10628
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
1
10374
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
0
10113
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
7651
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6880
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5547
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
3
3011
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.