473,407 Members | 2,312 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,407 software developers and data experts.

googlebot doesn't enter my website

Hi, not really a html question, but...
I've submitted my URL to Google for indexing.
In the logs of my server, I see that googlebot has requested my /robots.txt
and my /index.html, but it stopped there: there was no request for the
other pages of my site.
(It did so twice: after some time I re-submitted my URL, and googlebot still
retrieved only the first page.)
What did I do wrong? Here is a description of my site:

- I didn't put any <meta robots=...> tag.

- I've put an empty /robots.txt file.

- The structure of my index.html page is:

<html><head><title>title</title></head>
<body>
<a title="click to enter" href="next.html">
<IMG src="pics/pic.jpg" border="0" alt="">
<div class=c>
<div class=d>text</div>
<div class=e>text</div>
</div>
</a>
</body>
</html>
Thanks!

Jul 24 '05 #1
3 2781
noop wrote:
Hi, not really a html question, but...
I've submitted my URL to Google for indexing.
In the logs of my server, I see that googlebot has requested my
/robots.txt and my /index.html, but it stopped there: there was no request
for the other pages of my site.
(It did so twice: after some time I re-submitted my URL, and googlebot
still retrieved only the first page.)
What did I do wrong? Here is a description of my site:

- I didn't put any <meta robots=...> tag.

- I've put an empty /robots.txt file.

- The structure of my index.html page is:

<html><head><title>title</title></head>
<body>
<a title="click to enter" href="next.html">
<IMG src="pics/pic.jpg" border="0" alt="">
<div class=c>
<div class=d>text</div>
<div class=e>text</div>
</div>
</a>
</body>
</html>
Thanks!


How long has your site existed? How many inbound links does it have if any?
Submission without any links is almost futile. It makes your site an
island, which in turn makes Google reluctant to index. How long has this
submission and monitoring been going on? Google might re-visit and go
deeper in subsequent visits.

Better newsgroup to help you: alt.internet.search-engines

Roy

--
Roy S. Schestowitz
http://Schestowitz.com
Jul 24 '05 #2
noop wrote:
<a title="click to enter" href="next.html">
<IMG src="pics/pic.jpg" border="0" alt="">
<div class=c>
<div class=d>text</div>
<div class=e>text</div>
</div>
</a>


This is invalid code. In attempting to recover from it, GoogleBot may have
decided that there was no text inside the element and that the link was
worthless.

Feed GoogleBot (and, for that matter, all other browsers) valid[1],
accessible[2] webpages and you will probably get better results.

[1] http://validator.w3.org/
[2] http://www.w3.org/TR/WCAG10/full-checklist.html
--
David Dorward <http://blog.dorward.me.uk/> <http://dorward.me.uk/>
Home is where the ~/.bashrc is
Jul 24 '05 #3
David Dorward wrote:
noop wrote:
<a title="click to enter" href="next.html">
<IMG src="pics/pic.jpg" border="0" alt="">
<div class=c>
<div class=d>text</div>
<div class=e>text</div>
</div>
</a>


This is invalid code. In attempting to recover from it, GoogleBot may have
decided that there was no text inside the element and that the link was
worthless.


Thank you.
I tried the validators and discovered that <div> are not allowed into an <a>
element.
Jul 24 '05 #4

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

6
by: Bonnie | last post by:
Hi: I'm hoping someone can shed some light on this issue. (I've been digging around everywhere and can't seem to find it by searching): I use the @import statement to attach an external style...
2
by: socialism001 | last post by:
I have a folder that I want googlebot to index but I don't want any other bots to be able to index the files. How would I do this in the ..robots file. Thanks, Chris
149
by: Christopher Benson-Manica | last post by:
(Followups set to comp.std.c. Apologies if the crosspost is unwelcome.) strchr() is to strrchr() as strstr() is to strrstr(), but strrstr() isn't part of the standard. Why not? --...
0
by: John Smith | last post by:
Googlebot has been picking up numerous PHPSESSID name/value pairs in URIs at my website, and this causes duplicate hits and wasted bandwidth. I've since prevented PHPSESSID generation in my PHP...
29
by: CAH | last post by:
Hi Can you avoid that googlebot indexes PHPSESSID pages? Googlebot is indexing pages with PHPSESSID, which makes it think my page has a infinite number of pages. How can one avoid this? ...
5
by: =?Utf-8?B?cGF0cmlja2RyZA==?= | last post by:
Hi everyone! I get some errors lately regarding: HTTP_USER_AGENT Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) and: ...
8
by: Ciaran | last post by:
I have a piece of code that I'd rather google's spider did not follow. Is this possible please?
6
by: ewolfman | last post by:
Hi, Recently we've hired professional SEO services to help up promote our website. They claim that pages which contain ASP.NET's Gridview with paging will not be scanned by the different spiders...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.