473,714 Members | 2,111 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

utf-8 and xhtml 1.0 strict

My web site has not been spidered by Googlebot since April 2003. The site in
question is at www.TheBicyclingGuitarist.net/ I received much help from this
NG and the stylesheets NG when updating the code before then.

My host's tech guy just sent me the following. Isn't it okay to specify
UTF-8 as the charset in the HTTP headers at the server level? Isn't it okay
to have validated XHTML 1.0 strict code?

*************** *************** *************** *************** *

If it was an misconfiguratio n with IIS the problem would be presenting
itself for every site that is hosted on that server under that instance of
IIS which isn't the case here. I have only been able to find two
differences between your site which Google isn't updated, and the sites that
are.

1) You have a custom charset also specified in the HTTP headers at the
server level
2) You are using XHTML strict.

I am curious why you chose XHTML strict rather than traditional? Here's a
quote from broadbandreport s.com with the full link at
http://www.broadbandreports.com/faq/...ebmonks?text=1

"If you are using XHTML you should strive to make your pages validate as
XHTML 1.0 Transitional. The XHTML 1.0 Strict standard is a bit too confining
for real world web sites."

My suggestion is still that you talk to Google to find out why their bot
both is getting a 406 error, and why it isn't updating the content it isn't
getting an error on. If you would like I would be happy to reset the HTTP
headers to the default setting so your site identically matches every other
site hosted on this server as far as IIS goes.

----- Original Message -----
From: Chris Watson
To: XXXXXXXXXXXXX
Sent: Tuesday, October 26, 2004 5:16 PM
Subject: RE: Jesse, you really need to see this.
I posted the information from your last two emails in one message at a
search engines newsgroup. What about this guy's answer? It's short and
sweet.

The Bicycling Guitarist wrote:
The following are two messages from the tech guy at my host concerning my
problems with Googlebot or vice versa.


The problem seems to be with your IIS configuration. Google sends
Accept: text/html,text/plain; which of course makes good sense for a
robot as it doesn't want anything else. Your IIS appears to be
incorrectly configured to send a 406 not acceptable message when it sees
this.

If you accept text/* you get your page. It doesn't seem to be linked to
the charset.
Jul 23 '05 #1
35 4624
On Thu, 28 Oct 2004 06:26:27 GMT, The Bicycling Guitarist
<Ch***@TheBicyc lingGuitarist.n et> wrote:
My web site has not been spidered by Googlebot since April 2003. The
site in
question is at www.TheBicyclingGuitarist.net/ I received much help from
this
NG and the stylesheets NG when updating the code before then.

My host's tech guy just sent me the following. Isn't it okay to specify
UTF-8 as the charset in the HTTP headers at the server level? Isn't it
okay
to have validated XHTML 1.0 strict code?


I replied in alt.html - yep, UTF-8 and XHTML (served as text/html) has put
my site at PR4 and is on top for my keywords. The problem must lie
elsewhere.
Jul 23 '05 #2
On Thu, 28 Oct 2004, The Bicycling Guitarist wrote:
My web site has not been spidered by Googlebot since April 2003.

My host's tech guy just sent me the following. Isn't it okay to specify
UTF-8 as the charset in the HTTP headers at the server level?
It certainly is.
<http://google.com/search?q=www.un ics.uni-hannover.de/nhtcapri/multilingual1.h tml>
Isn't it okay
to have validated XHTML 1.0 strict code?
I think it's okay. But why are you writing XHTML 1.0 instead of HTML 4.01?
Is there any good reason or is it just "kewl"?
2) You are using XHTML strict.
I am curious why you chose XHTML strict rather than traditional?

"If you are using XHTML you should strive to make your pages validate as
XHTML 1.0 Transitional. The XHTML 1.0 Strict standard is a bit too confining
for real world web sites."


This is absurd because any document that validates as [X]HTML Strict also
validates as [X]HTML Transitional. This person is clueless.

I have no indication that Google struggles with XHTML - but what's your
reason to write XHTML 1.0 rather than HTML 4.01 Strict?

--
Top-posting.
What's the most irritating thing on Usenet?

Jul 23 '05 #3

"Andreas Prilop" <nh******@rrz n-user.uni-hannover.de> wrote in message
news:Pine.GSO.4 .44.04102814391 80.12878-100000@s5b003.. .
On Thu, 28 Oct 2004, The Bicycling Guitarist wrote:
My web site has not been spidered by Googlebot since April 2003.

My host's tech guy just sent me the following. Isn't it >> 2) You are
using XHTML strict.
I am curious why you chose XHTML strict rather than traditional?

"If you are using XHTML you should strive to make your pages validate as
XHTML 1.0 Transitional. The XHTML 1.0 Strict standard is a bit too
confining
for real world web sites."
This is absurd because any document that validates as [X]HTML Strict also
validates as [X]HTML Transitional. This person is clueless.


I will point this out to him.

I have no indication that Google struggles with XHTML - but what's your
reason to write XHTML 1.0 rather than HTML 4.01 Strict?


For Duty and Humanity! I wish to make my pages more available to different
user-agents as they develop, and to make it easier to convert to xml in the
future.

If the tech really is clueless, then perhaps he hasn't configured the server
correctly even if he thinks he has. Can this be tested by somebody other
than him?

Chris Watson
www.TheBicyclingGuitarist.net/

..
Jul 23 '05 #4
On Thu, 28 Oct 2004, The Bicycling Guitarist wrote:
My host's tech guy just sent me the following.
Sounds to me like "grasp as any conceivable excuse and see if
the customer is clueless enough to swallow it".
Isn't it okay to specify UTF-8 as the charset in the HTTP headers at
the server level?
Not only is it "OK", but it's also strongly recommended.
Isn't it okay to have validated XHTML 1.0 strict code?
Only a super-purist (i.e me on a bad day) would complain that Appendix
C is hostile to the very intentions of XML. However, a more practical
person might counsel you to carry on using HTML/4.01 (by all means
"strict") until you're ready to go for the full XHTML+XML stuff. Or
rather, until the rest of the world is ready for you ;-))
If it was an misconfiguratio n with IIS
Oh, blimey. Is -that- the server they're using....
the problem would be presenting itself for every site that is hosted
on that server under that instance of IIS which isn't the case here.
The chap's plausible, at least... but is it technically well
founded?...
1) You have a custom charset also specified in the HTTP headers at the
server level
I wouldn't exactly refer to utf-8 as "custom" !!!
2) You are using XHTML strict.

I am curious why you chose XHTML strict rather than traditional?
I'm confident that this issue is irrelevant to your original question.
Here's a
quote from broadbandreport s.com [...]

"If you are using XHTML you should strive to make your pages validate as
XHTML 1.0 Transitional. The XHTML 1.0 Strict standard is a bit too confining
for real world web sites."
I would take the opposite point of view. If starting from HTML4.*
transitional, my first priority would be to head in the direction of
"strict" (with CSS for presentation), than to worry for the moment
about XHTML as such.

As far as I'm concerned, XHTML/1.0 "transition al" is merely a formal
rewriting into XML notation of an HTML/4.01 specification that was
already obsolescent at the time, and is surely inappropriate now for
new developments.
My suggestion is still that you talk to Google to find out why their
bot both is getting a 406 error,
Uh-uh, now we're getting to the -real- problem. Let's see this on the
lab bench:

$ telnet www.thebicyclingguitarist.net 80
Trying 216.229.101.149 ...
Connected to www.thebicyclingguitarist.net.
Escape character is '^]'.
GET / HTTP/1.0
Host: www.thebicyclingguitarist.net
Accept: text/html,text/plain

HTTP/1.1 406 No acceptable objects were found
Server: Microsoft-IIS/5.0
Date: Thu, 28 Oct 2004 13:51:57 GMT
Content-Length: 3906
Content-Type: text/html

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<html dir=ltr>

[...and so on, yeuch...]
Once more with feeling:

$ telnet www.thebicyclingguitarist.net 80
Trying 216.229.101.149 ...
Connected to www.thebicyclingguitarist.net.
Escape character is '^]'.
GET / HTTP/1.0
Host: www.thebicyclingguitarist.net
Accept: text/html

HTTP/1.1 406 No acceptable objects were found
Server: Microsoft-IIS/5.0
Date: Thu, 28 Oct 2004 13:53:59 GMT

[...bleagh...]
You need to concentrate on why content-type negotiation is failing.

<prejudice type="Halloween Papers">If it was me, my first priority
would be to migrate to an Apache server.</>
If you would like I would be happy to reset the HTTP headers to the
default setting so your site identically matches every other site
hosted on this server as far as IIS goes.


Pffffffffffffff t.

This server is demonstrating its inability to implement content-type
negotiation correctly. As such, it's unfit for use on the WWW in this
state.

That's my best offer based on the evidence presented and the results
as far as I can see them.
Jul 23 '05 #5
Once upon a time *The Bicycling Guitarist* wrote:
"Andreas Prilop" <nh******@rrz n-user.uni-hannover.de> wrote in message
news:Pine.GSO.4 .44.04102814391 80.12878-100000@s5b003.. .
On Thu, 28 Oct 2004, The Bicycling Guitarist wrote:
My web site has not been spidered by Googlebot since April 2003.

My host's tech guy just sent me the following. Isn't it >> 2) You are
using XHTML strict.
I am curious why you chose XHTML strict rather than traditional?

"If you are using XHTML you should strive to make your pages validate as
XHTML 1.0 Transitional. The XHTML 1.0 Strict standard is a bit too
confining
for real world web sites."


This is absurd because any document that validates as [X]HTML Strict also
validates as [X]HTML Transitional. This person is clueless.


I will point this out to him.


I have small site in XHTML 1.1 and UTF-8 and I have no problem with
Google. So, your host's tech guy don't know what his talking about!

I have no indication that Google struggles with XHTML - but what's your
reason to write XHTML 1.0 rather than HTML 4.01 Strict?


For Duty and Humanity! I wish to make my pages more available to different
user-agents as they develop, and to make it easier to convert to xml in the
future.


I you want to use XHTML, why not go strait to XHTML 1.1 if you don't
need the transitional in 1.0 It's no big difference moving from 1.0
Strict to 1.1

In my opinion the transitional doctype should not be used in others than
frameset build sites, no matter if its XHTML 1.0 or HTML 4. The
"frameset" doctype must be used for the file containing the frameset,
and the transitional for other pages within the site makes the use of
the "target" attribut valid. But if you don't use frameset, you can go
to XHTML 1.1 directly

--
/Arne
http://w1.978.telia.com/~u97802964/
Jul 23 '05 #6
On Thu, 28 Oct 2004 14:53:30 GMT, Invalid User <us**@domain.in valid> wrote:
I have small site in XHTML 1.1 and UTF-8 and I have no problem with
Google. So, your host's tech guy don't know what his talking about!


But how do you get IE to handle it?

Or are you serving 1.1 as text/html ? Oh dear.

Steve

Jul 23 '05 #7
Invalid User <us**@domain.in valid> writes:
Once upon a time *The Bicycling Guitarist* wrote:
"Andreas Prilop" <nh******@rrz n-user.uni-hannover.de> wrote in message
I have no indication that Google struggles with XHTML - but what's your
reason to write XHTML 1.0 rather than HTML 4.01 Strict?
For Duty and Humanity! I wish to make my pages more available to
different user-agents as they develop, and to make it easier to
convert to xml in the future.


Write XHTML and use tidy or similar to convert it to HTML before
serving? At the moment there are more user agents that support HTML
than there are that support XHTML, and I don't know of any that only
support XHTML (given that most pages don't validate to any doctype,
any that do exist are probably confined to the lab).

XHTML also has problems with incremental rendering.

Oh, and all those /s in XHTML add to the filesize. ;)
I you want to use XHTML, why not go strait to XHTML 1.1 if you don't
need the transitional in 1.0 It's no big difference moving from 1.0
Strict to 1.1


The Appendix C fix isn't allowed with XHTML 1.1, so you either serve
it against the specifications (and why go to something as obscure as
XHTML 1.1 if not to follow the specifications) , or you accept that
Internet Explorer users won't be able to view it.

--
Chris
Jul 23 '05 #8
The Bicycling Guitarist wrote:
My web site has not been spidered by Googlebot since April 2003. The site in
question is at www.TheBicyclingGuitarist.net/ I received much help from this
NG and the stylesheets NG when updating the code before then.


Seems to be sending the incorrect MIME type "text/*" instead of text/html:
[leif@localhost leif]$ telnet TheBicyclingGui tarist.net 80
Trying 216.229.101.149 ...
Connected to TheBicyclingGui tarist.net (216.229.101.14 9).
Escape character is '^]'.
GET / HTTP/1.1
Host: TheBicyclingGui tarist.net

HTTP/1.1 200 OK
Server: Microsoft-IIS/5.0
Content-Location: http://TheBicyclingGuitarist.net/index.htm
Date: Thu, 28 Oct 2004 18:24:11 GMT
Content-Type: text/*;charset=utf-8
Accept-Ranges: bytes
Last-Modified: Wed, 27 Oct 2004 19:48:04 GMT
ETag: "fab99adf5dbcc4 1:9f9"
Content-Length: 5169

<snip>
Jul 23 '05 #9
Once upon a time *Steve Pugh* wrote:
On Thu, 28 Oct 2004 14:53:30 GMT, Invalid User <us**@domain.in valid> wrote:
I have small site in XHTML 1.1 and UTF-8 and I have no problem with
Google. So, your host's tech guy don't know what his talking about!


But how do you get IE to handle it?

Or are you serving 1.1 as text/html ? Oh dear.


Yes, I have to if I want the IE users to have access to it.
What do you mean with "Oh dear"? Nothing wrong with text/html since it's
valid to do so, andf even recommended by W3C. However, it's just a small
personal "play ground" for testing purposes.

But basically, why use HTML 4.01 Strict, when XHTML is available. The
difference is not that big, but XHTML is more prepared for the future.
Therefore more XHTML coded sites is published almost every day now.

--
/Arne
http://w1.978.telia.com/~u97802964/
Jul 23 '05 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

9
4184
by: lawrence | last post by:
Someone on www.php.net suggested using a seems_utf8() method to test text for UTF-8 character encoding but didn't specify how to write such a method. Can anyone suggest a test that might work? Something that maybe gives 90% confidence that a given block of text is or is not UTF-8 encoded?
4
6396
by: Alban Hertroys | last post by:
Another python/psycopg question, for which the solution is probably quite simple; I just don't know where to look. I have a query that inserts data originating from an utf-8 encoded XML file. And guess what, it contains utf-8 encoded characters... Now my problem is that psycopg will only accept queries of type str, so how do I get my utf-8 encoded data into the DB? I can't do query.encode('ascii'), that would be similar to: >>> x =...
12
8227
by: Mike Dee | last post by:
A very very basic UTF-8 question that's driving me nuts: If I have this in the beginning of my Python script in Linux: #!/usr/bin/env python # -*- coding: UTF-8 -*- should I - or should I not - be able to use non-ASCII characters in strings and in Tk GUI button labels and GUI window titles and in raw_input data without Python returning wrong case in manipulated
38
5737
by: Haines Brown | last post by:
I'm having trouble finding the character entity for the French abbreviation for "number" (capital N followed by a small supercript o, period). My references are not listing it. Where would I find an answer to this question (don't find it in the W3C_char_entities document). -- Haines Brown brownh@hartford-hwp.com
6
18758
by: jmgonet | last post by:
Hello everybody, I'm having troubles loading a Xml string encoded in UTF-8. If I try this code: ------------------------------ XmlDocument doc=new XmlDocument(); String s="<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"yes\"?><a>Schönbühl</a>"; doc.LoadXml(s); doc.Save("d:\\temp\\test.xml");
6
13890
by: archana | last post by:
Hi all, can someone tell me difference between unicode and utf 8 or utf 18 and which one is supporting more character set. whic i should use to support character ucs-2. I want to use ucs-2 character in streamreader and streamwriter. How unicode and utf chacters are stored.
7
12145
by: Jimmy Shaw | last post by:
Hi everybody, Is there any SIMPLE way to convert from UTF-16 to UTF-32? I may be mixed up, but is it possible that all UTF-16 "code points" that are 16 bits long appear just the same in UTF-32, but with zero padding and hence no real conversion is necessary? If I am completely wrong and some intricate conversion operation needs to take place, can anyone give me some primer on the subject?
1
7288
by: sheldon.regular | last post by:
I am new to unicode so please bear with my stupidity. I am doing the following in a Python IDE called Wing with Python 23. äöü äöü '\xc3\xa4\xc3\xb6\xc3\xbc' u'\xe4\xf6\xfc' u'\xe4\xf6\xfc' äöü
10
19565
by: Jed | last post by:
I have a form that needs to handle international characters withing the UTF-8 character set. I have tried all the recommended strategies for getting utf-8 characters from form input to email message and I cannot get it to work. I need to stay with classic asp for this. Here are some things I tried: 'CDONTS Call msg.SetLocaleIDs(65001)
23
5019
by: Allan Ebdrup | last post by:
I hava an ajax web application where i hvae problems with UTF-8 encoding oc chineese chars. My Ajax webapplication runs in a HTML page that is UTF-8 Encoded. I copy and paste some chineese chars from another HTML page viewed in IE7, that is also UTF-8 encoded (search for "china" on google.com). I paste the chineese chars into a content editable div. My Ajax webservice compiles an XML where the data from the content editable div is...
0
8815
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, well explore What is ONU, What Is Router, ONU & Routers main usage, and What is the difference between ONU and Router. Lets take a closer look ! Part I. Meaning of...
0
8713
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
9318
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
9033
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
7960
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development projectplanning, coding, testing, and deploymentwithout human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
0
5961
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
4467
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
4730
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
2529
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.