I hava an ajax web application where i hvae problems with UTF-8 encoding oc
chineese chars.
My Ajax webapplication runs in a HTML page that is UTF-8 Encoded.
I copy and paste some chineese chars from another HTML page viewed in IE7,
that is also UTF-8 encoded (search for "china" on google.com). I paste the
chineese chars into a content editable div.
My Ajax webservice compiles an XML where the data from the content editable
div is placed in a CDATA section and sends it to a webservice on the server.
I read the content editable div using .innerHTML. I call the webservice
using
XMLHttpRequest in the following way:
-----
req.open("POST" , strUrl, true);
req.setRequestH eader("Content-Type", "applicatio n/x-www-form-urlencoded;
charset=UTF-8");
var strSend = "";
for(var i=0; i<aParameters.l ength; i+=2)
{
if(strSend.leng th!=0) strSend += "&";
strSend += aParameters[i] + "=" + encodeURICompon ent(aParameters[i+1]);
}
req.send(strSen d);
-----
where req is the XMLHttpRequest object. and aParameteres is an array that
contians: parameterName, parameterValue, parameterName, parameterValue, ...
Before I send the XML I write it to screen and here the chineese chars are
displayed correctly.
On the server i use DotNet 2.0. The XML is transformed to SQL in a CDATA
section, that is read and executed against a MSSQL 2000 database, where the
string with the chineese chars is stored in a text column.
When I load the data again in my Ajax webapplication a webservice is called
that returns the string in an XML in a CDATA section, the data is read from
the database using a DataReader.
When the text loaded is displayed the chineese chars have turned into
questionmarks.
I've tried to change the column in the database to a image and use a
byte-array to fetch the data from the database. that didn't work, so I
changed it back.
I've added the following to my web.config:
-----
<globalizatio n
requestEncoding ="utf-8"
responseEncodin g="utf-8"
fileEncoding="u tf-8"
/>
-----
I've changed my ToXml method on my object to the following:
-----
// Define the desired encoding of the output
System.Text.Enc oding encodingOfXmlOu tput = System.Text.Enc oding.UTF8;
// Create MemoryStream to recieve our bytes
using (System.IO.Memo ryStream memoryStream = new System.IO.Memor yStream())
{
// Create XmlTextWriter using our created memoryStream and
encodingOfXmlOu tput
using (System.Xml.Xml TextWriter xmlWriter = new
System.Xml.XmlT extWriter(memor yStream, encodingOfXmlOu tput))
{
// Set formatting options for XmlTextWriter
xmlWriter.Forma tting = System.Xml.Form atting.None; // Output should not be
indented
//Write XML
xmlWriter.Write StartElement("Q uestion");
xmlWriter.Write StartElement("Q uestionText");
xmlWriter.Write CData(this.Text );
xmlWriter.Write EndElement(); //QuestionText
xmlWriter.Write EndElement(); //Question
// Force all bytes into memoryStream
xmlWriter.Flush ();
// Create buffer to recieve bytes from memoryStream
// Some encodings like UTF-8 contains a preamble (bytes to identify the
encoding)
// having this preamble in our output will invalidate our output, so we wont
be grapping that.
byte[] buffer = new byte[memoryStream.Le ngth -
encodingOfXmlOu tput.GetPreambl e().Length];
// Position cursor correct in memoryStream (which is after the preamble
memoryStream.Po sition = encodingOfXmlOu tput.GetPreambl e().Length;
// Fill data from current position of memoryStream into buffer
memoryStream.Re ad(buffer, 0, buffer.Length);
// Return string of the created Xml
return encodingOfXmlOu tput.GetString( buffer);
}
}
-----
Still the same problem.
When I transform the xml to sql I use the following function:
-----
public static string Transform(XslCo mpiledTransform compiledTransfo rm,
IXPathNavigable document)
{
if (compiledTransf orm == null) throw new
ArgumentNullExc eption("compile dTransform");
using (StringWriter writer = new StringWriter())
{
string strResult = string.Empty;
compiledTransfo rm.Transform(do cument, null, writer);
strResult = writer.ToString ();
return strResult;
}
}
-----
The XSLT has the following encoding
-----
<?xml version="1.0" encoding="UTF-8"?>
-----
So my question is the following: Where does my encoding screw up? How come I
can't save and load chineese chars correctly?
Any pointers would be greatly appreciated.
I don't know what other UTF-8 chars don't work correctly, but the danish
chars I initially had problems with (æøå) work correctly, I would like my
solution to work with any UTF-8 chars.
Kind Regards,
Allan Ebdrup
