UTF8 Encoding

[Matt]

I have a problem where I am working with extended character sets in XML but
I have also found that any time I work with a translation or internally
generated Xml document I get the dreaded message, "Data at the root level is
invalid. Line 1 position 1".

If you run the following code there will be extra bytes at the beginning of
the resulting string. I believe this is some type of BigEndian encoding or
something. My question is this, how do I do this and load the result into
the DOM object and keep all character encoding in tact?

Thanks,

Matt

using System;
using System.Xml;
using System.IO;
using System.Text;
class Program
{
static void Main(string[] args)
{
MemoryStream ms = new MemoryStream();
// Create Xml
XmlTextWriter writer = new XmlTextWriter(m s, System.Text.Enc oding.UTF8);
writer.WriteSta rtDocument(true );
writer.WriteSta rtElement("data ", "www.contoso.co m");
writer.WriteEnd Element();
writer.WriteEnd Document();
// Flush Document
writer.Close();
// Get resulting document
string text = Encoding.UTF8.G etString(ms.Get Buffer());
Console.WriteLi ne(text);
// Load resulting Xml Document into DOM
XmlDocument xml = new XmlDocument();
try
{
xml.LoadXml(tex t);
}
catch (Exception ex)
{
Console.WriteLi ne(ex.Message);
}
}
}

[Martin Honnen]

Matt wrote:

MemoryStream ms = new MemoryStream();
// Create Xml
XmlTextWriter writer = new XmlTextWriter(m s, System.Text.Enc oding.UTF8);
writer.WriteSta rtDocument(true );
writer.WriteSta rtElement("data ", "www.contoso.co m");
writer.WriteEnd Element();
writer.WriteEnd Document();
// Flush Document
writer.Close();
// Get resulting document
string text = Encoding.UTF8.G etString(ms.Get Buffer());

Why are you using a stream to write the XML to but then want a string
with XML? If you want a string then write to a StringWriter not a stream.
If you use a stream then simply load the XML from that stream e.g.

MemoryStream ms = new MemoryStream();
// Create Xml
XmlTextWriter writer = new XmlTextWriter(m s,
System.Text.Enc oding.UTF8);
writer.WriteSta rtDocument(true );
writer.WriteSta rtElement("data ", "www.contoso.co m");
writer.WriteEnd Element();
writer.WriteEnd Document();
// Flush Document
writer.Flush();

ms.Position = 0;

XmlDocument xmlDocument = new XmlDocument();
try {
xmlDocument.Loa d(ms);
Console.WriteLi ne("Got\r\n{0}" , xmlDocument.Out erXml);
}
catch (Exception e) {
Console.WriteLi ne(e);
}
finally {
writer.Close();
}


--

Martin Honnen --- MVP XML
http://JavaScript.FAQTs.com/

[Matt]

Martin,

Simple, because a stream does not change extended character sets where strings do. This was a quick way to show the issue I am having with working with foreign characters in a document. If you would like, I can give a style sheet and a document that has German characters and you can translate and see the issues for yourself when using a string.

Matt
"Martin Honnen" <ma*******@yaho o.dewrote in message news:OL******** ******@TK2MSFTN GP03.phx.gbl...
Matt wrote:

MemoryStream ms = new MemoryStream();
// Create Xml
XmlTextWriter writer = new XmlTextWriter(m s, System.Text.Enc oding.UTF8);
writer.WriteSta rtDocument(true );
writer.WriteSta rtElement("data ", "www.contoso.co m");
writer.WriteEnd Element();
writer.WriteEnd Document();
// Flush Document
writer.Close();
// Get resulting document
string text = Encoding.UTF8.G etString(ms.Get Buffer());

Why are you using a stream to write the XML to but then want a string
with XML? If you want a string then write to a StringWriter not a stream.
If you use a stream then simply load the XML from that stream e.g.

MemoryStream ms = new MemoryStream();
// Create Xml
XmlTextWriter writer = new XmlTextWriter(m s,
System.Text.Enc oding.UTF8);
writer.WriteSta rtDocument(true );
writer.WriteSta rtElement("data ", "www.contoso.co m");
writer.WriteEnd Element();
writer.WriteEnd Document();
// Flush Document
writer.Flush();

ms.Position = 0;

XmlDocument xmlDocument = new XmlDocument();
try {
xmlDocument.Loa d(ms);
Console.WriteLi ne("Got\r\n{0}" , xmlDocument.Out erXml);
}
catch (Exception e) {
Console.WriteLi ne(e);
}
finally {
writer.Close();
}


--

Martin Honnen --- MVP XML
http://JavaScript.FAQTs.com/

[Martin Honnen]

Matt wrote:

Simple, because a stream does not change extended character sets where
strings do. This was a quick way to show the issue I am having with
working with foreign characters in a document. If you would like, I can
give a style sheet and a document that has German characters and you can
translate and see the issues for yourself when using a string.

I don't understand the issue, you need to explain what problem you have.

A .NET string is a sequence of Unicode characters so it does not have
any encoding or character set. Unicode has all characters of lots of
scripts/languages around the world so in a .NET string you do not have
any problems to use German umlauts of French accented characters or
Greek letters or Hebrew letters.

And as shown, you can use a stream if you want but then I would suggest
to load back from the stream with a method that takes a stream.

--

Martin Honnen --- MVP XML
http://JavaScript.FAQTs.com/