How to read a text file with wchar?

[Kueishiong Tu]

I have a text file with wide characters. I use the following C++ code to read
them in. However the wide characters are read in properly. What is wrong?

String* path = "C:\\Documents and Settings\\kst\\BE.dat";

try
{
FileStream* fs = new FileStream(path, FileMode::Open);
StreamReader* sr = new StreamReader(fs);

int count = 0;
while (sr->Peek() >= 0)
{
count++;
Debug::Write(__box(count));
Debug::WriteLine(__box((Char)sr->Read()), " ");
}
}

[Kueishiong Tu]

"are read in properly" should be "are not read in properly" in the following
description.

"Kueishiong Tu" wrote:

I have a text file with wide characters. I use the following C++ code to read
them in. However the wide characters are read in properly. What is wrong?

String* path = "C:\\Documents and Settings\\kst\\BE.dat";

try
{
FileStream* fs = new FileStream(path, FileMode::Open);
StreamReader* sr = new StreamReader(fs);

int count = 0;
while (sr->Peek() >= 0)
{
count++;
Debug::Write(__box(count));
Debug::WriteLine(__box((Char)sr->Read()), " ");
}
}

[Jon Skeet [C# MVP]]

Kueishiong Tu <Ku**********@discussions.microsoft.com> wrote:

I have a text file with wide characters. I use the following C++ code to read
them in. However the wide characters are read in properly. What is wrong?

String* path = "C:\\Documents and Settings\\kst\\BE.dat";

try
{
FileStream* fs = new FileStream(path, FileMode::Open);
StreamReader* sr = new StreamReader(fs);

int count = 0;
while (sr->Peek() >= 0)
{
count++;
Debug::Write(__box(count));
Debug::WriteLine(__box((Char)sr->Read()), " ");
}
}

Well, what encoding is used for the text file? The default for
StreamReader is UTF-8. If that isn't the encoding used for your file,
you'll get the wrong characters. You really need to know what the
encoding is.

See http://www.pobox.com/~skeet/csharp/unicode.html for more
information.

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet Blog: http://www.msmvps.com/jon.skeet
If replying to the group, please do not mail me too

[Kueishiong Tu]

Thank you for replying.
It is a text file contains both Ascii (one byte) and Chinese characters (two
bytes) coded in big-5. How do I find the encoding of a text file?

"Jon Skeet [C# MVP]" wrote:

Kueishiong Tu <Ku**********@discussions.microsoft.com> wrote:

I have a text file with wide characters. I use the following C++ code to read
them in. However the wide characters are read in properly. What is wrong?

String* path = "C:\\Documents and Settings\\kst\\BE.dat";

try
{
FileStream* fs = new FileStream(path, FileMode::Open);
StreamReader* sr = new StreamReader(fs);

int count = 0;
while (sr->Peek() >= 0)
{
count++;
Debug::Write(__box(count));
Debug::WriteLine(__box((Char)sr->Read()), " ");
}
}

Well, what encoding is used for the text file? The default for
StreamReader is UTF-8. If that isn't the encoding used for your file,
you'll get the wrong characters. You really need to know what the
encoding is.

See http://www.pobox.com/~skeet/csharp/unicode.html for more
information.

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet Blog: http://www.msmvps.com/jon.skeet
If replying to the group, please do not mail me too

[Jon Skeet [C# MVP]]

Kueishiong Tu <Ku**********@discussions.microsoft.com> wrote:

Thank you for replying.
It is a text file contains both Ascii (one byte) and Chinese characters (two
bytes) coded in big-5. How do I find the encoding of a text file?

You need to know the encoding - a text file is just a bunch of bytes,
the same as any other file. It's the interpretation which matters.

That sounds like it's just a Big-5 file though - as far as I can see,
ASCII characters come out the same in Big-5.

Big-5 is Windows codepage 950, I believe, so use
Encoding.GetEncoding(950).

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet Blog: http://www.msmvps.com/jon.skeet
If replying to the group, please do not mail me too

[Cor Ligthert [MVP]]

Kueishiong,

Only in addition to Jon's answers

Unicode
http://www.geocities.com/Athens/Acad.../fontset.htm#b

OS systems
http://www.microsoft.com/globaldev/r...ocversion.mspx

I hope this helps a little bit?

Cor

[Kueishiong Tu]

Thank you very much for your help.

Kueishiong Tu

"Cor Ligthert [MVP]" wrote:

Kueishiong,

Only in addition to Jon's answers

Unicode
http://www.geocities.com/Athens/Acad.../fontset.htm#b

OS systems
http://www.microsoft.com/globaldev/r...ocversion.mspx

I hope this helps a little bit?

Cor

[Kueishiong Tu]

Thank you very much for your help.
I try Encoding.GetEncoding("big5") and it works.

Kueishiong Tu
"Jon Skeet [C# MVP]" wrote:

Kueishiong Tu <Ku**********@discussions.microsoft.com> wrote:

Thank you for replying.
It is a text file contains both Ascii (one byte) and Chinese characters (two
bytes) coded in big-5. How do I find the encoding of a text file?

You need to know the encoding - a text file is just a bunch of bytes,
the same as any other file. It's the interpretation which matters.

That sounds like it's just a Big-5 file though - as far as I can see,
ASCII characters come out the same in Big-5.

Big-5 is Windows codepage 950, I believe, so use
Encoding.GetEncoding(950).

--
Jon Skeet - <sk***@pobox.com>
http://www.pobox.com/~skeet Blog: http://www.msmvps.com/jon.skeet
If replying to the group, please do not mail me too