a question about unicode in python

[hzqij]

i have a python source code test.py

# -*- coding: UTF-8 -*-

# s is a unicode string, include chinese
s = u'ÕÅÈý'

then i run

$ python test.py
UnicodeDecodeError: 'utf8' codec can't decode bytes in position 0-1:
invalid data

by in python interactive, it is right

>>s = u'ÕÅÈý'

why?

[Marc 'BlackJack' Rintsch]

In <11*********************@i13g2000prf.googlegroups. com>, hzqij wrote:

i have a python source code test.py

# -*- coding: UTF-8 -*-

# s is a unicode string, include chinese
s = u'å¼*三'

then i run

$ python test.py
UnicodeDecodeError: 'utf8' codec can't decode bytes in position 0-1:
invalid data

by in python interactive, it is right

>>>s = u'å¼*三'

why?

Does the "coding comment" match the actual encoding of the source file?

Ciao,
Marc 'BlackJack' Rintsch

[WolfgangZ]

hzqij schrieb:

i have a python source code test.py

# -*- coding: UTF-8 -*-

# s is a unicode string, include chinese
s = u'ÕÅÈý'

then i run

$ python test.py
UnicodeDecodeError: 'utf8' codec can't decode bytes in position 0-1:
invalid data

by in python interactive, it is right

>>>s = u'ÕÅÈý'

why?

just an idea: is your text editor really supporting utf-8? In the mail
it is only displayed as '??' which looks for me as the mail editor did
not send the mail as utf. Try to attach a correct text file.

[Evan Klitzke]

On 6/12/07, hzqij <hz*******@gmail.comwrote:

i have a python source code test.py

# -*- coding: UTF-8 -*-

As Marc pointed out, you should test the actual file encoding of the
program to check that it is, in fact, UTF-8 encoded. If you're on a
Unix/Linux system you should be able to test for a UTF-8 encoded file
using the "file" command, e.g.

evan@dhcp-10-10-7-101 ~ $ file ~/uni.py
/home/evan/uni.py: UTF-8 Unicode text

--
Evan Klitzke <ev**@yelp.com>

[kyosohma]

On Jun 12, 12:29 pm, "Evan Klitzke" <[e-mail]:

On 6/12/07, hzqij <[e-mail]:

i have a python source code test.py

# -*- coding: UTF-8 -*-

As Marc pointed out, you should test the actual file encoding of the
program to check that it is, in fact, UTF-8 encoded. If you're on a
Unix/Linux system you should be able to test for a UTF-8 encoded file
using the "file" command, e.g.

evan@dhcp-10-10-7-101 ~ $ file ~/uni.py
/home/evan/uni.py: UTF-8 Unicode text

--
Evan Klitzke <[e-mail]>

If you're using IDLE to edit the source with, you can set IDLE to
encode in utf8 by going to Options, Configure IDLE, General Tab, and
change the Default Source Encoding to utf-8.

Mike

[Andre Engels]

2007/6/12, WolfgangZ <wo****@gmx.net>:

hzqij schrieb:

i have a python source code test.py

# -*- coding: UTF-8 -*-

# s is a unicode string, include chinese
s = u'å¼*三'

then i run

$ python test.py
UnicodeDecodeError: 'utf8' codec can't decode bytes in position 0-1:
invalid data

by in python interactive, it is right

>>s = u'å¼*三'

why?

just an idea: is your text editor really supporting utf-8? In the mail
it is only displayed as '??' which looks for me as the mail editor did
not send the mail as utf. Try to attach a correct text file.

That must be your mail client, not his text editor or mail client. I
do see two Chinese characters in the message.

--
Andre Engels, an*********@gmail.com
ICQ: 6260644 -- Skype: a_engels