utf-8 read/write file

[Bruno]

Hi!

I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(Å*,Ä�,Ž,ÄŒ,Ć).
How can I read/write from/to file in utf-8 encoding?
I read file with fileinput.input.

thanks

[Benjamin]

On Oct 8, 12:49*pm, Bruno <[e-mail]:

Hi!

I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(©,Ð,®,È,Æ).

Can you show us what you have so far?

How can I read/write from/to file in utf-8 encoding?

import codecs
data = codecs.open("my-utf8-file.txt").read()

I read file with fileinput.input.

thanks

[gigs]

Benjamin wrote:

On Oct 8, 12:49 pm, Bruno <[e-mail]:

>Hi!

I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(©,Ð,®,È,Æ).

Can you show us what you have so far?

>How can I read/write from/to file in utf-8 encoding?

import codecs
data = codecs.open("my-utf8-file.txt").read()

>I read file with fileinput.input.

thanks

I have tried with codecs, but when i use encoding="utf-8" i get this error on
word : ¾ivot

Traceback (most recent call last):
File "C:\Users\Administrator\Desktop\getcontent.py" , line 43, in <module>
encoding="utf-8").readlines()
File "C:\Python25\Lib\codecs.py", line 626, in readlines
return self.reader.readlines(sizehint)
File "C:\Python25\Lib\codecs.py", line 535, in readlines
data = self.read()
File "C:\Python25\Lib\codecs.py", line 424, in read
newchars, decodedbytes = self.decode(data, self.errors)
UnicodeDecodeError: 'utf8' codec can't decode byte 0x9e in position 0:
unexpected code byte
i just need to read from file1.txt, process (its simple text processing) some
words and write them to file2.txt without loss of croatian characters. (¹ð¾èæ)

[Kent Johnson]

On Oct 8, 5:55*pm, gigs <[e-mail]:

Benjamin wrote:

On Oct 8, 12:49 pm, Bruno <[e-mail]:

Hi!

I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(©,Ð,®,È,Æ).

UnicodeDecodeError: 'utf8' codec can't decode byte 0x9e in position 0:
unexpected code byte

Are you sure you have UTF-8 data? I guess your file is encoded in
CP1250 or CP1252; in both of these charsets 0x9e represents LATIN
SMALL LETTER Z WITH CARON.

Kent

[gigs]

Kent Johnson wrote:

On Oct 8, 5:55 pm, gigs <[e-mail]:

>Benjamin wrote:

>>On Oct 8, 12:49 pm, Bruno <[e-mail]:
Hi!
I have big .txt file which i want to read, process and write to another .txt file.
I have done script for that, but im having problem with croatian characters
(©,Ð,®,È,Æ).

UnicodeDecodeError: 'utf8' codec can't decode byte 0x9e in position 0:
unexpected code byte

Are you sure you have UTF-8 data? I guess your file is encoded in
CP1250 or CP1252; in both of these charsets 0x9e represents LATIN
SMALL LETTER Z WITH CARON.

Kent

This data wasnt in utf-8 probably, today i get another one utf-8 and its working

thanks