string conversion latin2 to ascii

[Martin Landa]

Hi all,

sorry for a newbie question. I have unicode string (or better say
latin2 encoding) containing non-ascii characters, e.g.

s = "Ukázka_možnost i_využití_progr amu_OpenJUMP_v_ SOA"

I would like to convert this string to plain ascii (using some lookup
table for latin2)

to get

-Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA

Thanks for any hits! Regards, Martin Landa

[kyosohma]

On Nov 27, 3:35 pm, Martin Landa <landa.mar...@g mail.comwrote:

Hi all,

sorry for a newbie question. I have unicode string (or better say
latin2 encoding) containing non-ascii characters, e.g.

s = "Ukázka_možnost i_využití_progr amu_OpenJUMP_v_ SOA"

I would like to convert this string to plain ascii (using some lookup
table for latin2)

to get

-Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA

Thanks for any hits! Regards, Martin Landa

With a little googling, I found this:

http://www.peterbe.com/plog/unicode-to-ascii

You might also find this article useful:

http://www.reportlab.com/i18n/python..._tutorial.html

Mike

[=?UTF-8?B?Ik1hcnRpbiB2LiBMw7Z3aXMi?=]

sorry for a newbie question. I have unicode string (or better say

latin2 encoding) containing non-ascii characters, e.g.

s = "Ukázka_možno sti_využitÃ*_p rogramu_OpenJUM P_v_SOA"

That's not a Unicode string (at least in Python 2); it is
a latin-2 encoded byte string; it has nothing to do with Unicode.

I would like to convert this string to plain ascii (using some lookup
table for latin2)

to get

-Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA

I recommend to use string.translat e. You need a translation
table there, which is best generated with string.maketran s.

table=string.ma ketrans("ážÃ* ","azi")
print s.translate(tab le)

HTH,
Martin

[John Machin]

On Nov 28, 8:45 am, kyoso...@gmail. com wrote:

On Nov 27, 3:35 pm, Martin Landa <landa.mar...@g mail.comwrote:

Hi all,

sorry for a newbie question. I have unicode string (or better say
latin2 encoding) containing non-ascii characters, e.g.

s = "Ukázka_možnost i_využití_progr amu_OpenJUMP_v_ SOA"

I would like to convert this string to plain ascii (using some lookup
table for latin2)

to get

-Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA

Thanks for any hits! Regards, Martin Landa

With a little googling, I found this:

http://www.peterbe.com/plog/unicode-to-ascii

and if the OP has the patience to read *ALL* the comments on that blog
entry, he will find that comment[-2] points to

http://effbot.python-hosting.com/fil...xt/unaccent.py

and comment[-1] (from the blog owner) is "Brilliant! Thank you."

The bottom line is that there is no universal easy solution; you need
to handcraft a translation table suited to your particular purpose
(e.g. do you want u-with-umlaut to become u or ue?). The
unicodedata.nor malize function is useful for off-line preparation of a
set of candidate mappings for that table; it should not be applied
either on-line or blindly.

Cheers,
John

[Jakub Wilk]

* Martin Landa <la**********@g mail.com>, 2007-11-27:

I have unicode string (or better say latin2 encoding) containing
non-ascii characters, e.g.

s = "Ukázka_možnost i_využití_progr amu_OpenJUMP_v_ SOA"

I would like to convert this string to plain ascii (using some lookup
table for latin2)

to get

-Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA

You may try python-elinks
<http://freshmeat.net/projects/python-elinks/>:

>>import elinks
print "Ukázka_mo\236n osti_vyu\236ití _programu_OpenJ UMP_v_SOA".deco de('Windows-1250').encode(' ASCII', 'elinks')

Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA
--
Jakub Wilk

[kyosohma]

On Nov 27, 5:08 pm, John Machin <sjmac...@lexic on.netwrote:

On Nov 28, 8:45 am, kyoso...@gmail. com wrote:

On Nov 27, 3:35 pm, Martin Landa <landa.mar...@g mail.comwrote:

Hi all,

sorry for a newbie question. I have unicode string (or better say
latin2 encoding) containing non-ascii characters, e.g.

s = "Ukázka_možnost i_využití_progr amu_OpenJUMP_v_ SOA"

I would like to convert this string to plain ascii (using some lookup
table for latin2)

to get

-Ukazka_moznosti _vyuziti_progra mu_OpenJUMP_v_S OA

Thanks for any hits! Regards, Martin Landa

With a little googling, I found this:

http://www.peterbe.com/plog/unicode-to-ascii

and if the OP has the patience to read *ALL* the comments on that blog
entry, he will find that comment[-2] points to

http://effbot.python-hosting.com/fil...xt/unaccent.py

and comment[-1] (from the blog owner) is "Brilliant! Thank you."

The bottom line is that there is no universal easy solution; you need
to handcraft a translation table suited to your particular purpose
(e.g. do you want u-with-umlaut to become u or ue?). The
unicodedata.nor malize function is useful for off-line preparation of a
set of candidate mappings for that table; it should not be applied
either on-line or blindly.

Cheers,
John

Sorry...I didn't know about translation tables or I would have
mentioned that instead. My bad.

Mike