Is there a string function to trim all non-ascii characters out of astring

[silverburgh.meryl]

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

Thank you.

[Dan Bishop]

On Dec 31, 2:20 am, "[e-mail]"
<[e-mail]:

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

Thank you.

def ascii_chars(string):
return ''.join(char for char in string if ord(char) < 128)

[abhishek]

On Dec 31, 1:20*pm, "[e-mail]"
<[e-mail]:

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

Thank you.

Use this function --

def omitNonAscii(nstr):
sstr=''
for r in nstr:
if ord(r)<127:
sstr+=r
return sstr

[John Machin]

On Dec 31, 7:20 pm, "[e-mail]"
<[e-mail]:

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

[John Machin]

On Dec 31, 7:20 pm, "[e-mail]"
<[e-mail]:

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

OK, I'll bite: why do you want to throw data away?

[Paul McGuire]

On Dec 31, 2:54*am, abhishek <[e-mail]:

>
Use this function --

def omitNonAscii(nstr):
* * sstr=''
* * for r in nstr:
* * * * if ord(r)<127:
* * * * * * sstr+=r
* * return sstr

<Yoda>
Learn the ways of the generator expression you must.
</Yoda>
See Dan Bishop's post.

-- Paul

[Duncan Booth]

"si***************@gmail.com" <si***************@gmail.comwrote:

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

Thank you.

Yes, just decode it to unicode (which you should do as the first thing for
any encoded strings) and then encode it back to ascii with error handling
set how you want:

>>s = '\xc2\xa342'
s.decode('utf8').encode('ascii', 'replace')

'?42'

>>s.decode('utf8').encode('ascii', 'ignore')

'42'

>>s.decode('utf8').encode('ascii', 'xmlcharrefreplace')

'£42'

[Steven D'Aprano]

On Mon, 31 Dec 2007 01:09:09 -0800, John Machin wrote:

On Dec 31, 7:20 pm, "[e-mail]"
<[e-mail]:

>Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

OK, I'll bite: why do you want to throw data away?

Maybe he has to send the data to a device that can't deal with more than
7-bit ASCII.

Maybe he's sick of seeing text with "missing character" squares all over
from all the characters that his fonts can't display.

Maybe the string ends up as a file name on an operating system that
doesn't support unicode.

Or maybe he's just a curmudgeon who thinks life was better when there
were only 128 characters available.
--
Steven

[John Machin]

On Dec 31, 7:20 pm, "[e-mail]"
<[e-mail]:

Hi,

Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

You actually asked TWO different questions, and have got answers
mainly to the first one. Here's a very simple answer to the second
question, which has the advantage of no loss of information:

repr(your_utf8_string.decode('utf8'))
or merely
repr(your_utf8_string)

Cheers,
John

[=?ISO-8859-1?Q?Michael_Str=F6der?=]

si***************@gmail.com wrote:

>
Is there a string function to trim all non-ascii characters out of a
string?
Let say I have a string in python (which is utf8 encoded), is there a
python function which I can convert that to a string which composed of
only ascii characters?

I'd recommend to rethink this approach.
In the worst case the result is an empty string... ;-)

Ciao, Michael.

[Torsten Bronger]

Hallöchen!

Paul McGuire writes:

On Dec 31, 2:54*am, abhishek <[e-mail]:

>>
Use this function --

def omitNonAscii(nstr):
* * sstr=''
* * for r in nstr:
* * * * if ord(r)<127:
* * * * * * sstr+=r
* * return sstr

<Yoda>
Learn the ways of the generator expression you must.
</Yoda>

Stupid me! How could I miss such a lovely feature in the language?

Tschö,
Torsten.

--
Torsten Bronger, aquisgrana, europa vetus
Jabber ID: br*****@jabber.org
(See http://ime.webhop.org for further contact info.)