Unicode and UrlEncode!

[John]

I am trying to translate some French via Google.

Here is my code.

# -*- coding: latin-1 -*-

import httplib, urllib, re

def translate_french_to_english(french):
params = urllib.urlencode( {'text': french, 'langpair': 'fr|en',
'hl':'en', 'ie':'UTF8', 'oe':'UTF8'} )
print params
headers = {"Content-type": "application/x-www-form-urlencoded",
"Accept": "text/plain"}
Cn = httplib.HTTPConnection("translate.google.com")
Cn.request("POST", "/translate_t", params, headers)
response = Cn.getresponse()
data = response.read()
Cn.close()
match = re.compile('<textarea name=q
..*?>(.*?)</textarea>').search(data)
translated = match.groups()[0]
return translated

print translate_french_to_english('sÈdimentation')

The problem is my params in encoding to
langpair=fr%7Cen&text=s%C8dimentation&oe=UTF8&ie=U TF8&hl=en
-- s%C8dimentation --
when it should encode to
text=s%C3%88dimentation&langpair=fr%7Cen&hl=en&ie= UTF8&oe=UTF8
-- s%C3%88dimentation --

What should I do?

[Michel Claveau/Hamster]

Bonsoir !

Effectivement, j'ai fait des essais, et, dès qu'il y a un accent, ça
accroche.
Par contre, j'ai une fonction qui enlève les accents, et, alors, plus de
problème.
--
@-salutations
--
Michel Claveau
mél : http://cerbermail.com/?6J1TthIa8B
site : http://mclaveau.com

[Jeff Epler]

You should transform the byte string 'french' from whatever encoding
it's in (latin-1 according to your coding: directive) to unicode, if
you are going to tell google it's in Unicode.

Example:
"s\xc8dimentation".decode("latin-1").encode("utf-8")

Or, you can tell Python that the string is a Unicode literal, and it
will do the .decode() step for you:
u"sÈdimentation".encode("utf-8")

"" is always a bytestring literal, and u"" is always a unicode string
literal. If you have "<sequence of bytes>" then the string's value at
runtime is "<sequence of bytes>", and if you have u"<sequence of bytes>"
then the string's value is "<sequence of bytes>".encode(<file encoding>)

Jeff

[Michel Claveau/Hamster]

OK

ça marche avec :
sret=translate_french_to_english('sÈdimentation'.d ecode("latin-1").encode("u
tf-8"))
et aussi pour :

sret=translate_french_to_english('sédimentation'.d ecode("latin-1").encode("u
tf-8"))
Merci pour lui. (thanks).

@-salutation
--
Michel Claveau

[John]

Thanks a bunch. It works.

"Michel Claveau/Hamster" <No********@No.Spam.mclaveau.No.Spam.com> wrote in message news:<c3**********@news-reader4.wanadoo.fr>...

OK

ça marche avec :
sret=translate_french_to_english('sÈdimentation'.d ecode("latin-1").encode("u
tf-8"))
et aussi pour :

sret=translate_french_to_english('sédimentation'.d ecode("latin-1").encode("u
tf-8"))
Merci pour lui. (thanks).

@-salutation