Selection error...

[Abandoned]

Hi..
I want to select datas but some datas give me this error:

psycopg2.ProgrammingError: invalid byte sequence for encoding "UTF8":
0xc720
HINT: This error can also happen if the byte sequence does not match
the encoding expected by the server, which is controlled by
"client_encoding".

My select command:
cursor.execute("SELECT id from templinks where url='%s'"% URL)

This problem occured only select data when i try insert the same data
it doesn't give me error..
Note: My database is UTF-8 and the URLS come from different web sites'
html code
How can i fix this problem ?
I'm sorry my bad english..

[Carsten Haese]

On Sat, 2007-10-20 at 18:28 -0700, Abandoned wrote:

Hi..
I want to select datas but some datas give me this error:

psycopg2.ProgrammingError: invalid byte sequence for encoding "UTF8":
0xc720
HINT: This error can also happen if the byte sequence does not match
the encoding expected by the server, which is controlled by
"client_encoding".

My select command:
cursor.execute("SELECT id from templinks where url='%s'"% URL)

Haven't we told you before not to use the % operator to fill values into
a query? Use parameter binding:

cursor.execute("SELECT id from templinks where url=%s", (URL,) )

This problem occured only select data when i try insert the same data
it doesn't give me error..
Note: My database is UTF-8 and the URLS come from different web sites'
html code

Your string probably contains latin-1 encoded text. Try
URL.decode('latin-1').encode('utf-8') to transcode it into utf-8.

Hope this helps,

--
Carsten Haese
http://informixdb.sourceforge.net

[Abandoned]

cursor.execute("SELECT id from templinks where url=%s", (URL,) )

Yes i already try this before ask.

URL.decode('latin-1').encode('utf-8') to transcode it into utf-8.
i know this but how do you know the html encoding's a latin-1 ? Html
encoding is to be iso-8859-9 or ascii or cp1254 ... For this reason
URL.decode('latin-1').encode('utf-8') must give me error. I'm trying
now and whet it finished i write the result here.
Thank you very much for your helps.

[Guilherme Polo]

2007/10/21, Abandoned <be*****@gmail.com>:

>

cursor.execute("SELECT id from templinks where url=%s", (URL,) )

Yes i already try this before ask.

URL.decode('latin-1').encode('utf-8') to transcode it into utf-8.
i know this but how do you know the html encoding's a latin-1 ?

Try using chardet to detect the encoding

Html
encoding is to be iso-8859-9 or ascii or cp1254 ... For this reason
URL.decode('latin-1').encode('utf-8') must give me error. I'm trying
now and whet it finished i write the result here.
Thank you very much for your helps.

--
http://mail.python.org/mailman/listinfo/python-list

--
-- Guilherme H. Polo Goncalves