Python / Chinese Encodings

Achim Domma

Hi,

I need to convert Big5 or GB encoded chinese strings to unicode. It would
be also nice to be able to detect the encoding of the original string.
Search with groups.google.com I found some links to different projects but
they all look not very active. Can somebody give me a short overview of the
status of processing chinese texts with python?

regards,
Achim

Jul 18 '05 #1

Subscribe Post Reply

2590

Martin v. Löwis

"Achim Domma" <do***@procoders.net> writes:

I need to convert Big5 or GB encoded chinese strings to unicode. It would
be also nice to be able to detect the encoding of the original string.
Search with groups.google.com I found some links to different projects but
they all look not very active. Can somebody give me a short overview of the
status of processing chinese texts with python?

The very short summary: Use the CJK codecs package; it supports all
encodings you might encounter, and it is actively maintained.

As for detecting the encoding of the original string: Forget it. Tell
your communication partners to always properly declare the encoding.

Regards,
Martin

Jul 18 '05 #2

Similar topics

chinese codecs mit py2exe

by: Achim Domma | last post by:

Hi, I build successfully different COM servers with py2exe. In my setup.py I have something like this: opts = { "py2exe" : { "includes" : , "packages" : , }

Python

Does python's minidom support Chinese?

by: Anthony Liu | last post by:

The following 4 lines of code parses an XML document very well if the XML document contains only English words. But when I insert one Chinese character into the XML document, then Python starts...

Python

Fwd: [Python-Dev] Strawman decision: @decorator won't change

by: Peter Otten | last post by:

I took the freedom to forward GvR's mail concerning decorator cosmetics. I think you should know about it. Peter ---------- Forwarded Message ---------- Subject: Strawman decision:...

Python

displaying chinese from code behind

by: Coco | last post by:

Hi! I managed to display chinese character in my web form (.aspx), in certain situation i need to to set the text of the label of my web form in chinese character programatically which is done in...

.NET Framework

asp.net chinese encoding

by: pabv | last post by:

Hello all, I am having a few issues with encoding to chinese characters and perhaps someone might be able to assist. At the moment I am only able to see chinese characters when displayed as...

C# / C Sharp

python -U problem for 2.4.3c1 on Windows 2000 (was Does -U optionreally exist?)

by: Petr Prikryl | last post by:

I did observe the problem when using the -U option on Windows 2000. Seems like some infinite recursion in cp1250.py -- see below. I did not try it with earlier versions of Python. Can this...

Python

Static linking of python and pyqt

by: Markus Dahlbokum | last post by:

Hello, I'm trying to link python statically with qt and pyqt. I've tried this in several ways but never succeeded. At the moment the final make runs without errors but I get import errors when...

Python

a question about Chinese characters in aPython Program

by: Liang Chen | last post by:

Hope you all had a nice weekend. I have a question that I hope someone can help me out. I want to run a Python program that uses Tkinter for the user interface (GUI). The program allows me to type...

Python

Re: Where to locate existing standard encodings in python

by: Philip Semanchuk | last post by:

On Nov 9, 2008, at 7:00 PM, News123 wrote: Look under the heading "Standard Encodings": http://docs.python.org/library/codecs.html Note that both the page you found (which appears to be a...

Python

Basic concepts of WebLogic Admin training?

by: Naresh1 | last post by:

What is WebLogic Admin Training? WebLogic Admin Training is a specialized program designed to equip individuals with the skills and knowledge required to effectively administer and manage Oracle...

Oracle Database

Hyperconverged All-in-One Streaming Engine, ushering in new age for distributed database

by: antdb | last post by:

Ⅰ. Advantage of AntDB: hyper-convergence + streaming processing engine In the overall architecture, a new "hyper-convergence" concept was proposed, which integrated multiple engines and...

General

How to layout php header location with a variable as the location?

by: Matthew3360 | last post by:

Hi there. I have been struggling to find out how to use a variable as my location in my header redirect function. Here is my code. header("Location:".$urlback); Is this the right layout the...

PHP

How to use http requests (Get function) to get variable value?

by: Matthew3360 | last post by:

Hi, I have a python app that i want to be able to get variables from a php page on my webserver. My python app is on my computer. How would I make it so the python app could use a http request to get...

Python

HOW CAN I CREATE AN AI with an .executable file that would suck all files in the folder and on my computer

by: AndyPSV | last post by:

HOW CAN I CREATE AN AI with an .executable file that would suck all files in the folder and on my computerHOW CAN I CREATE AN AI with an .executable file that would suck all files in the folder and...

General

How do I view Redshift db tables in Alteryx

by: Arjunsri | last post by:

I have a Redshift database that I need to use as an import data source. I have configured the DSN connection using the server, port, database, and credentials and received a successful connection...

General

PHP Curl Not wanting to connect to localhost.

by: Matthew3360 | last post by:

Hi, I have been trying to connect to a local host using php curl. But I am finding it hard to do this. I am doing the curl get request from my web server and have made sure to enable curl. I get a...

PHP

One of the easiest ways to set the background color of Excel documents in Java

by: Carina712 | last post by:

Setting background colors for Excel documents can help to improve the visual appeal of the document and make it easier to read and understand. Background colors can be used to highlight important...

General

Join our open community on Discord to learn programming, SEO, and marketing

by: BLUEPANDA | last post by:

At BluePanda Dev, we're passionate about building high-quality software and sharing our knowledge with the community. That's why we've created a SaaS starter kit that's not only easy to use but also...

General