Hello,
I'm using Python 2.3.4 and I noticed that, when stdout is a terminal, the
'print' statement converts Unicode strings into the encoding defined by
the locales instead of the one returned by sys.getdefaulte ncoding().
However, I can't find any references to it. Anyone knows where it's
descrbed?
Example:
!/usr/bin/env python
# -*- coding: utf-8 -*-
import sys, locale
print 'Python encoding:', sys.getdefaulte ncoding()
print 'System encoding:', locale.getprefe rredencoding()
print 'Test string: ', u'Olá mundo'
If stdout is a terminal, works fine
$ python x.py
Python encoding: ascii
System encoding: UTF-8
Test string: Olá mundo
If I redirect the output to a file, raises an UnicodeEncodeEr ror exception
$ python x.py > x.txt
Traceback (most recent call last):
File "x.py", line 8, in ?
print 'Test string: ', u'Olá mundo'
UnicodeEncodeEr ror: 'ascii' codec can't encode character u'\xe1' in position 2: ordinal not in range(128)
--
Ricardo 4 2224
Ricardo Bugalho wrote: Hello, I'm using Python 2.3.4 and I noticed that, when stdout is a
terminal, the 'print' statement converts Unicode strings into the encoding defined by the locales instead of the one returned by sys.getdefaulte ncoding().
Sure. It uses the encoding of you console. Here is explanation why it
uses locale to get the encoding of console: http://www.python.org/moin/PrintFails
However, I can't find any references to it. Anyone knows where it's descrbed?
I've just wrote about it here: http://www.python.org/moin/DefaultEncoding Example:
!/usr/bin/env python # -*- coding: utf-8 -*-
import sys, locale
print 'Python encoding:', sys.getdefaulte ncoding() print 'System encoding:', locale.getprefe rredencoding() print 'Test string: ', u'Olá mundo'
If stdout is a terminal, works fine $ python x.py Python encoding: ascii System encoding: UTF-8 Test string: Olá mundo
If I redirect the output to a file, raises an UnicodeEncodeEr ror
exception $ python x.py > x.txt Traceback (most recent call last): File "x.py", line 8, in ? print 'Test string: ', u'Olá mundo' UnicodeEncodeEr ror: 'ascii' codec can't encode character u'\xe1' in
position 2: ordinal not in range(128) http://www.python.org/moin/ShellRedirectionFails
Feel free to reply here if something is not clear, corrections in wiki
are also welcome.
Serge.
Hi,
thanks for the information. But what I was really looking for was
informaion on when and why Python started doing it (previously, it always
used sys.getdefaulte ncoding())) and why it was done only for 'print' when
stdout is a terminal instead of always.
On Thu, 13 Jan 2005 14:33:20 -0800, Serge Orlov wrote: Sure. It uses the encoding of you console. Here is explanation why it uses locale to get the encoding of console: http://www.python.org/moin/PrintFails
--
Ricardo
Ricardo Bugalho wrote: Hi, thanks for the information. But what I was really looking for was informaion on when and why Python started doing it (previously, it always used sys.getdefaulte ncoding()))
I don't have access to any other version except 2.2 at the moment but I
believe it happened between 2.2 and 2.3 for Windows and UNIX terminals.
On other unsupported terminals I suspect sys.getdefaulte ncoding is
still used. The reason for the change is proper support of unicode
input/output.
and why it was done only for 'print' when stdout is a terminal instead of always.
The real question is why not *never* use sys.getdefaulte ncoding()
for printing. If you leave sys.getdefaulte ncoding() at Python default
value ('ascii') you won't need to worry about it <wink>
sys.getdefaulte ncoding() is a temporary measure for big projects to
use within one Python version.
Serge.
Ricardo Bugalho wrote: thanks for the information. But what I was really looking for was informaion on when and why Python started doing it (previously, it always used sys.getdefaulte ncoding())) and why it was done only for 'print' when stdout is a terminal instead of always.
It does that since 2.2, in response to many complains that you cannot
print a Unicode string in interactive mode, unless the Unicode string
contains only ASCII characters. It does that only if sys.stdout is
a real terminal, because otherwise it is not possible to determine
what the encoding of sys.stdout is.
Regards,
Martin This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics |
by: wolfgang haefelinger |
last post by:
Hi,
I wonder whether someone could explain me a bit what's going on here:
import sys
# I'm running Mandrake 1o and Windows XP.
print sys.version
## 2.3.3 (#2, Feb 17 2004, 11:45:40)
|
by: Spamtrap |
last post by:
I only work in Perl occasionaly, and have been searching for a
solution for a conversion, and everything I found seems much too
complex.
All I need to do is take a simple text file and copy it, however some specific lines are in
fact in UTF8 as printed garbagy characters and they need to be
converted to Unicode, so that the new text file can be imported into a
desktop program and into some Word documents.
For the moment I would be...
|
by: fowlertrainer |
last post by:
Hi !
I want to get the WMI infos from Windows machines.
I use Py from HU (iso-8859-2) charset.
Then I wrote some utility for it, because I want to write it to an XML file.
def ToHU(s,NoneStr='-'):
if s==None: s=NoneStr
if not (type(s) in ):
|
by: Borko |
last post by:
hi
I am having problems getting unicode characters into VB. Using VB6 (sp3) and
Access 2000
Characters are displayed correctly in Access, just when I use ADODB (2.7) to
read them in VB i get ? character instead of unicode characters.
I will display them in TreeView (capable of Unicode)
Is there any patch, fix or something, I know this thing is going around
|
by: lorenzo.viscanti |
last post by:
X-No-Archive: yes
Hi, I've found lots of material on the net about unicode html
conversions, but still i'm having many problems converting unicode
characters to html entities. Is there any available function to solve
this issue?
As an example I would like to do this kind of conversion:
\uc3B4 =ô
for all available html entities.
thanks,
| |
by: sonald |
last post by:
Hi,
I am using python2.4.1
I need to pass russian text into python and validate the same.
Can u plz guide me on how to make my existing code support the
russian text.
Is there any module that can be used for unicode support in python?
Incase of decimal numbers, how to handle "comma as a decimal point"
|
by: NevilleDNZ |
last post by:
Hi,
Apologies first as I am not a unicode expert.... indeed I the details
probably totally elude me. Not withstanding: how can I convert a
binary string containing UTF-8 binary into a python unicode string?
cutdown example:
$ cat ./uc.py
#!/usr/bin/env python
imported="\304\246\311\231\316\257\316\271\303\222
|
by: Jim |
last post by:
Hello,
I'm trying to write exception-handling code that is OK in the
presence
of unicode error messages. I seem to have gotten all mixed up and
I'd
appreciate any un-mixing that anyone can give me.
I'm used to writing code like this.
|
by: thijs.braem |
last post by:
Hi everyone,
I'm having quite some troubles trying to convert Unicode to String
(for use in psycopg, which apparently doesn't know how to cope with
unicode strings).
The error I keep having is something like this:
ERREUR: Séquence d'octets invalide pour le codage «UTF8» : 0xe02063
(sorry, locale is french, it means "byte sequence invalid for encoding
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
| |
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
| |