473,289 Members | 1,842 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,289 software developers and data experts.

interpretation of special characters in Python

TP
Hi everybody,

I am new to Python, I try to understand how Python treats special
characters. For example, if I execute the following line in a shell
console, I obtain a colored string:

$ python -c "print '\033[30;44m foo \033[0m'"

So, it works.
Some time ago, I have made a lot of shell variables with all possible colors
(with shell functions executed each time I launch a new shell). For
example:

$ echo -e $esc$ColorBlackOnDarkblue foo $esc$ColorReset

gives the same result than the python command above.
To know the corresponding non-interpreted characters, I can use the -n
option of echo:

$ echo -n $esc$ColorBlackOnDarkblue foo $esc$ColorReset
\033[30;44m foo \033[0m

So, it is exactly the string above, as expected.

My problem arises when it comes to get these shell variables ( $esc,
$ColorBlackOnDarkblue, $ColorReset) in a Python script, with os.environ, in
the following 5-line script:

import os
Color = os.environ['ColorBlackOnDarkblue']
ColorReset = os.environ['ColorReset']
Esc = os.environ['esc']
print '%s%s%s%s%s' % (Esc, Color, " foo ", Esc, ColorReset)

Run this script color.py, but after having defined these shell variables in
a shell:

$ export esc="\033"
$ export ColorBlackOnDarkblue="[30;44m"
$ export ColorReset="[0m"

When I execute the Python script, I do not obtain any special character
interpretation in Python:

$ python color.py
\033[30;44m foo \033[0m

Why? What is the problem? Is there any solution?
I really want to get my shell color variables.

Thanks a lot

--
TP (Tribulations Parallèles)

"Allez, Monsieur, allez, et la foi vous viendra." (D'Alembert).
Jul 6 '08 #1
9 2552
On Sun, 06 Jul 2008 23:42:26 +0200, TP <Tr**********@Paralleles.invalidwrote:
>
$ python -c "print '\033[30;44m foo \033[0m'"
[writes an escape sequence to stdout]
$ echo -e $esc$ColorBlackOnDarkblue foo $esc$ColorReset
[also writes an escape sequence to stdout]
$ echo -n $esc$ColorBlackOnDarkblue foo $esc$ColorReset
\033[30;44m foo \033[0m
[snip, shuffle]
$ export esc="\033"
$ export ColorBlackOnDarkblue="[30;44m"
$ export ColorReset="[0m"

import os
Color = os.environ['ColorBlackOnDarkblue']
ColorReset = os.environ['ColorReset']
Esc = os.environ['esc']
print '%s%s%s%s%s' % (Esc, Color, " foo ", Esc, ColorReset)
[snip]
$ python color.py
\033[30;44m foo \033[0m
The string "\033" is 4 characters long. Your shell variable
"esc" is 4 characters long. Your Python program prints
those four characters. You want it to re-interpret those 4
characters into a single escape character.

One of this group's regular participants can (I hope) tell
us three breathtakingly elegant ways to do that. I'm sorry
I can't.

When you run echo, it recognizes the 4-character "esc" as a
convention for representing a single character, and performs
the re-interpretation for you. When you tell python
"print '\033[30;44m foo \033[0m'", python interprets
the "\033" as a single character.

--
To email me, substitute nowhere->spamcop, invalid->net.
Jul 7 '08 #2
TP
Dennis Lee Bieber wrote:
Off-hand, I'd probably try first with:

csi = "\033["

and then define your

colorblackondarkblue = $csi"30;44m"
Thanks for your answer.
I have tried this slight modification, but it does not change anything on my
terminal.
--
TP (Tribulations Parallèles)

"Allez, Monsieur, allez, et la foi vous viendra." (D'Alembert).
Jul 7 '08 #3
TP
Peter Pearson wrote:

Thanks for your answer.
When you run echo, it recognizes the 4-character "esc" as a
convention for representing a single character, and performs
the re-interpretation for you. When you tell python
"print '\033[30;44m foo \033[0m'", python interprets
the "\033" as a single character.
So, the python print command *can* interpret these 4-character as a single
character. It would be odd if there were no possibility to do the same
thing when the characters are (i) stored in a python variable, or (ii) come
from the environment variables. Does anybody know any way to re-interpret a
string in Python? I have tried to play with "eval" (as in bash), but it
does not yield anything.

--
TP (Tribulations Parallèles)

"Allez, Monsieur, allez, et la foi vous viendra." (D'Alembert).
Jul 7 '08 #4
TP <Tr**********@Paralleles.invalidwrites:
Peter Pearson wrote:
When you tell python "print '\033[30;44m foo \033[0m'", python
interprets the "\033" as a single character.

So, the python print command *can* interpret these 4-character as a
single character.
Not "interpret", no.

It's more accurate to say that the Python *compiler* will translate
"\033" within a string literal into a single character in the compiled
executable byte code.

That is, the input to the Python interpreter will not have "\033" in
the string literal at all, but instead a single character produced by
the Python compiler at that point in the byte code.
It would be odd if there were no possibility to do the same thing
when the characters are (i) stored in a python variable, or (ii)
come from the environment variables.
Since those are not the input to the Python compiler, they can't be
translated this way.

--
\ “You know I could rent you out as a decoy for duck hunters?†|
`\ —Groucho Marx |
_o__) |
Ben Finney
Jul 7 '08 #5
TP
TP wrote:
So, the python print command *can* interpret these 4-character as a single
character. It would be odd if there were no possibility to do the same
thing when the characters are (i) stored in a python variable
Sorry, it works when using variables. Try for example:

col="[0;31m"
esc="\033"
colreset="[0m"
print esc + col + "foobar" + esc + colreset

--
TP (Tribulations Parallèles)

"Allez, Monsieur, allez, et la foi vous viendra." (D'Alembert).
Jul 7 '08 #6
Peter Pearson wrote:
On Sun, 06 Jul 2008 23:42:26 +0200, TP <Tr**********@Paralleles.invalid>
wrote:
>>
$ python -c "print '\033[30;44m foo \033[0m'"
[writes an escape sequence to stdout]
>$ echo -e $esc$ColorBlackOnDarkblue foo $esc$ColorReset
[also writes an escape sequence to stdout]
>$ echo -n $esc$ColorBlackOnDarkblue foo $esc$ColorReset
\033[30;44m foo \033[0m

[snip, shuffle]
>$ export esc="\033"
$ export ColorBlackOnDarkblue="[30;44m"
$ export ColorReset="[0m"

import os
Color = os.environ['ColorBlackOnDarkblue']
ColorReset = os.environ['ColorReset']
Esc = os.environ['esc']
print '%s%s%s%s%s' % (Esc, Color, " foo ", Esc, ColorReset)
[snip]
>$ python color.py
\033[30;44m foo \033[0m

The string "\033" is 4 characters long. Your shell variable
"esc" is 4 characters long. Your Python program prints
those four characters. You want it to re-interpret those 4
characters into a single escape character.

One of this group's regular participants can (I hope) tell
us three breathtakingly elegant ways to do that. I'm sorry
I can't.

When you run echo, it recognizes the 4-character "esc" as a
convention for representing a single character, and performs
the re-interpretation for you. When you tell python
"print '\033[30;44m foo \033[0m'", python interprets
the "\033" as a single character.
Peter Pearson's explanation is spot-on. You get the 4-character sequence
instead of the escape code chr(27).

$ export esc="\033"
$ python
Python 2.5.1 (r251:54863, Mar 7 2008, 03:39:23)
[GCC 4.1.3 20070929 (prerelease) (Ubuntu 4.1.2-16ubuntu2)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>import os
os.environ["esc"]
'\\033'
>>print _
\033

If you want to interpret "\\033" as "\033" you have to perform the
conversion explicitly. Fortunately there already is an encoding that
understands these escape sequences for characters:
>>esc = os.environ["esc"].decode("string-escape")
esc
'\x1b'
>>print "%s[30;44malles so schoen bunt hier%s[0m" % (esc, esc)
alles so schoen bunt hier

Peter
Jul 7 '08 #7
TP
Peter Otten wrote:
>>>esc = os.environ["esc"].decode("string-escape")
esc
'\x1b'
>>>print "%s[30;44malles so schoen bunt hier%s[0m" % (esc, esc)
alles so schoen bunt hier
Thanks a lot for your help. It works perfectly.
Indeed, one can read in the documentation concerning encodings:

"Produce a string that is suitable as string literal in Python source code"

--
TP (Tribulations Parallèles)

"Allez, Monsieur, allez, et la foi vous viendra." (D'Alembert).
Jul 7 '08 #8
On Mon, 07 Jul 2008 10:05:56 +0200, TP <Tr**********@Paralleles.invalidwrote:
TP wrote:
>So, the python print command *can* interpret these 4-character as a single
character. It would be odd if there were no possibility to do the same
thing when the characters are (i) stored in a python variable

Sorry, it works when using variables. Try for example:

col="[0;31m"
esc="\033"
colreset="[0m"
print esc + col + "foobar" + esc + colreset
I don't understand exactly what you mean by "Sorry", but
let me direct your attention to the fact that the "interpretation"
step about which we're talking happens during the parsing
of the string literal (i.e., while the statement esc="\033" is
processed), not during the execution of the print statement.
To prove this assertion, simply print len(esc). You will see
that esc is a single character long.

--
To email me, substitute nowhere->spamcop, invalid->net.
Jul 8 '08 #9
TP
Peter Pearson wrote:
I don't understand exactly what you mean by "Sorry"
I means: please forgive me for having said that it does not work with
variables, because it is completely false.

Thanks one more time

Julien

--
TP (Tribulations Parallèles)

"Allez, Monsieur, allez, et la foi vous viendra." (D'Alembert).
Jul 8 '08 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

5
by: Gregor | last post by:
I am trying to print some special characters, but they come out as different characters in the Python console. If I have a script like this: # -*- coding: latin_1 -*- print "Mädchen" print...
1
by: ulrice jardin | last post by:
hi I had a look to this htmlentitydefs lib, but I still don't know how to convert html special characters into latin-1 characters. For instance, how can I convert ' into ' or é and &eacute;...
3
by: trapeze.jsg | last post by:
Hi. Platform: Win XP Python version: 2.4.1 Running script from: cmd.exe (windows console) I am having some trouble passing arguments to a python script having special...
3
by: Scott David Daniels | last post by:
In reading over the source for CPython's PyUnicode_EncodeDecimal, I see a dance to handle characters which are neither dec-equiv nor in Latin-1. Does anyone know about the intent of such a...
0
by: Luis Corrales | last post by:
Hi all, I have a problem when searching for text with special characters in e-mails in an IMAP server. I'm using imaplib in python 2.4.3 and I can't get this code working: # first connect and...
1
by: sonald | last post by:
Dear All, I am working on a module that validates the provided CSV data in a text format, which must be in a predefined format. We check for the : 1. Number of fields provided in the text file,...
1
by: ronrsr | last post by:
I have an MySQL database called zingers. The structure is: zid - integer, key, autoincrement keyword - varchar citation - text quotation - text I am having trouble storing text, as typed in...
1
by: ronrsr | last post by:
I have an MySQL database called zingers. The structure is: zid - integer, key, autoincrement keyword - varchar citation - text quotation - text I am having trouble storing text, as typed in...
3
KevinADC
by: KevinADC | last post by:
Purpose The purpose of this article is to discuss the difference between characters inside a character class and outside a character class and some special characters inside a character class....
2
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 7 Feb 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:30 (7.30PM). In this month's session, the creator of the excellent VBE...
0
by: MeoLessi9 | last post by:
I have VirtualBox installed on Windows 11 and now I would like to install Kali on a virtual machine. However, on the official website, I see two options: "Installer images" and "Virtual machines"....
0
by: DolphinDB | last post by:
The formulas of 101 quantitative trading alphas used by WorldQuant were presented in the paper 101 Formulaic Alphas. However, some formulas are complex, leading to challenges in calculation. Take...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
1
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.