Jython 2.1 and Cheetah:Cyrilli c templates output mixed encoding

[Mike Grigorov]

I am using cheetah with jython 2.1 and I have problem generating templates
that contain cyrillic text. Some texts are printed OK and others are not.

I searched Jython and cheetah projects mailing lists on sourceforge.net as
well as these groups and tried some other fixes proposed but without success.

I call the template like this:

PythonInterpret er pyiInterp = new PythonInterpret er();
pyiInterp.set(" textTool", TextToolkit.get Instance());
String _body = readFile(strTem plateFile.repla ce('\\', '/'));

//----Encoding:
PyString _pyBody = new PyString(_body) ;
//----

pyiInterp.set(" templBody", _pyBody);
ByteArrayOutput Stream bos = new ByteArrayOutput Stream();
PrintWriter pwOut = new PrintWriter(bos );
pyiInterp.setOu t(pwOut);
pyiInterp.exec( "from Cheetah.Templat e import Template");
pyiInterp.exec( "t = Template(source =templBody)");
pyiInterp.exec( "t.textTool = textTool");
pyiInterp.exec( "print t");

I tried replacing the section marked as //---Encoding:
String isoScript = _body;
try {
//The call to sun.io.Converte rs.getDefaultEn codingName() returns "Cp1251"
byte[] bytes = _body.getBytes( sun.io.Converte rs.getDefaultEn codingName());
isoScript = new String(bytes, "ISO-8859-1");
}
catch (Exception ex) {
System.out.prin tln("CONVERSION ERROR:" + ex);
}
PyString _pyBody = new PyString(isoScr ipt);
This resulted in the problem inverted - the 'good' text became 'bad' and vice versa.

Here are sample lines one of which prints good text and the second - not
good(depending on its position in the template) /I guess text will be garbled
here/ :

${textTool.fill er(35, " ")}???????? ? ????
${textTool.fill er(35, " ")}???????? ???? ?? ??????????

textTool is a java object and this call produces 35 spaces

The encoding of the lines is the same(I checked the int values for the
letters).
I tried:

import sys
sys.setdefaulte ncoding('cp1251 ')

It didn't help but it caused compilation of the encodings\cp125 1.py module ->
cp1251$py.class so I guess it was taken into account

Please guide me to papers that can help solving this or propose ideas what
might be causing this behaviour.

Thanks for your cooperation
Mike

[Mike Grigorov]

mi****@abv.bg (Mike Grigorov) wrote in message news:<9d******* *************** ****@posting.go ogle.com>...

I am using cheetah with jython 2.1 and I have problem generating templates
that contain cyrillic text. Some texts are printed OK and others are not.

The fact is that cheetah had nothing to do with the problem. I studied Jython
code and changed PyString and PyFile classes in the org.python.core package. I
changed all calls to deprecated methods of java.lang.Strin g with their
recommended replacements and the problem seems to be solved. I also changed
references to StringBufferInp utStream with ByteArrayInputS tream in the "Py" and
"parser" classes of the same package but haven't studied if this helped to solve
the problem.
Thanks for your time
Mike