xml and java euro signs disapear

[flm]

I've got an XML document that contains euro signs and looks like :

<?xml version="1.0" encoding="utf-8"?>
<merchant id="52">
<product
offerid="03543068131"
deliverycost="6,90 €"
/>
....

I use this bit of Java (jdk 1.4.2) code to parse it :

DocumentBuilderFactory factory = DocumentBuilderFactory.newInstance();
DocumentBuilder builder = factory.newDocumentBuilder();
Document document = builder.parse( file_ );

The problem is the euro signs are transformed into the charactere '?'
(printing the value of a getAttribute( "deliverycost" ) gives ? on a
utf-8 terminal)

Thanks for any help,
FL

[David Carlisle]

You have declared that your xml file is utf-8 encoded but have used (as
far as I can tell) a byte with value 128 to represent a euro which isn't
the utf8 encoding of character 8364 which is the Euro.
You either need to declare the encoding that you are using or express
the character in an encoding-neutral form such as
"& # 8364 ;"
(without the spaces

David

[Francois-Louis Mommens]

Thank for you reply David.
If I use & # 8364; or even & # x20ac like you recommand I got the same
result.

FLM

*** Sent via Developersdex http://www.developersdex.com ***

[Alain Ketterlin]

"flm" <fl*******@hotmail.com> writes:

The problem is the euro signs are transformed into the charactere '?'
(printing the value of a getAttribute( "deliverycost" ) gives ? on a
utf-8 terminal)

The problem is in "printing", probably because your Writer object has
improper encoding and/or mismatching locale. Or because you use
System.out, which use the locale-specified encoding, which may not be
utf-8. It's probably best to give an explicit encoding/charset.

-- Alain.

[Martin Honnen]

Francois-Louis Mommens wrote:

If I use & # 8364; or even & # x20ac like you recommand I got the same
result.

Are you sure that output terminal is able to render a Euro symbol
properly? What happens if you do not use XML at all but try to output a
Euro symbol '€' from a normal string?

--

Martin Honnen
http://JavaScript.FAQTs.com/

[Rob van der Putten]

Hi there
flm wrote:

I've got an XML document that contains euro signs and looks like :

<?xml version="1.0" encoding="utf-8"?>
<merchant id="52">
<product
offerid="03543068131"
deliverycost="6,90 ?"
/>
...

I use this bit of Java (jdk 1.4.2) code to parse it :

DocumentBuilderFactory factory = DocumentBuilderFactory.newInstance();
DocumentBuilder builder = factory.newDocumentBuilder();
Document document = builder.parse( file_ );

The problem is the euro signs are transformed into the charactere '?'
(printing the value of a getAttribute( "deliverycost" ) gives ? on a
utf-8 terminal)

If you want to post an UTF-8 file, use UTF-8 as charset; Set the default
charset in your browser / newsreader to UTF-8.

Set your locale to UTF-8, eg en_GB.UTF-8 or en_US.UTF-8
Set de default characterset of your editor to UTF-8.
Use an UTF-8 enabled terminal such as uxterm.
Install unicode fonts such as Cyberbit.ttf, Ariel-unicode or GNU-unifont
and install a unicode font as your default font.
Regards,
Rob
--
+----------------------------------------------------------------------+
| The EU constitution will turn the EU into an USA colony |
| Vote against the EU constitution in the referendum |
+----------------------------------------------------------------------+

[Rob vd Putten]

Hi there
Rob van der Putten wrote:

If you want to post an UTF-8 file, use UTF-8 as charset; Set the default
charset in your browser / newsreader to UTF-8.

Set your locale to UTF-8, eg en_GB.UTF-8 or en_US.UTF-8
Set de default characterset of your editor to UTF-8.
Use an UTF-8 enabled terminal such as uxterm.
Install unicode fonts such as Cyberbit.ttf, Ariel-unicode or GNU-unifont
and install a unicode font as your default font.

If all goes well, this should be UTF-8;

Nicer typography in plain text files:

╔���������������╠�����������������⠕����������╗
â•‘ â•‘
║ • ‘single’ and “double� quotes ║
â•‘ â•‘
║ • Curly apostrophes: “We’ve been here� ║
â•‘ â•‘
║ • Latin-1 apostrophe and accents: '´` ║
â•‘ â•‘
║ • ‚deutsche‘ „Anführungszeichen“ ║
â•‘ â•‘
â•‘ • â€*, ‡, ‰, •, 3–4, —, −5/+5, â„¢, … â•‘
â•‘ â•‘
║ • ASCII safety test: 1lI|, 0OD, 8B ║
â•‘ â•*─────────╮ â•‘
║ • the euro symbol: │ 14.95 € │ ║
║ ╰─────────╯ ║
╚���������������╠�����������������⠕�����������

Russian:

From a Unicode conference invitation:

Зареги�трируйте�ь �ейча� на Де��тую Международную Конференцию по
Unicode, котора� �о�тоит�� 10-12 марта 1997 года в Майнце в Германии.
Конференци� �оберет широкий круг �к�пертов по вопро�ам глобального
Интернета и Unicode, локализации и интернационализации, воплощению и
применению Unicode в различных операционных �и�темах и программных
приложени�х, шрифтах, вер�тке и много�зычных компьютерных �и�темах.

Greek:

From a speech of Demosthenes in the 4th century BC:

Ο�χὶ τα�τὰ πα�ίσταταί μοι γιγνώσκειν, ὦ ἄνδ�ες ᾿Αθηναῖοι,
ὅταν τ᾿ εἰς τὰ π�άγματα ἀποβλέψω καὶ ὅταν π�ὸς τοὺς
λόγους οὓς ἀκούω· τοὺς μὲν γὰ� λόγους πε�ὶ τοῦ
τιμω�ήσασθαι Φίλιππον ��ῶ γιγνομένους, τὰ δὲ π�άγματ᾿
εἰς τοῦτο π�οήκοντα, ὥσθ᾿ ὅπως μὴ πεισόμεθ᾿ α�τοὶ
π�ότε�ον κακῶς σκέψασθαι δέον. ο�δέν οὖν ἄλλο μοι δοκοῦσιν
οἱ τὰ τοιαῦτα λέγοντες ἢ τὴν ὑπόθεσιν, πε�ὶ ἧς βουλεύεσθαι,
ο�χὶ τὴν οὖσαν πα�ιστάντες ὑμῖν �μα�τάνειν. �γὼ δέ, ὅτι μέν
ποτ᾿ �ξῆν τῇ πόλει καὶ τὰ αὑτῆς ἔχειν ἀσφαλῶς καὶ Φίλιππον
τιμω�ήσασθαι, καὶ μάλ᾿ ἀκ�ιβῶς οἶδα· �π᾿ �μοῦ γά�, ο� πάλαι
γέγονεν ταῦτ᾿ ἀμφότε�α· νῦν μέντοι πέπεισμαι τοῦθ᾿ ἱκανὸν
π�ολαβεῖν ἡμῖν εἶναι τὴν π�ώτην, ὅπως τοὺς συμμάχους
σώσομεν. �ὰν γὰ� τοῦτο βεβαίως ὑπά�ξῃ, τότε καὶ πε�ὶ τοῦ
τίνα τιμω�ήσεταί τις καὶ ὃν τ�όπον �ξέσται σκοπεῖν· π�ὶν δὲ
τὴν ἀ�χὴν ὀ�θῶς ὑποθέσθαι, μάταιον ἡγοῦμαι πε�ὶ τῆς
τελευτῆς �ντινοῦν ποιεῖσθαι λόγον.

Δημοσθένους, Γ´ ᾿Ολυνθιακὸς

All the display, editing and conversion software you use should also be
capable of handling UTF-8.
Regards,
Rob
--
+----------------------------------------------------------------------+
| The EU constitution will turn the EU into an USA colony |
| Vote against the EU constitution in the referendum |
+----------------------------------------------------------------------+

[Rob van der Putten]

Hi there
Martin Honnen wrote:

Are you sure that output terminal is able to render a Euro symbol
properly? What happens if you do not use XML at all but try to output a
Euro symbol '?' from a normal string?

Most UTF-8 enviroments display dec 128 / hex 0x80 as a glyph looking
something like;

+----+
| 00 |
| 80 |
+----+

The same applies to other glyphs in the 128 / 0x80 ... 159 / 0x9F range;

+----+
| 00 |
| 9F |
+----+

Maybe UTF-8 is somehow converterd to CP-1252.

Try yudit, http://www.yudit.org/ to view and edit your files.
Regards,
Rob
--
+----------------------------------------------------------------------+
| The EU constitution will turn the EU into an USA colony |
| Vote against the EU constitution in the referendum |
+----------------------------------------------------------------------+