DB2 issue for some Non English Characters

[prajithgg]

Hi,

I am facing some problem while inserting some non English characters to DB2 server from my java application. We are not able to retrieve the same record when searched with the same non English string. The data I tried is “£¤¥®¶ÀÆÇÐÉÎÕÛÜÞßàñéïðĂąΏΓΔπήЄЊЯҖכظٔⁿ∑┴♠☺♫שׁﭯ שׁﭯﻼ” (To be frank, I don’t know which language it is…This is a bug reported by one of our client) .

Our observations/findings

1. On research, we noticed that the non english string which we entered is not saved in the database as such. We found that some of the characters are replaced with blocks ( ���������� )
2. On debugging the java code, we found that is is passed correctly to the statement object for insertion.
3. We tried to replicate the same issue by connecting to Oracle server (instead of DB2), but couldn’t reproduce this issue. There it is working fine.

Our findings, makes us assume that the issue is with either
i. db2 database configuration
ii. IBM db2 java thin driver

Our configuration setting are as follows:
1. Db2 server version – 8.1
2. db2 database created to support utf-8is as follows:
3.
CREATE DATABASE TESTDATABASE ON C: ALIAS TESTDATABASE USING CODESET UTF-8 TERRITORY US COLLATE …….
……………….
4. Configured the environment variable () in DB2 Server

Can any one please, let me know the reason for this bug. Is it related to the DB2 server we are using or with the driver or is there any other reasons. Do I need to run any patch?????

Thanks.

[r035198x]

Hi,

I am facing some problem while inserting some non English characters to DB2 server from my java application. We are not able to retrieve the same record when searched with the same non English string. The data I tried is “£¤¥®¶ÀÆÇÐÉÎÕÛÜÞßàñéïðĂąΏΓΔπήЄЊЯҖכظٔⁿ∑┴♠☺♫שׁﭯ שׁﭯﻼ” (To be frank, I don’t know which language it is…This is a bug reported by one of our client) .

Our observations/findings

1. On research, we noticed that the non english string which we entered is not saved in the database as such. We found that some of the characters are replaced with blocks ( ���������� )
2. On debugging the java code, we found that is is passed correctly to the statement object for insertion.
3. We tried to replicate the same issue by connecting to Oracle server (instead of DB2), but couldn’t reproduce this issue. There it is working fine.

Our findings, makes us assume that the issue is with either
i. db2 database configuration
ii. IBM db2 java thin driver

Our configuration setting are as follows:
1. Db2 server version – 8.1
2. db2 database created to support utf-8is as follows:
3.
CREATE DATABASE TESTDATABASE ON C: ALIAS TESTDATABASE USING CODESET UTF-8 TERRITORY US COLLATE …….
……………….
4. Configured the environment variable () in DB2 Server

Can any one please, let me know the reason for this bug. Is it related to the DB2 server we are using or with the driver or is there any other reasons. Do I need to run any patch?????

Thanks.

You need a user defined function (UDF for this).

This should shed some light

http://www-128.ibm.com/developerwork.../dm-0602doole/

[prajithgg]

Thanks for your update. I will try this out.
But it seems that the link which you have provided is related to Sorting functions. Will this fix my issue of data getting saved in different format (and so not able to retrieve it using the user entered value).

Once agian thanks for your immediate reply.

[r035198x]

Thanks for your update. I will try this out.
But it seems that the link which you have provided is related to Sorting functions. Will this fix my issue of data getting saved in different format (and so not able to retrieve it using the user entered value).

Once agian thanks for your immediate reply.

Oh the reason I thought about it is because a sort is done everytime a retrieve is done. Here is an explanation from Neopa
http://www.thescripts.com/forum/thread570905.html