473,569 Members | 2,845 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

DB2 issue for some Non English Characters

2 New Member
Hi,

I am facing some problem while inserting some non English characters to DB2 server from my java application. We are not able to retrieve the same record when searched with the same non English string. The data I tried is “£¤¥®¶ÀÆÇÐÉÎÕÛÜ ÞßàñéïðĂąΏΓΔπήЄ ЊЯҖכظٔⁿ∑┴♠ ☺♫שׁﭯ שׁﭯﻼ” (To be frank, I don’t know which language it is…This is a bug reported by one of our client) .

Our observations/findings

1. On research, we noticed that the non english string which we entered is not saved in the database as such. We found that some of the characters are replaced with blocks ( ��������� � )
2. On debugging the java code, we found that is is passed correctly to the statement object for insertion.
3. We tried to replicate the same issue by connecting to Oracle server (instead of DB2), but couldn’t reproduce this issue. There it is working fine.

Our findings, makes us assume that the issue is with either
i. db2 database configuration
ii. IBM db2 java thin driver

Our configuration setting are as follows:
1. Db2 server version – 8.1
2. db2 database created to support utf-8is as follows:
3.
CREATE DATABASE TESTDATABASE ON C: ALIAS TESTDATABASE USING CODESET UTF-8 TERRITORY US COLLATE …….
……………….
4. Configured the environment variable () in DB2 Server

Can any one please, let me know the reason for this bug. Is it related to the DB2 server we are using or with the driver or is there any other reasons. Do I need to run any patch?????

Thanks.
Dec 6 '06 #1
3 2687
r035198x
13,262 MVP
Hi,

I am facing some problem while inserting some non English characters to DB2 server from my java application. We are not able to retrieve the same record when searched with the same non English string. The data I tried is “£¤¥®¶ÀÆÇÐÉÎÕÛÜ ÞßàñéïðĂąΏΓΔπήЄ ЊЯҖכظٔⁿ∑┴♠ ☺♫שׁﭯ שׁﭯﻼ” (To be frank, I don’t know which language it is…This is a bug reported by one of our client) .

Our observations/findings

1. On research, we noticed that the non english string which we entered is not saved in the database as such. We found that some of the characters are replaced with blocks ( ��������� � )
2. On debugging the java code, we found that is is passed correctly to the statement object for insertion.
3. We tried to replicate the same issue by connecting to Oracle server (instead of DB2), but couldn’t reproduce this issue. There it is working fine.

Our findings, makes us assume that the issue is with either
i. db2 database configuration
ii. IBM db2 java thin driver

Our configuration setting are as follows:
1. Db2 server version – 8.1
2. db2 database created to support utf-8is as follows:
3.
CREATE DATABASE TESTDATABASE ON C: ALIAS TESTDATABASE USING CODESET UTF-8 TERRITORY US COLLATE …….
……………….
4. Configured the environment variable () in DB2 Server

Can any one please, let me know the reason for this bug. Is it related to the DB2 server we are using or with the driver or is there any other reasons. Do I need to run any patch?????

Thanks.
You need a user defined function (UDF for this).

This should shed some light

http://www-128.ibm.com/developerwork.../dm-0602doole/
Dec 6 '06 #2
prajithgg
2 New Member
Thanks for your update. I will try this out.
But it seems that the link which you have provided is related to Sorting functions. Will this fix my issue of data getting saved in different format (and so not able to retrieve it using the user entered value).

Once agian thanks for your immediate reply.
Dec 6 '06 #3
r035198x
13,262 MVP
Thanks for your update. I will try this out.
But it seems that the link which you have provided is related to Sorting functions. Will this fix my issue of data getting saved in different format (and so not able to retrieve it using the user entered value).

Once agian thanks for your immediate reply.
Oh the reason I thought about it is because a sort is done everytime a retrieve is done. Here is an explanation from Neopa
http://www.thescripts.com/forum/thread570905.html
Dec 6 '06 #4

Sign in to post your reply or Sign up for a free account.

Similar topics

4
2334
by: Ricky Romaya | last post by:
Hi, Anybody could show me a regex for capturing words (alphas, without numerics) in languages other than english (languages with special characters i.e. french, german)? I've tried '+' but the special letters for some language (i.e. french) are not captured. The '\w+' works fine, but it also include numerics, which I don't want. TIA
8
6417
by: Beznas | last post by:
Hi All; I'm trying to create an ASP function called CleanX that removes the punctuation and some characters like (*&^%$#@!<>?"}|{..) from a text string I came up with this but It doesn't look like it's working. Can anyone help please. THANK YOU.
3
1784
by: Elie Grouchko | last post by:
Hi All I am submitting a form to IIS 5.0, the CODEPAGE is set to 1252 and the charset is 'iso-8859-1'. I noticed that if I type information in a language different from English I get data from the Request.Form collection in the following Unicode format: 'stגד', i.e English characters unchanged and other characters coded as Unicode...
3
2154
by: Ron M | last post by:
I am sure this is a simple issue, but being a beginner I am struggling. In the following js function I am attempting to make sure no numbers are within "name" controls. I want to pass the text value of the HTML control and the control name into the function: function CheckForNumbers (strString, strField) { var result = true; var validNums =...
18
5444
by: OrenFlekser | last post by:
Hi I've posted this message couple of days ago, but I can't find it now, so sorry if you see it twice... Anyways - I have a text box, and I want my users to be able to write only in english inside it. I want to prevent the Alt+Shift option of switching to other languages. Thanks alot - Oren
1
3050
by: tony.pahl | last post by:
We are converting a data warehouse to a Unicode database to get ready for multilingual support. If we will have 95% of our data in English as we currently do, and less than 5% in other foreign languages including Japanese, it appears as if we would be best off using codepage of 1208 and UTF-8. We are thinking we would need to expand our...
10
1403
by: Samuel | last post by:
Hi I am trying to read text files that are saved in ANSI format with Unicode characters such as French e German big S etc, and as I read the file these characters appear as squares etc. I know that if the file would be saved as Unicode this wouldn't be a problem. The question is whether there is an option that when I create the Stream
10
1247
by: LayneMitch via WebmasterKB.com | last post by:
Hello. I'm trying to figure out why this isn't working... <html><head><title>Prob.11</title> <script type="text/javascript"> function attachHandlers { var the_opts=document.getElementsByTagName("input");
3
2617
by: Terry IT | last post by:
hi, i've some C and C++ code written. I'll speak about the C code here. All of the text user interface is with printfs and scanf. They are all ascii characters. They are working well on english . Now i have to change these printf("Select 1 for choosing option billing \n") ; to japanese , chinese etc. One option would be to use GNU gettext...
0
7695
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main...
0
7612
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language...
0
8119
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that...
1
5509
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes...
0
3653
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in...
0
3637
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
2111
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
1
1209
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
0
936
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.