Hi, i have a situaion where i need to convert the characters entered in
an text field to upper case using C. The configuration id utf8
environment in which user can enter any character (single , double,
triple byte etc). I need to convert to upper case only those characters
which has got upper case. ie if an user enter bot english and japanese
characters in the text field, then I should convert only english
characters, not japanese.
I have seen that the C functions toupper() and tolower() handles multi
byte characters from Solaris 8. I am not sure with other platforms.
can any one suggest the best approch for the above scenario. 8 20230 cs******@gmail.com writes: Hi, i have a situaion where i need to convert the characters entered in
Hi. Do you know you triple-posted this?
an text field to upper case using C. The configuration id utf8 environment in which user can enter any character (single , double, triple byte etc). I need to convert to upper case only those characters
which has got upper case. ie if an user enter bot english and japanese characters in the text field, then I should convert only english characters, not japanese.
I have seen that the C functions toupper() and tolower() handles multi byte characters from Solaris 8. I am not sure with other platforms.
can any one suggest the best approch for the above scenario.
The encodings supported by your C implementation for operations in
toupper() and tolower() are implementation-defined: you'll need to
look it up in your documentation.
You might need to use setlocale() with something like "en_US.UTF8",
and restore the locale afterwards. This may or may not work. And you
still won't be able to work with multibyte strings directly: you'll
have to convert to and from wchar_t's.
Your best bet is to use a (off-topic) specialized library devoted to
manipulating UTF8 strings. IBM has one: http://www-306.ibm.com/software/glob.../icu/index.jsp
This provides a u_strToLower() function in ustring.h. Please don't
post here for questions regarding this library, however, as it is
off-topic for this NG.
HTH,
-Micah
Micah Cowan a écrit : Your best bet is to use a (off-topic) specialized library devoted to manipulating UTF8 strings. IBM has one:
And glib can do it too.
On Thursday 16 March 2006 20:26, Micah Cowan opined (in
<87************@mcowan.barracudanetworks.com>): cs******@gmail.com writes: Hi, i have a situaion where i need to convert the characters entered
Hi. Do you know you triple-posted this?
It's the blinkin' Google. It does it sometimes.
--
BR, Vladimir
"There is hopeful symbolism in the fact that flags do not wave in a
vacuum."
-- Arthur C. Clarke cs******@gmail.com wrote: Hi, i have a situaion where i need to convert the characters entered in
an text field to upper case using C. The configuration id utf8 environment in which user can enter any character (single , double, triple byte etc). I need to convert to upper case only those characters
Latin based uppercasing is easy, just convert to those characters
exactly in the lower-case or upper-case ASCII range. This is one of
the properties of UTF-8. However, to perform correct case change over
the whole Unicode range, you need to simply know which characters have
either a upper case or capitalization case alternative character (as
well as the reverse.) This information is available from the standard
Unicode data table.
Oh yeah, and this off topic here in comp.lang.c. ANSI C does not have
a notion of portable internationalization, let alone Unicode (though
some compilers implement wchar_t as Unicode, this cannot be relied
upon.)
--
Paul Hsieh http://www.pobox.com/~qed/ http://bstring.sf.net/
On Thu, 16 Mar 2006 10:17:13 -0800, csanjith wrote: Hi, i have a situaion where i need to convert the characters entered in
an text field to upper case using C. The configuration id utf8 environment in which user can enter any character (single , double, triple byte etc). I need to convert to upper case only those characters
which has got upper case. ie if an user enter bot english and japanese characters in the text field, then I should convert only english characters, not japanese.
I have seen that the C functions toupper() and tolower() handles multi byte characters from Solaris 8. I am not sure with other platforms.
It would seem improbable that toupper(), on Solaris or elsewhere, could
give the correct output for all valid input when using UTF-8, UTF-16,
UTF-32 or any other Unicode encoding variant.
For all Unicode encoding variants there are some "characters" (or
"graphemes" in Unicode terminology) which can be encoded
equivalently across multiple sets of integer values. Assume UTF-32, and
our Unicode string is an array of uint32_t integers. The Latin-1 character
a+umlaut could be described equivalently within the range of one 32-bit
integer with a value of 0x000000C1 or by combining two integers,
0x00000041-0x00000301. The latter representation could not be passed to
toupper() or tolower(), considering that neither can take an array.
[ http://www.unicode.org/faq/char_combmark.html#8]
Hmmmm. Do any Unicode gurus know if 0x0061-0301 would accomplish a capital
A + umlaut? Regardless, I strongly suspect that there are many graphemes
in many scripts where such a trick could never work, but where notions
like uppercase or lowercase are still meaningful.
On Thu, 16 Mar 2006 17:29:38 -0800, websnarf wrote: cs******@gmail.com wrote: Hi, i have a situaion where i need to convert the characters entered in
an text field to upper case using C. The configuration id utf8 environment in which user can enter any character (single , double, triple byte etc). I need to convert to upper case only those characters Latin based uppercasing is easy, just convert to those characters exactly in the lower-case or upper-case ASCII range. This is one of the properties of UTF-8. However, to perform correct case change over the whole Unicode range, you need to simply know which characters have either a upper case or capitalization case alternative character (as well as the reverse.) This information is available from the standard Unicode data table.
Latin != ASCII. ASCII is 7-bit, ISO Latin encodings are 8-bit. Non-ASCII
code points, in UTF-8, are multibyte. How do you pass an array to toupper()?
Oh yeah, and this off topic here in comp.lang.c. ANSI C does not have a notion of portable internationalization, let alone Unicode (though some compilers implement wchar_t as Unicode, this cannot be relied upon.)
The wide-character API is not sufficient to support Unicode.
But you're right, this is off-topic. Anybody know where this would be
on-topic, though?
William Ahern <wi*****@25thandClement.com> wrote: On Thu, 16 Mar 2006 10:17:13 -0800, csanjith wrote:
Hi, i have a situaion where i need to convert the characters entered in an text field to upper case using C. The configuration id utf8 environment in which user can enter any character (single , double, triple byte etc). I need to convert to upper case only those characters which has got upper case. ie if an user enter bot english and japanese characters in the text field, then I should convert only english characters, not japanese.
For all Unicode encoding variants there are some "characters" (or "graphemes" in Unicode terminology) which can be encoded equivalently across multiple sets of integer values. Assume UTF-32, and our Unicode string is an array of uint32_t integers. The Latin-1 character a+umlaut could be described equivalently within the range of one 32-bit integer with a value of 0x000000C1 or by combining two integers, 0x00000041-0x00000301. The latter representation could not be passed to toupper() or tolower(), considering that neither can take an array.
[http://www.unicode.org/faq/char_combmark.html#8]
Hmmmm. Do any Unicode gurus know if 0x0061-0301 would accomplish a capital A + umlaut?
If I read the Unicode Standard correctly, yes, it would. However, the
right question is: do you really _want_ to capitalise an accented lowed
case letter to an accented upper case letter? In Dutch you wouldn't.
There are (at least) two reasonable C solutions:
- trust that your implementation handles this correctly, for example by
letting the sysadmin of the system the program runs on install
language-specific libraries for the <ctype.h> functions, and just use
tolower() and toupper(), as you would otherwise;
- assume that you know better than J. Random Sysadmin which characters
you want to capitalise, and write your own case-changing functions
with knowledge about the Unicode tables.
Something is to be said for either solution; the first is simpler and
more flexible, in the second case the results are more strictly known.
Richard we******@gmail.com wrote On 03/16/06 20:29,: cs******@gmail.com wrote: Hi, i have a situaion where i need to convert the characters entered in
an text field to upper case using C. The configuration id utf8 environment in which user can enter any character (single , double, triple byte etc). I need to convert to upper case only those characters Latin based uppercasing is easy, just convert to those characters exactly in the lower-case or upper-case ASCII range. [...]
Note that all of "àáâãäåæçèéêëìíîïðñòóôõöøùúûüý" appear
in the alphabets of Latinic (Latinous?) languages, are
outside the ASCII lower-case range, and yet have upper-
case equivalents.
-- Er*********@sun.com This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Hallvard B Furuseth |
last post by:
Has someone got a Python routine or module which converts Unicode
strings to lowercase (or uppercase)?
What I actually need to do is to compare a number of strings in a
case-insensitive manner,...
|
by: Vladimir |
last post by:
Method UnicodeEncoding.GetMaxByteCount(charCount) returns charCount * 2.
Method UTF8Encoding.GetMaxByteCount(charCount) returns charCount * 4.
But why that?
Look:
/*
Each Unicode character...
|
by: hunterb |
last post by:
I have a file which has no BOM and contains mostly single byte chars. There
are numerous double byte chars (Japanese) which appear throughout. I need to
take the resulting Unicode and store it in a...
|
by: Dan V. |
last post by:
How do I create a one line text file with these control codes? e.g.: 144 =
0x90 and 147 = 0x93?
I am trying to create a one line text file with these characters all one one
row with no spaces.
...
|
by: Friso Wiskerke |
last post by:
Hi all,
I'm creating a fixed length textfile with data which is sent out to a
third-party which in turn reads the file and processes it. Some of the
characters are not part of the lower ASCII...
|
by: Dino Buljubasic |
last post by:
Hi,
I would like to convert characters as typed in my text box to upper
case. How can I do this?
Thank you
|
by: csanjith |
last post by:
Hi, i have a situaion where i need to convert the characters entered in
an text field to upper case using C. The configuration id utf8
environment in which user can enter any character (single ,...
|
by: uday.sen |
last post by:
Hi,
I need to convert a string from UTF8 to wide character (wchar_t *). I
perform the same in windows using:
MultiByteToWideChar(CP_UTF8, 0, pInput, -1, pOutput, nLen);
However, in linux...
|
by: Tux SC |
last post by:
Hello,
I have a JavaScript function which receives as input a string which in
some cases contain non-UTF8 characters. The output of this function is
used by another utility which fails if it...
|
by: taylorcarr |
last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
|
by: ryjfgjl |
last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
|
by: emmanuelkatto |
last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud.
Please let me know.
Thanks!
Emmanuel
|
by: BarryA |
last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
|
by: Hystou |
last post by:
There are some requirements for setting up RAID:
1. The motherboard and BIOS support RAID configuration.
2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
|
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers,...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
| |