German "Umlaute" in QueryString

[Uwe Braunholz]

Hello,

working on a asp.net Website brought me to a strange problem.

I want to enable my users to pass a search string via the query string
of an url.

It works if the user calls the URL like "default.aspx?s earch=mystring"
But as soon as a German umlaut is in the query string it does not
handle the char correctly (like "default.aspx?s earch=müstring " will be
displayed as "m?string" on the page).

I notice that firefox converts the URL automatically to:
?search=m%FCstr ing
using the debugger results in:
Request.QuerySt ring = {search=m%ufffd string}
the display as label is:
m�string

If I call the page from another asp.net page using
Response.Redire ct("Default.asp x?search=" +
Server.UrlEncod e("müstring")) ;
the result is corretly, but the URL is changed to:
?search=m%c3%bc string
debugging results in
Request.QuerySt ring = {search=m%u00fc string}

The problem is, that the users will call the URL from different
applications (not necessarily .NET) so Server.URLEncod e will never be
called so the first case will occur.

How can I solve this?

Thank you!
Regards,
Uwe

[Sriram Srivatsan]

Needs to be treated as unicode. Look at requestEncoding , responseEncodin g
and the related configuration entries in MSDN under globalization node in
the web.config file. May throw some light.
"Uwe Braunholz" <uw***********@ hotmail.dewrote in message
news:d9******** *************** ***********@79g 2000hsk.googleg roups.com...
Hello,

working on a asp.net Website brought me to a strange problem.

I want to enable my users to pass a search string via the query string
of an url.

It works if the user calls the URL like "default.aspx?s earch=mystring"
But as soon as a German umlaut is in the query string it does not
handle the char correctly (like "default.aspx?s earch=müstring" will be
displayed as "m?string" on the page).

I notice that firefox converts the URL automatically to:
?search=m%FCstr ing
using the debugger results in:
Request.QuerySt ring = {search=m%ufffd string}
the display as label is:
m?string

If I call the page from another asp.net page using
Response.Redire ct("Default.asp x?search=" +
Server.UrlEncod e("müstring") );
the result is corretly, but the URL is changed to:
?search=m%c3%bc string
debugging results in
Request.QuerySt ring = {search=m%u00fc string}

The problem is, that the users will call the URL from different
applications (not necessarily .NET) so Server.URLEncod e will never be
called so the first case will occur.

How can I solve this?

Thank you!
Regards,
Uwe

[Uwe Braunholz]

Hello Sriram,
thank you for your answer. I thougth so too, but the default seems to
be utf-8. If I set
<globalizatio n requestEncoding ="UTF-8" responseEncodin g="UTF-8" />
in web.config, nothing changes. Only if I set a different encoding
like "ISO-8859-1". But what if another user enters some greek, russian
or chinese characters?

I think fixing my application to a specific encoding is not a good
idea. I thought utf8 would be the choice for that?

Regards,
Uwe

On 11 Aug., 12:00, "Sriram Srivatsan" <sriramsrivat.. [e-mail]>
wrote:

Needs to be treated as unicode. *Look at requestEncoding , responseEncodin g
and the related configuration entries in MSDN under globalization node in
the web.config file. May throw some light.

"Uwe Braunholz" <uwe.braunh...@ hotmail.dewrote in message

news:d9******** *************** ***********@79g 2000hsk.googleg roups.com...
Hello,

working on a asp.net Website brought me to a strange problem.

I want to enable my users to pass a search string via the query string
of an url.

It works if the user calls the URL like "default.aspx?s earch=mystring"
But as soon as a German umlaut is in the query string it does not
handle the char correctly (like "default.aspx?s earch=müstring" will be
displayed as "m?string" on the page).

I notice that firefox converts the URL automatically to:
?search=m%FCstr ing
using the debugger results in:
Request.QuerySt ring = {search=m%ufffd string}
the display as label is:
m?string

If I call the page from another asp.net page using
Response.Redire ct("Default.asp x?search=" +
Server.UrlEncod e("müstring") );
the result is corretly, but the URL is changed to:
?search=m%c3%bc string
debugging results in
Request.QuerySt ring = {search=m%u00fc string}

The problem is, that the users will call the URL from different
applications (not necessarily .NET) so Server.URLEncod e will never be
called so the first case will occur.

How can I solve this?

Thank you!
Regards,
Uwe

[Alexey Smirnov]

On Aug 11, 11:44*am, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello,

working on a asp.net Website brought me to a strange problem.

I want to enable my users to pass a search string via the query string
of an url.

It works if the user calls the URL like "default.aspx?s earch=mystring"
But as soon as a German umlaut is in the query string it does not
handle the char correctly (like "default.aspx?s earch=müstring" will be
displayed as "m?string" on the page).

I notice that firefox converts the URL automatically to:
?search=m%FCstr ing
using the debugger results in:
Request.QuerySt ring = {search=m%ufffd string}
the display as label is:
m string

If I call the page from another asp.net page using
Response.Redire ct("Default.asp x?search=" +
Server.UrlEncod e("müstring") );
the result is corretly, but the URL is changed to:
?search=m%c3%bc string
debugging results in
Request.QuerySt ring = {search=m%u00fc string}

The problem is, that the users will call the URL from different
applications (not necessarily .NET) so Server.URLEncod e will never be
called so the first case will occur.

How can I solve this?

Thank you!
Regards,
Uwe

Hallo Uwe,

generally all umlauts must be encoded (as UTF-8 in your case).

So, if your search string value is from the Search textbox, you have
to encode it as

string search = HttpUtility.Url Encode(SearchTe xtBox.Text,
Encoding.UTF8)) ;
Response.Redire ct("default.asp x?search=" + search);

this would redirect you to default.aspx?se arch=m%c3%bcstr ing

In this case you would not have any problem to get the value using
HttpUtility.Url Decode() function...

If you want to get umlauts out of the "default.aspx?s earch=müstring"
use RawUrl:

string search = Request.RawUrl. Split('=')[1];

and then search would return you "müstring". ..

To handle both requests

default.aspx?se arch=m%c3%bcstr ing
default.aspx?se arch=müstring

use

string search = Request.RawUrl. Split('=')[1];
string newsearch = HttpUtility.Url Decode(search);

[Uwe Braunholz]

Hello Alexey,

thank you for your reply. Unfortunately even the RawUrl does not give
me the real (intended) URL-string. There still is a ? instead of the
"ü".
Debugging says
Request.QuerySt ring = {search=m%ufffd string}
Request.RawUrl = "/WebSite2/Default.aspx?se arch=m�string "

The problem is that I do not have any control over the search-source.
This could be any application where the url is put together
automatically.

Regards,
Uwe

On 11 Aug., 13:37, Alexey Smirnov <alexey.smir... @gmail.comwrote :

On Aug 11, 11:44Â*am, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello,

working on a asp.net Website brought me to a strange problem.

I want to enable my users to pass a search string via the query string
of an url.

It works if the user calls the URL like "default.aspx?s earch=mystring"
But as soon as a German umlaut is in the query string it does not
handle the char correctly (like "default.aspx?s earch=müstring " will be
displayed as "m?string" on the page).

I notice that firefox converts the URL automatically to:
?search=m%FCstr ing
using the debugger results in:
Request.QuerySt ring = {search=m%ufffd string}
the display as label is:
m string

If I call the page from another asp.net page using
Response.Redire ct("Default.asp x?search=" +
Server.UrlEncod e("müstring")) ;
the result is corretly, but the URL is changed to:
?search=m%c3%bc string
debugging results in
Request.QuerySt ring = {search=m%u00fc string}

The problem is, that the users will call the URL from different
applications (not necessarily .NET) so Server.URLEncod e will never be
called so the first case will occur.

How can I solve this?

Thank you!
Regards,
Uwe

Hallo Uwe,

generally all umlauts must be encoded (as UTF-8 in your case).

So, if your search string value is from the Search textbox, you have
to encode it as

string search = HttpUtility.Url Encode(SearchTe xtBox.Text,
Encoding.UTF8)) ;
Response.Redire ct("default.asp x?search=" + search);

this would redirect you to default.aspx?se arch=m%c3%bcstr ing

In this case you would not have any problem to get the value using
HttpUtility.Url Decode() function...

If you want to get umlauts out of the "default.aspx?s earch=müstring "
use RawUrl:

string search = Request.RawUrl. Split('=')[1];

and then search would return you "müstring" ...

To handle both requests

default.aspx?se arch=m%c3%bcstr ing
default.aspx?se arch=müstring

use

string search = Request.RawUrl. Split('=')[1];
string newsearch = HttpUtility.Url Decode(search);

[Alexey Smirnov]

On Aug 11, 3:10*pm, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello Alexey,

thank you for your reply. Unfortunately even the RawUrl does not give
me the real (intended) URL-string. There still is a ? instead of the
"ü".
Debugging says
Request.QuerySt ring = {search=m%ufffd string}
Request.RawUrl = "/WebSite2/Default.aspx?se arch=m string"

Well, but where did you get the "m%ufffdstring" ?

%ufff is wrong there... you can simply check it by typing "müstring"
in google. When UTF8 is used you will see that url is encoded as "m
%C3%BCstring"

http://www.google.com/search?hl=en&q=m%C3%BCstring

and not

http://www.google.com/search?hl=en&q=m%25ufffdstring

[Uwe Braunholz]

Hello Alexey,

the "m%ufffdstr ing" appears, if I hover the variable in my Visual
Studio 2005 with my mouse.

Regards,
Uwe

On 11 Aug., 17:05, Alexey Smirnov <alexey.smir... @gmail.comwrote :

On Aug 11, 3:10*pm, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello Alexey,

thank you for your reply. Unfortunately even the RawUrl does not give
me the real (intended) URL-string. There still is a ? instead of the
"ü".
Debugging says
Request.QuerySt ring = {search=m%ufffd string}
Request.RawUrl = "/WebSite2/Default.aspx?se arch=m string"

Well, but where did you get the "m%ufffdstring" ?

%ufff is wrong there... you can simply check it by typing "müstring"
in google. When UTF8 is used you will see that url is encoded as "m
%C3%BCstring"

http://www.google.com/search?hl=en&q=m%C3%BCstring

and not

http://www.google.com/search?hl=en&q=m%25ufffdstring

[Uwe Braunholz]

Ok, I think the problem is about that:
http://www.captain.at/howto-php-urle...IComponent.php

Assuming, I will never be able to pass a regular ü to the server by
simply put it into the url:
The Server.UrlEncod e converts ü to %C3%BC
But my browsers convert ü to %FC
Why is this? How do I know what I will get on the serverside?

Regards,
Uwe

On 11 Aug., 17:05, Alexey Smirnov <alexey.smir... @gmail.comwrote :

On Aug 11, 3:10*pm, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello Alexey,

thank you for your reply. Unfortunately even the RawUrl does not give
me the real (intended) URL-string. There still is a ? instead of the
"ü".
Debugging says
Request.QuerySt ring = {search=m%ufffd string}
Request.RawUrl = "/WebSite2/Default.aspx?se arch=m string"

Well, but where did you get the "m%ufffdstring" ?

%ufff is wrong there... you can simply check it by typing "müstring"
in google. When UTF8 is used you will see that url is encoded as "m
%C3%BCstring"

http://www.google.com/search?hl=en&q=m%C3%BCstring

and not

http://www.google.com/search?hl=en&q=m%25ufffdstring

[Alexey Smirnov]

On Aug 12, 8:03*am, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Ok, I think the problem is about that:http://www.captain.at/howto-php-urle...codeURICompone...

Assuming, I will never be able to pass a regular ü to the server by
simply put it into the url:
The Server.UrlEncod e converts ü to %C3%BC
But my browsers convert ü to %FC
Why is this? How do I know what I will get on the serverside?

Regards,
Uwe

On 11 Aug., 17:05, Alexey Smirnov <alexey.smir... @gmail.comwrote :

On Aug 11, 3:10*pm, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello Alexey,

thank you for your reply. Unfortunately even the RawUrl does not give
me the real (intended) URL-string. There still is a ? instead of the
"ü".
Debugging says
Request.QuerySt ring = {search=m%ufffd string}
Request.RawUrl = "/WebSite2/Default.aspx?se arch=m string"

Well, but where did you get the "m%ufffdstring" ?

%ufff is wrong there... you can simply check it by typing "müstring"
in google. When UTF8 is used you will see that url is encoded as "m
%C3%BCstring"

http://www.google.com/search?hl=en&q=m%C3%BCstring

and not

http://www.google.com/search?hl=en&q=m%25ufffdstring- Hide quoted text -

- Show quoted text -

Uwe,

you used Firefox 2 to get the "ü" converted into "%FC", right? While
FF2 sends it by default in ISO-8859-1, FF3 and IE send it in UTF-8 and
that means that you cannot get "ü" working in FF2 only. But in FF2 you
can change this behavior too. Go to about:config, and set
"network.standa rd-url.encode-utf8" parameter to true.

If you want to make umlauts working in all browsers I guess you would
need to check if letter has 1 or 2 bytes encoded. But the easiest way
is probably to use a function as the one below:

string convertLetters( string s)
{
string[] oldchars = new string[] {"%FC","%C3%BC" , ...};
string[] newchars = new string[] {"ü","ü", "ä", "ö"...};

for (i==0;i<oldchar s.length();i++)
{
if (s.indexOf(oldc hars[i])>-1)
{
s = s.replace(oldch ars[i],newchars[i]);
}
}

return s;
}

[Uwe Braunholz]

Hello Alexey,

thanks for keeping up on this!
I am using FF3, but the settings was false, so I assume the behavior
did not change. As I switched to true, it worked.
On my testmachine I use IE6 as well, and this one does not seem to use
UTF8 also, because the result is the same.

How could I check if the string is encoded with one or two bytes?

Regards,
uwe

On 12 Aug., 09:34, Alexey Smirnov <alexey.smir... @gmail.comwrote :

On Aug 12, 8:03*am, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Ok, I think the problem is about that:http://www.captain.at/howto-php-urle...codeURICompone...

Assuming, I will never be able to pass a regular ü to the server by
simply put it into the url:
The Server.UrlEncod e converts ü to %C3%BC
But my browsers convert ü to %FC
Why is this? How do I know what I will get on the serverside?

Regards,
Uwe

On 11 Aug., 17:05, Alexey Smirnov <alexey.smir... @gmail.comwrote :

On Aug 11, 3:10*pm, Uwe Braunholz <uwe.braunh...@ hotmail.dewrote :

Hello Alexey,

thank you for your reply. Unfortunately even the RawUrl does not give
me the real (intended) URL-string. There still is a ? instead of the
"ü".
Debugging says
Request.QuerySt ring = {search=m%ufffd string}
Request.RawUrl = "/WebSite2/Default.aspx?se arch=m string"

Well, but where did you get the "m%ufffdstring" ?

%ufff is wrong there... you can simply check it by typing "müstring"
in google. When UTF8 is used you will see that url is encoded as "m
%C3%BCstring"

>http://www.google.com/search?hl=en&q=m%C3%BCstring

and not

>http://www.google.com/search?hl=en&q...ffdstring-Hide quoted text -

- Show quoted text -

Uwe,

you used Firefox 2 to get the "ü" converted into "%FC", right? While
FF2 sends it by default in ISO-8859-1, FF3 and IE send it in UTF-8 and
that means that you cannot get "ü" working in FF2 only. But in FF2 you
can change this behavior too. Go to about:config, and set
"network.standa rd-url.encode-utf8" parameter to true.

If you want to make umlauts working in all browsers I guess you would
need to check if letter has 1 or 2 bytes encoded. But the easiest way
is probably to use a function as the one below:

string convertLetters( string s)
{
string[] oldchars = new string[] {"%FC","%C3%BC" , ...};
string[] newchars = new string[] {"ü","ü", "ä", "ö"...};

for (i==0;i<oldchar s.length();i++)
{
if (s.indexOf(oldc hars[i])>-1)
{
s = s.replace(oldch ars[i],newchars[i]);

}
}

return s;

}