Hi,
I'm having some troubles with my numeric-types in my VB.NET 2005
application, together with a SQL Server 2000.
- I first used Single in my application, and Decimal in my database. But a
Single with value 4.475 was converted to a Decimal with value
4.4749999999999996D. So after inserting and selecting it from the database I
got another value than the original!
- So I used also the Decimal in my application, but now all my numbers are
formatted with all the decimals: when my value is "1", it shows "1.0000". A
single value roudns it nicely to 1, but the decimal value shows the whole
decimal part, even when it isn't needed.
What I need is: the users should only see the decimal part when needed, AND
my values have to be the same (no 4.475 to 4.474999999999 changements).
This seems such a simple and basic need, but I just keep having troubles
with it :-(
What should I do/use? Another numeric datatype in my application? Another
datatype in my Database??
Any help/hints/links/information would be really appreciated!
Thansk a lot in advance,
Pieter
11  9877 
er, it depends
are the calculations that you are performing financial style calcs where
precision is everything? if so use Decimal. or are they scientific calcs
where you have a wide range of numbers that need ot be accurate to a a given
nummber of digits? (eg calculation of stresses in an engineering project) in
this case use Double. I wouldnt use Single unless... it is a leagacy app
being converted or you have REALLY big arrays and are tight on memory
dont worry about the formatting, that is trivial comapred with getting the
data right, you can sort it out later.
hth
guy
"Pieter" wrote: Hi,
I'm having some troubles with my numeric-types in my VB.NET 2005
application, together with a SQL Server 2000.
- I first used Single in my application, and Decimal in my database. But a
Single with value 4.475 was converted to a Decimal with value
4.4749999999999996D. So after inserting and selecting it from the database I
got another value than the original!
- So I used also the Decimal in my application, but now all my numbers are
formatted with all the decimals: when my value is "1", it shows "1.0000". A
single value roudns it nicely to 1, but the decimal value shows the whole
decimal part, even when it isn't needed.
What I need is: the users should only see the decimal part when needed, AND
my values have to be the same (no 4.475 to 4.474999999999 changements).
This seems such a simple and basic need, but I just keep having troubles
with it :-(
What should I do/use? Another numeric datatype in my application? Another
datatype in my Database??
Any help/hints/links/information would be really appreciated!
Thansk a lot in advance,
Pieter
Precision is indeed everything. Most of the time it are prices, weights,
heights etc. So it has to be exact.
And I do worry about the formatting, because when I show the decimal value
in a Textbox, it shows all the zeros after the decimal, and I don't want it
to do it. Especially in some cases where it contains most of the time whole
numbers (1, 2, 3, ...) and rarely 1.001 etc. So I don't want the user to be
seeing the whole time 1.0000, 2.0000, 3.0000, etc.
Basicly: I need exact precision, but without the zeros at the end.
How should I do that? there isn't a Format-property on the textbox...
"guy" <gu*@discussions.microsoft.com> wrote in message
news:52**********************************@microsof t.com... er, it depends
are the calculations that you are performing financial style calcs where
precision is everything? if so use Decimal. or are they scientific calcs
where you have a wide range of numbers that need ot be accurate to a a
given
nummber of digits? (eg calculation of stresses in an engineering project)
in
this case use Double. I wouldnt use Single unless... it is a leagacy app
being converted or you have REALLY big arrays and are tight on memory
dont worry about the formatting, that is trivial comapred with getting the
data right, you can sort it out later.
hth
guy
look at the overloads of Decimal.ToString
this one may help...
(it is the online version of Help) http://msdn.microsoft.com/library/de...ringtopic3.asp
hth
guy
"Pieter" wrote: Precision is indeed everything. Most of the time it are prices, weights,
heights etc. So it has to be exact.
And I do worry about the formatting, because when I show the decimal value
in a Textbox, it shows all the zeros after the decimal, and I don't want it
to do it. Especially in some cases where it contains most of the time whole
numbers (1, 2, 3, ...) and rarely 1.001 etc. So I don't want the user to be
seeing the whole time 1.0000, 2.0000, 3.0000, etc.
Basicly: I need exact precision, but without the zeros at the end.
How should I do that? there isn't a Format-property on the textbox...
"guy" <gu*@discussions.microsoft.com> wrote in message
news:52**********************************@microsof t.com... er, it depends
are the calculations that you are performing financial style calcs where
precision is everything? if so use Decimal. or are they scientific calcs
where you have a wide range of numbers that need ot be accurate to a a
given
nummber of digits? (eg calculation of stresses in an engineering project)
in
this case use Double. I wouldnt use Single unless... it is a leagacy app
being converted or you have REALLY big arrays and are tight on memory
dont worry about the formatting, that is trivial comapred with getting the
data right, you can sort it out later.
hth
guy
Pieter,
I have the idea that you do not use precise but rounded decimal values.
Be aware that it uses Banking roundings as default. In version 2005 you can
as well use other roundings (as standard is used in the Benelux by
instance). I could not find the information on MSDN, so have a look for
yourself.
Cor
"Pieter" <pi**********@hotmail.com> schreef in bericht
news:Ot**************@TK2MSFTNGP10.phx.gbl... Precision is indeed everything. Most of the time it are prices, weights,
heights etc. So it has to be exact.
And I do worry about the formatting, because when I show the decimal value
in a Textbox, it shows all the zeros after the decimal, and I don't want
it to do it. Especially in some cases where it contains most of the time
whole numbers (1, 2, 3, ...) and rarely 1.001 etc. So I don't want the
user to be seeing the whole time 1.0000, 2.0000, 3.0000, etc.
Basicly: I need exact precision, but without the zeros at the end.
How should I do that? there isn't a Format-property on the textbox...
"guy" <gu*@discussions.microsoft.com> wrote in message
news:52**********************************@microsof t.com... er, it depends
are the calculations that you are performing financial style calcs where
precision is everything? if so use Decimal. or are they scientific calcs
where you have a wide range of numbers that need ot be accurate to a a
given
nummber of digits? (eg calculation of stresses in an engineering project)
in
this case use Double. I wouldnt use Single unless... it is a leagacy app
being converted or you have REALLY big arrays and are tight on memory
dont worry about the formatting, that is trivial comapred with getting
the
data right, you can sort it out later.
hth
guy
Thanks, but this means that I have to change manually every numeric property
of my objects to a string? And that I can't anymore DataBind my controls
directly to the propertys of my objects? It seems a little bit a werid
solution for such a problem.
Why does a Single threats the trailing zeros right (cuts them off) but
doesn't have ap recision, and does a decimal the opposite?
Isn't there somehow a datatype that combines the two? I can't be the only
one with this problem????
"guy" <gu*@discussions.microsoft.com> wrote in message
news:16**********************************@microsof t.com... look at the overloads of Decimal.ToString
this one may help...
(it is the online version of Help)
http://msdn.microsoft.com/library/de...ringtopic3.asp
hth
guy
I did some test:
I used single in my application, and Float, Real, Decimal and Numeric in my
database.
The combination Single-float/Real works great, and give mle the exact
results that I wanted. Should I use this? Or is there some problem that I'm
not seeing?
It doesn't round the precision, and it cuts off the trailing zeroes...
"Pieter" <pi**********@hotmail.com> wrote in message
news:uu**************@TK2MSFTNGP11.phx.gbl... Hi,
I'm having some troubles with my numeric-types in my VB.NET 2005
application, together with a SQL Server 2000.
- I first used Single in my application, and Decimal in my database. But a
Single with value 4.475 was converted to a Decimal with value
4.4749999999999996D. So after inserting and selecting it from the database
I got another value than the original!
- So I used also the Decimal in my application, but now all my numbers are
formatted with all the decimals: when my value is "1", it shows "1.0000".
A single value roudns it nicely to 1, but the decimal value shows the
whole decimal part, even when it isn't needed.
What I need is: the users should only see the decimal part when needed,
AND my values have to be the same (no 4.475 to 4.474999999999
changements).
This seems such a simple and basic need, but I just keep having troubles
with it :-(
What should I do/use? Another numeric datatype in my application? Another
datatype in my Database??
Any help/hints/links/information would be really appreciated!
Thansk a lot in advance,
Pieter
another thing to consider...
in one project i have developed, i built a set of structuers - Distance,
Area, volume, Weight etc. which wrapped a double (you could equally well use
a decimal) with appropriate overloads and formatting. It sounds a lot of work
but more than paid for itself in functionality and ensuring correct variable
usage.
"Pieter" wrote: Thanks, but this means that I have to change manually every numeric property
of my objects to a string? And that I can't anymore DataBind my controls
directly to the propertys of my objects? It seems a little bit a werid
solution for such a problem.
Why does a Single threats the trailing zeros right (cuts them off) but
doesn't have ap recision, and does a decimal the opposite?
Isn't there somehow a datatype that combines the two? I can't be the only
one with this problem????
"guy" <gu*@discussions.microsoft.com> wrote in message
news:16**********************************@microsof t.com... look at the overloads of Decimal.ToString
this one may help...
(it is the online version of Help)
http://msdn.microsoft.com/library/de...ringtopic3.asp
hth
guy
Ok, thanks for the help on this issue.
So if I am right I should define my propertys like this:
Public Property FraisEmballageOriginal() As Decimal
Get
Return m_decFraisEmballageOriginal.ToString("0.##")
End Get
"guy" <gu*@discussions.microsoft.com> wrote in message
news:FA**********************************@microsof t.com... another thing to consider...
in one project i have developed, i built a set of structuers - Distance,
Area, volume, Weight etc. which wrapped a double (you could equally well
use
a decimal) with appropriate overloads and formatting. It sounds a lot of
work
but more than paid for itself in functionality and ensuring correct
variable
usage.
Pieter wrote: Hi,
I'm having some troubles with my numeric-types in my VB.NET 2005
application, together with a SQL Server 2000.
- I first used Single in my application, and Decimal in my database.
Use the same type to process and store floating numbers, otherwise you
will multiply loss of precision.
Single numbers are "float", and uses base 2, that is it can represent
multiples of halves without precision loss (upto the precision limits).
Decimal is base10 and can represent decimal-numbers without loss (upto
the precision limit).
Single with value 4.475 was converted to a Decimal with value
4.4749999999999996D. So after inserting and selecting it from the database I
got another value than the original!
Actually what happened is that Signgle (float) cannot represent 4.475
without loss, it becomes a bit-pattern which represents
4.4749999999999996. So the conversion to decimal does not loose
precision, the use of float to represent base10 numbers does.
If you format 4.475 as: (4.475).ToString("##.###") you *will* get 4.475,
since the presentation will do rounding.
- So I used also the Decimal in my application, but now all my numbers are
formatted with all the decimals: when my value is "1", it shows "1.0000". A
single value roudns it nicely to 1, but the decimal value shows the whole
decimal part, even when it isn't needed.
You should look into how the numbers are presented to the user. Have a
look at ToString(format) and NumberFormatInfo.
What I need is: the users should only see the decimal part when needed, AND
my values have to be the same (no 4.475 to 4.474999999999 changements).
That can be done with Decimal, which can represent base10 without loss
of precision. beware you you may stil inadvertently generate numbers
which does *not* have representation without loss in base 10, for
example by division.
This seems such a simple and basic need, but I just keep having troubles
with it :-(
floating-point precision numbers are not "reals" as in math, they do not
have infinite precision, that's the problem here.
What should I do/use? Another numeric datatype in my application? Another
datatype in my Database??
Decimal all-round if your *really* need the precision (not just as
4.475), otherwise just use the same in app and databse. And learn to
format the numbers presented to the users, have a look at ToString with
formatting arguments and the string-conversions in string.Format.
Whatever you do, dont start using strings to represent numbers in your
calculations and interface, that won't help you.
--
Helge Jensen
mailto:he**********@slog.dk
sip:he**********@slog.dk
-=> Sebastian cover-music: http://ungdomshus.nu <=-
Hello, Pieter,
It is important to realize that you cannot represent all decimal
fractions exactly with a floating point variable. (It is a little like
trying to represent a number like 2/3 exactly as a decimal number with a
fixed number of decimal places. You can write 0.66667, or you can write
0.66666666667. But neither is precisely correct. There is always some
"round-off error".
For measurements such as weights and heights this is not normally a
problem. The "accuracy" of the measurement is usually less than the
precision of the variable used to store it. (Note there is an important
distinction between accuracy and precision.) Floating point is
typically the best choice for these values, as it provides the
possibility for a very wide range of values.
However, currency values are typically considered to be exact, and so
the "round-off error" that is normal with Single and Double precision
floating point values is a problem. You should use Decimal for these
numbers. Usually with currency values, you want to always display the
same number of places following the decimal, even if they are zero.
I.e. If an amount is Euros, Dollars, Pounds, Kronar, etc. I think it
would be unusual to display 12.22 in one case and 12.2 in another
(instead of 12.20).
Anyway, I wonder if your observation that: The combination Single-float/Real works great, and give mle the exact
results that I wanted.
is a result of simply having chosen values that can be represented
exactly in floating point, and that if you experimented further you
might find that you again see values like "4.4749999999999996D" instead
of the "4.475" that you hope to see.
Cheers,
Randy
Pieter wrote:
I did some test:
I used single in my application, and Float, Real, Decimal and Numeric in my
database.
The combination Single-float/Real works great, and give mle the exact
results that I wanted. Should I use this? Or is there some problem that I'm
not seeing?
It doesn't round the precision, and it cuts off the trailing zeroes...
"Pieter" <pi**********@hotmail.com> wrote in message
news:uu**************@TK2MSFTNGP11.phx.gbl...
Hi,
I'm having some troubles with my numeric-types in my VB.NET 2005
application, together with a SQL Server 2000.
- I first used Single in my application, and Decimal in my database. But a
Single with value 4.475 was converted to a Decimal with value
4.4749999999999996D. So after inserting and selecting it from the database
I got another value than the original!
- So I used also the Decimal in my application, but now all my numbers are
formatted with all the decimals: when my value is "1", it shows "1.0000".
A single value roudns it nicely to 1, but the decimal value shows the
whole decimal part, even when it isn't needed.
What I need is: the users should only see the decimal part when needed,
AND my values have to be the same (no 4.475 to 4.474999999999
changements).
This seems such a simple and basic need, but I just keep having troubles
with it :-(
What should I do/use? Another numeric datatype in my application? Another
datatype in my Database??
Any help/hints/links/information would be really appreciated!
Thansk a lot in advance,
Pieter
Pieter,
the key is to separate what you display to the operator and the actual value
in your classes.
use the data type of your choice in the class, but build a formatting method
to present it to the operator that does not interfere with applicationss
internals
"Pieter" wrote: Ok, thanks for the help on this issue.
So if I am right I should define my propertys like this:
Public Property FraisEmballageOriginal() As Decimal
Get
Return m_decFraisEmballageOriginal.ToString("0.##")
*** this wont work, the data type is decimal so you cant return a string *** End Get
"guy" <gu*@discussions.microsoft.com> wrote in message
news:FA**********************************@microsof t.com... another thing to consider...
in one project i have developed, i built a set of structuers - Distance,
Area, volume, Weight etc. which wrapped a double (you could equally well
use
a decimal) with appropriate overloads and formatting. It sounds a lot of
work
but more than paid for itself in functionality and ensuring correct
variable
usage.
This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics
by: Peter Blatt |
last post by:
Does 5 represent the total numer of digits (including the fractional portion) or only the number of places
BEFORE the decimal point? Moreover does the number include the decimal point?
Are there...
|
by: Tariq |
last post by:
I've a SQL view performing a number of very precise calculations ie.
495/(1.112 - (.00043499*((Col1 + Col2 + Col3))) + ( .00000055 * ((Col1
+ Col2 + Col3)) * ((Col1 + Col2 + Col3))) - (.00028826...
|
by: Mark |
last post by:
I have a Decimal or a Double - your choice. I'd like to print the number as
string with a specified number of decimal places. Let's say my number
110.5, and I'd like to capture it in a string...
|
by: Steve Richter |
last post by:
I have having a hard time getting the numeric columns in my sql tables
to map correctly to .NET. I have a price and a cost column in a
table. What is the most .NET friendly way to declare those...
|
by: Amaryllis |
last post by:
Hi again,
I'm new to the world of communicating between VB.NET and AS/400, so
I've been posting a lot of questions lately since no one else in the
company has done anything like this before. ...
|
by: FAQ server |
last post by:
-----------------------------------------------------------------------
FAQ Topic - How do I convert a Number into a String with
exactly 2 decimal places?...
|
by: =?Utf-8?B?UmljaA==?= |
last post by:
Is there a way to determine if a numeric value contains a decimal? how to do
this?
If IsNumeric(txt1.Text) then ... so now I know that txt1.Text is a numeric
value. How can I tell if it is a...
|
by: Andrus |
last post by:
I have lot of columns in database like
Price Numeric(5,2)
Street Character(30)
For UI display and validation I need to retrieve width and for numeric
properties, decimal places of ...
|
by: Andrus |
last post by:
How to create format string for decimal data type
which shows blank for zero and default format otherwize ?
I tried format string "f;f;#" but this shows f for nonzero numbers.
Andrus.
...
|
by: Terry Reedy |
last post by:
Gerhard Häring wrote:
The new fractions module acts differently, which is to say, as most
would want.
True
Traceback (most recent call last):
File "<pyshell#20>", line 1, in <module>
F(1.0)...
|
by: Charles Arthur |
last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
|
by: emmanuelkatto |
last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud.
Please let me know.
Thanks!
Emmanuel
|
by: nemocccc |
last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
|
by: Sonnysonu |
last post by:
This is the data of csv file
1 2 3
1 2 3
1 2 3
1 2 3
2 3
2 3
3
the lengths should be different i have to store the data by column-wise with in the specific length.
suppose the i have to...
|
by: Hystou |
last post by:
There are some requirements for setting up RAID:
1. The motherboard and BIOS support RAID configuration.
2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...
| |
