FAQ Topic - Why does simple decimal arithmetic give strange results?

[FAQ server]

-----------------------------------------------------------------------
FAQ Topic - Why does simple decimal arithmetic give strange
results?
-----------------------------------------------------------------------

For example, 5*1.015 does not give exactly 5.075 and 0.06+0.01 does
not give exactly 0.07 in javascript.

Javascript numbers are represented in binary as IEEE-754 (IEC 559)
Doubles, with a resolution of 53 bits, giving an accuracy of
15-16 decimal digits; integers up to about 9e15 are precise, but
few decimal fractions are. Given this, arithmetic is as exact
as possible, but no more. Operations on integers are exact if
the true result and all intermediates are integers within that
range.

In particular, non-integer results should not normally be
compared for equality; and non-integer computed results
commonly need rounding; see 4.6.

http://msdn.microsoft.com/library/de...6dbf483b41.asp
===
Postings such as this are automatically sent once a day. Their
goal is to answer repeated questions, and to offer the content to
the community for continuous evaluation/improvement. The complete
comp.lang.javas cript FAQ is at http://jibbering.com/faq/index.html.
The FAQ workers are a group of volunteers.

[Dr J R Stockton]

In comp.lang.javas cript message <46************ ***********@new s.sunsite.
dk>, Wed, 15 Aug 2007 23:00:01, FAQ server <ja********@dot internet.be>
posted:

>
For example, 5*1.015 does not give exactly 5.075 and 0.06+0.01 does
not give exactly 0.07 in javascript.

True; but "exactly 0.07" is ambiguous. How best can we state, briefly
BOTH that (0.06+0.01).toS tring() -"0.069999999999 99999"
AND that (0.06+0.01) - 0.07 != 0.0 // ??

The recent short list of FAQ changes has an error.

--
(c) John Stockton, Surrey, UK. ?@merlyn.demon. co.uk Turnpike v6.05 MIME.
Web <URL:http://www.merlyn.demo n.co.uk/- FAQish topics, acronyms, & links.
Proper <= 4-line sig. separator as above, a line exactly "-- " (SonOfRFC1036)
Do not Mail News to me. Before a reply, quote with ">" or "" (SonOfRFC1036)

[John Hosking]

Dr J R Stockton wrote:

>
The recent short list of FAQ changes has an error.

Well, you're about as helpful as a government employee.

--
John Hosking

[Randy Webb]

Dr J R Stockton said the following on 8/16/2007 4:27 PM:

In comp.lang.javas cript message <46************ ***********@new s.sunsite.
dk>, Wed, 15 Aug 2007 23:00:01, FAQ server <ja********@dot internet.be>
posted:

>For example, 5*1.015 does not give exactly 5.075 and 0.06+0.01 does
not give exactly 0.07 in javascript.

True; but "exactly 0.07" is ambiguous. How best can we state, briefly
BOTH that (0.06+0.01).toS tring() -"0.069999999999 99999"
AND that (0.06+0.01) - 0.07 != 0.0 // ??

The recent short list of FAQ changes has an error.

Well, are you going to tell what the error was or simply mention it and
want someone to beg you to disclose what you think the error was?

--
Randy
Chance Favors The Prepared Mind
comp.lang.javas cript FAQ - http://jibbering.com/faq/index.html
Javascript Best Practices - http://www.JavascriptToolbox.com/bestpractices/