Floating Point Calculation Problem

  • Thread starter Thread starter Guest
  • Start date Start date
G

Guest

Hello,

In an application that worked fine until recently I have started to have
problems with calculations involving two doubles. For example: -24.708 +
26.0 = 1.2920000000000016, however, -24.708 + 8.0 = -16.708. What would
cause this? I don't think the numbers are so large that it would be the
usual floating point calculation error because of rounding. How can I fix
it? I'd rather not change every calcuation in my program to include a
math.round...

..Net Framework 1.1 version 1.1.4322 SP1
Visual Basic - Visual Studio .Net 2003
Windows XP

Thanks,
 
DJ said:
In an application that worked fine until recently I have started to have
problems with calculations involving two doubles. For example: -24.708 +
26.0 = 1.2920000000000016, however, -24.708 + 8.0 = -16.708. What would
cause this? I don't think the numbers are so large that it would be the
usual floating point calculation error because of rounding. How can I fix
it? I'd rather not change every calcuation in my program to include a
math.round...
Click to expand...

See http://www.pobox.com/~skeet/csharp/floatingpoint.html
 
DJ said:
Hello,

In an application that worked fine until recently I have started to have
problems with calculations involving two doubles. For example: -24.708 +
26.0 = 1.2920000000000016, however, -24.708 + 8.0 = -16.708. What would
cause this?
Click to expand...

I don't see a problem here. Why do you?
I don't think the numbers are so large that it would be the
usual floating point calculation error because of rounding.
Click to expand...

Who said size has anything at all to do with this calculation? Rounding
doesn't just happen for very large numbers. It happens for all of them.
How can I fix
it?
Click to expand...

Decimal datatype
 
Back
Top