R
ReneMarxis
Hello
can someone explain me?
can someone explain me?
H
Herfried K. Wagner [MVP]
ReneMarxis said:
(Complete) Tutorial to Understand IEEE Floating-Point Errors
<URL:http://support.microsoft.com/?scid=kb;EN-US;42980>
IEEE Standard 754 Floating Point Numbers
<URL:http://steve.hollasch.net/cgindex/coding/ieeefloat.html>
C
Cor Ligthert[MVP]
Rebe
This is the standard behaviour of floating point values,
If it was not there would probably no decimal values, therefore use that
instead of doubles to solve your problem.
Cor
This is the standard behaviour of floating point values,
If it was not there would probably no decimal values, therefore use that
instead of doubles to solve your problem.
Cor
B
Bill McCarthy
Hi Rene,
Doubles are a non precision floating point number. For precision work with
decimal values use the Decimal type.
If working with Double (or Single) then consider using Round, Ceiling, Floor
etc to. To compare Double values you typically look for a value less than a
margin of error, e.g:
<Runtime.CompilerServices.Extension()> _
Function Approximates(ByVal left As Double, ByVal right As Double,
Optional ByVal maxDifference As Double = 0.000000001) As Boolean
Return Math.Abs(left - right) < maxDifference
End Function
Doubles are a non precision floating point number. For precision work with
decimal values use the Decimal type.
If working with Double (or Single) then consider using Round, Ceiling, Floor
etc to. To compare Double values you typically look for a value less than a
margin of error, e.g:
<Runtime.CompilerServices.Extension()> _
Function Approximates(ByVal left As Double, ByVal right As Double,
Optional ByVal maxDifference As Double = 0.000000001) As Boolean
Return Math.Abs(left - right) < maxDifference
End Function
R
ReneMarxis
Many thanks for your answers. Helped a lot. I ll use decimals as far
as i can starting from now
