Excel 's precision problem

  • Thread starter Thread starter chenj
  • Start date Start date
C

chenj

Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!


Some one who know the detail??


Thank you !
 
chenj said:
Now I found Excel' precision is not very hign !
May be there is some problem in some Excel funcion's
implemention.ex:
in Excel :gammaln(4)=1.79175946908210000
but it is 1.791759469228055 in MATLAB and Mathematica !!
Same problem in function erf(),and so on!
Click to expand...

According to my version of excel (2000) it evaluates to:

1.7917594690821

Numerically equal to your quoted value of 1.79175946908210000 but
without the implicit level of precision that your trailing zeros might
carry.

I guess that you have to accept that it is only correct to 9 d.p.or 10
s.f. If you need more precision that that, you probably need to stick
to dedicated apps.

Alan.
 
Hi Chenj / Chengj

chengj said:
hi
I don't know what you said.
would you told me more!

Thank you !
Click to expand...

Which part did you not understand?

Essentially, I am saying that excel is not a high precision
mathematical application.

If you need that level of precision, I think you'll need to use a
different tool.

Other opinions are welcome!

Alan.
 
Back
Top