dividing 4 decimal places and receiving inaccurate results

  • Thread starter Thread starter Kelly
  • Start date Start date
K

Kelly

When I divide 229270/8.944% (.08944) the answer is
2,563,292 and on the calculator it is 2563394.45 a
difference of 102. Is there a patch or fix for this?
 
Yes on the calculator that is the answer. On the excel
spreadsheet (my excel 2002) it has 2,563,292 (rounded).
Did you do on calculator and excel spreadsheet? And do
you come up with the same answer?

Thanks for the reply, Kelly
 
In Excel I got this

2563394.45438283

which rounded to 2 decimals is

2563394.45

so that is correct

Excel 2002 here as well

Do you physically type in this or are you using

=A2/B2

then the value in the cells might differ even if they look the same
However to get this large difference over 100 sounds weird
 
Yes you are probably right it is pulling from another
sheet and I can go and check that area. It is a formula:
H16/$D$6

But H16 is pulled from or linked to another worksheet in
the book.

I took a quick look at the spreadsheet and I think it's
because all cells are pulled from various places.

Thanks I think that is the problem.

K
 
Kelly said:
When I divide 229270/8.944% (.08944) the answer is
2,563,292 and on the calculator it is 2563394.45 a
difference of 102. Is there a patch or fix for this?
Click to expand...

I wonder what you are doing? I set up 229270 in A1, 8.944% in B1 and
0.08944 in C1. A1/B1 gives exactly the same answer, 2563394.45, as
A1/C1. I am using Excel 2002.
 
Hi Kelly,
Yes there is a fix: display all your number to full precision.
If the denominator was not exactly 0.08944 but was in fact
0.0894435749029142
the answer is 2,2563,292
Bernard
 
Back
Top