I have a calculated column in a grid, the formula is simple: D = A - B - C
(D being the calculated column)
When the result should add up to zero, I get instead something like this: -2.8421709430404E-14
Is this a bug in the calc manager?
For example these numbers: 217.28 - 37.08 - 180.2 should return 0 but instead return the small scientific number above
EDIT: I am using version 2013.1
Talal,
I would have to know more about what you are doing to figure out what is causing this weird result that you are getting. Take a look at the sample application that I have attached and see if I am doing something very different from what you are doing.
What is the DataType of the columns that you are working with?
Sorry. Please look at the second attachment. This one will add up to zero in Column D. Let me know if you have questions.
I hope that works for you. Let me know if you need further assistance.
Michael,
Thanks for the reply, your example did work, I am using Double data types, I guess I should switch to Decimal since this error could be inherent in the Double type limitations.
http://stackoverflow.com/questions/1165761/decimal-vs-double-which-one-should-i-use-and-when