aspose.cells
Class CalculationPrecisionStrategy

Utility class containing constants. Enumerates strategies for handling calculation precision. Because of the precision issue of IEEE 754 Floating-Point Arithmetic, some "seemingly simple" formulas may not be calcualted as the expected result. Such as formula "=-0.45+0.43+0.02", when calcuating operands by '+' operator directly, the result is not zero. For such kind of precision issue, some special strategies may give the expected result.

Field Summary
const  NumberNONE
           No strategy applied on calculation. When calculating just use the original double value as operand and return the result directly. Most efficient for performance and applicable for most cases.
const  NumberROUND
           Rounds the calculation result according with significant digits.
const  NumberDECIMAL
           Uses decimal as operands when possible. Most inefficient for performance.
 

Field Detail

NONE

const Number NONE
No strategy applied on calculation. When calculating just use the original double value as operand and return the result directly. Most efficient for performance and applicable for most cases.

ROUND

const Number ROUND
Rounds the calculation result according with significant digits.

DECIMAL

const Number DECIMAL
Uses decimal as operands when possible. Most inefficient for performance.
See Also:
          Aspose.Cells Documentation - the home page for the Aspose.Cellss Product Documentation.
          Aspose.Cells Support Forum - our preferred method of support.

We guarantee a prompt response to any inquiry!

© 2003-2017 Aspose Pty Ltd. All rights reserved.