[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]
Subject: [OASIS Issue Tracker] (ODATA-784) Need to specify the behaviour of arithmetic operators on Decimal type
[ https://issues.oasis-open.org/browse/ODATA-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=58652#comment-58652 ] Evan Ireland commented on ODATA-784: ------------------------------------ Since decimals are frequently used to avoid problems with rounding, it is best to avoid unexpected behaviour. Suppose an implementation has maximum precision of 5 (just for the purpose of example, rathe it might be 28/29/34/36 etc). Now consider 1.0 div 3. Is it 0.3 (my proposal) or 0.33333 ("sufficient scale"). In regard to a filter, (A div 3) gt 0.3. Is it true or false when A = 1.0? Rounding rules need to be highly predictable with decimal. > Need to specify the behaviour of arithmetic operators on Decimal type > --------------------------------------------------------------------- > > Key: ODATA-784 > URL: https://issues.oasis-open.org/browse/ODATA-784 > Project: OASIS Open Data Protocol (OData) TC > Issue Type: Improvement > Components: OData URL Conventions > Affects Versions: V4.0_OS > Reporter: Evan Ireland > Priority: Minor > Fix For: V4.0_ERRATA03 > > > The rules for scale of results of decimal arithmetic operators are not specified. -- This message was sent by Atlassian JIRA (v6.2.2#6258)
[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index] | [List Home]