diff options
author | Winfried Donkers <winfrieddonkers@libreoffice.org> | 2019-03-26 16:27:09 +0100 |
---|---|---|
committer | Eike Rathke <erack@redhat.com> | 2019-03-28 23:18:37 +0100 |
commit | edcbe8c4e02a67c74ec6f85f28899431dbfa0765 (patch) | |
tree | 7ef3c50550daf2815b93d18af8446805b177b3de /include/test/callgrind.hxx | |
parent | e7d0785a7d2a07e64dc58dee4f1b072a72e32aa5 (diff) |
tdf#124286 fix annoying rounding error.
In case of ROUNDDOWN and ROUNDUP, it is possible that seemingly clear decimal
values are rounded unexpectedly (from the user's POV). This is caused by the i
decimal to binary to decimal conversions.
By rounding to 12 significanr digits before calling the round-down of -up
function, most of these unexpected roundings are eliminated.
Change-Id: Ia19181383b77e1ff40a067c4a1cea1ece0955871
Reviewed-on: https://gerrit.libreoffice.org/69762
Tested-by: Jenkins
Reviewed-by: Eike Rathke <erack@redhat.com>
Diffstat (limited to 'include/test/callgrind.hxx')
0 files changed, 0 insertions, 0 deletions