From fd4df675dfe1012448285134082f61a0c03a7d15 Mon Sep 17 00:00:00 2001 From: dante Date: Sun, 25 Apr 2021 12:20:58 +0200 Subject: tdf#137679 Use Kahan summation for scmatrix operations MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit May also want implement Kahan sum in there: sc/source/core/tool/arraysumSSE2.cxx sc/source/core/inc/arraysumfunctor.hxx Under some conditions the sum of a pointer type vector may be perforemed by arraysumfunctor on NumericCellAccumulator. arraysumSSE2 implements part of it. This code has been left unmodified. Why the test has been modified: The error was: 238.89000000000001 != 238.89 | 17 th digit IEEE 754 double-precision has 53 log10(2) ≈ 15.955 digits. So it's just noise. Change-Id: I6f84826bf3875be4f444f5eb61854bc1f95769bb Reviewed-on: https://gerrit.libreoffice.org/c/core/+/114627 Reviewed-by: Mike Kaganski Tested-by: Jenkins --- solenv/clang-format/excludelist | 1 - 1 file changed, 1 deletion(-) (limited to 'solenv') diff --git a/solenv/clang-format/excludelist b/solenv/clang-format/excludelist index 99d83dcc8730..927c1ceb781a 100644 --- a/solenv/clang-format/excludelist +++ b/solenv/clang-format/excludelist @@ -8311,7 +8311,6 @@ sc/source/core/tool/interpr8.cxx sc/source/core/tool/jumpmatrix.cxx sc/source/core/tool/listenerquery.cxx sc/source/core/tool/lookupcache.cxx -sc/source/core/tool/matrixoperators.cxx sc/source/core/tool/navicfg.cxx sc/source/core/tool/numformat.cxx sc/source/core/tool/odffmap.cxx -- cgit