Apache OpenOffice (AOO) Bugzilla – Issue 88972
XY (scatter) with large numbers goes wrong
Last modified: 2013-02-24 21:19:47 UTC
I was curious when I came across this document whether Calc had the same flaws as Excel: http://www.mis.coventry.ac.uk/~nhunt/pottel.pdf stdev is perfect in calc, but it goes wrong with the scatter plot: steps to reproduce: 1. create a new document with these numbers 10000000001 1000000000 10000000002 1000000000 10000000003 1000000000.9 10000000004 1000000001.1 10000000005 1000000001.01 10000000006 1000000000.99 10000000007 1000000001.1 10000000008 1000000001 10000000009 1000000000 10000000010 1000000000 2. create a new chart object with xy scatter 3. output is a plot with negative numbers? Expected: A good plot (see document, p. 7)
Confirm, the automatic sets wrong values to y-axis.
confirmed, reassign to IHA
Created attachment 53405 [details] example with wrong scaling
->iha: the patch is finished, please let me know your suggestions. Thanks!
Created attachment 53832 [details] patch_080515
@weiz, thanks for finding the root cause! Your patch does fix this problem. There is still a possibility to enhance the fix. Instead of switching only from sal_Int32 to sal_In64 we can use type double and function floor. Thus the fix will help for even more extreme values. I changed the code accordingly in CWS chart27.
Fixed in CWS chart27.
@Thomas, please verify in CWS chart27. For all old files including the attached one it is necessary to double click the chart once or update it otherwise (e.g. by pressing F9) to see the corrected rendering.
Seen ok in CWS chart27 -> verified
Seen ok in current master -> closed