Issue 17509 - Incorrect rounding for integer values
Summary: Incorrect rounding for integer values
Status: CLOSED FIXED
Alias: None
Product: Calc
Classification: Application
Component: ui (show other issues)
Version: OOo 1.1 RC
Hardware: PC Windows 2000
: P3 Trivial (vote)
Target Milestone: ---
Assignee: oc
QA Contact: issues@sc
URL:
Keywords:
: 17511 21662 26152 (view as issue list)
Depends on:
Blocks:
 
Reported: 2003-07-28 14:52 UTC by andreschnabel
Modified: 2013-08-07 15:13 UTC (History)
4 users (show)

See Also:
Issue Type: DEFECT
Latest Confirmation in: ---
Developer Difficulty: ---

Attachments
A lot of integers displayed as float by CALC (901 bytes, text/plain)
2003-10-13 10:13 UTC, michaelis 		no flags Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this issue.
Description andreschnabel 2003-07-28 14:52:27 UTC 
In some cases, integer values are shown as floating point values in calc.
Try the following:
- open new calc document
- type 68451887 in cell A1
-> CALC will show 68451887,0000001 at the inputline

other candidates are: 73369888, 72169218 
this was found on 1.1 RC1 german, Win2k 
this could not be confiremd on 1.1 RC1 debian linux
Comment 1 daniel.rentz 2003-07-28 15:17:44 UTC 
confirmed in win xp
Comment 2 oc 2003-07-28 16:04:18 UTC 
Hi Eike,
one4you
Comment 3 oc 2003-07-28 16:04:36 UTC 
*** Issue 17511 has been marked as a duplicate of this issue. ***
Comment 4 Rainer Bielefeld 2003-07-28 17:04:27 UTC 
Please have a look to additional comments and testfile in  Issue 17511!

Rainer
Comment 5 hermann 2003-07-28 20:49:22 UTC 
same on W2K with RC2
Comment 6 hermann 2003-07-29 12:54:29 UTC 
some comments on this are at:
http://de.openoffice.org/servlets/ReadMsg?msgId=767662&listName=users
Comment 7 hermann 2003-07-29 13:40:06 UTC 
with OOo 1.0.3 it works well on Win NT4

BTW:
Could it be that the target for this is OOo 2.0 ? I think this is very
strange because nobody knows wether OOo calculates right values - or?
Comment 8 f_abels 2003-08-03 14:58:33 UTC 
Hello,

confirmed on a AMD 1700+, Win XP Home, SP1, OOo 1.1 RC (previous
installed and not uninstalled 1.1 Beta 2 and 1.0.3.1) all german versions.

Friedhelm
Comment 9 thomaskrumbein 2003-08-03 15:26:38 UTC 
confirmed on PC, Intel Pentium II, 350 MHz, Windows 98 SE, OOo 1.1 RC
confirmed on same machine, StarOffice 6.1 Beta 1
Comment 10 ooo 2003-08-22 19:18:48 UTC 
Doesn't occur on Solaris Sparc, nor on Linux x86, seems to be a
Windows compiler optimization problem, we already had another case of
this. And it is only the display string affected, the underlying value
is correct, so no need to worry about wrong calculations.

@Oliver: Should be a candidate for the next release OOo1.1.1/SO7PP1
Comment 11 oc 2003-09-01 09:46:52 UTC 
Target set to OOo 1.1.1
Comment 12 michaelis 2003-10-13 10:13:26 UTC 
Created attachment 10253 [details]
A lot of integers displayed as float by CALC
Comment 13 ooo 2003-10-24 18:39:11 UTC 
*** Issue 21662 has been marked as a duplicate of this issue. ***
Comment 14 ooo 2003-11-11 20:01:32 UTC 
Fixed on branch cws_srx645_pp1numfor:

sal/rtl/source/math.cxx  1.7.106.1
Comment 15 daniel.rentz 2003-11-12 10:14:26 UTC 
DR: code reviewed
Comment 16 ooo 2003-12-09 11:17:00 UTC 
Reassign to QA.
Comment 17 oc 2003-12-12 14:21:05 UTC 
adjusting resolution to fixed
Comment 18 oc 2003-12-12 14:23:19 UTC 
Verified in internal build cws_pp1numfor
Comment 19 oc 2004-01-30 10:51:58 UTC 
Fix will be available in the forthcoming OOo1.1.1
Comment 20 niklas.nebel 2004-03-05 13:49:51 UTC 
*** Issue 26152 has been marked as a duplicate of this issue. ***