An attempt to make it more clear: a cell value in a spreadsheet can either be accounted as a binary deputy / representand / approximation for a decimal value - decimal POV -, then the digits after the grid / granularity / precision capa of the bin datatype are wrong - I call them conversion artefacts, or as a bin value itself - binary POV, then all digits shown by gnumeric are correct, but the precision of in- and output is limited by the precision the available bits can hold.Īn example for a difference between both POV's: accounting the 17'th digit of IEEE doubles. Also I did! explicitely distinguish and explain how many digits are correct - from a decimal POV - with which version and in which ranges. 1.12.17? available, but AFAIK no 'long'.įor the request from I - tried to - keep my answer short, any internet search will lead you to gnumeric:, exploring from there you'll also find the development long version. add info i forgot: gnumeric requires Linux as OS, for Win there is an old ver. recheck carefully before putting in production!īe aware that Calc and Excel can't handle the additional precision and! will destroy it in files if saved with them. Looks as if the precision restriction doesn't hit at all ranges for the long version, thus you might have 19 digits safe between 1E-2 and 2^69 ( 590295810358705651700 ). ![]() decimal digits as long as the absolute values stay between 1E-4932 and 1E+4932. It allows reliably storing 18 and in most ranges 19 sig. If not the rarely used 'long double' version can help you out. If you can keep your data outside these ranges you are done. ![]() It also has capa to work with Calc *.ods or Excel *.xls(x) files :-)īe aware that the precision and thus the amount of correct digits still depends on the IEEE datatype in use, and with the standard 'double' version is limited to 16 significant digits in most ranges while only 15! in the binary ranges below a 'power of ten range border', e.g. GNOME ' gnumeric' instead of LibreOffice Calc or Microsoft Excel let's you display more digits.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |