MC or Intel precision?
miscdas at boxfrog.com
miscdas at boxfrog.com
Sun Aug 10 14:03:00 EDT 2003
miscdas at boxfrog.com writes:
> MisterX writes:
>
>>
>> Hi everyone,
>>
>> Is this megaproblem Windows only?
>>
>> put 2 ^ .5 = 1.414214
>> put pi = 3.14159265358979323846
>> put pi * 1 = 3.141593 --- ooops...
>> put 0.0005 * 0.0005 = 0
>>
>> Other than start writting out externals, is there a way to use "Real"
>> math precision?
>>
>> Like PI!
>> but avoiding put 10000000000000 * 0.0000001 * pi = 3141592.65359 which is
>> as precise as it gets workaround... ;)
>>
>> thanks for any suggestions
>> Xavier
> ===============
> Xavier,
>
> Did you try using the Format function to define the output format? Check
> the dictionary.
>
> miscdas
>
===============
Oddly enough, even these two give different amounts of precision on Win XP
Pro MC2.5:
put pi
put format("%0.20f", pi)
3.14159265358979323846
3.14159265358979310000
why does the format function result in truncation?
miscdas
More information about the metacard
mailing list