MC or Intel precision?

xbury.cs at clearstream.com xbury.cs at clearstream.com
Mon Aug 11 03:51:00 EDT 2003


Well, that was confusing enough (coming from C++/MC debugging 
comparisons!)

Thanks a million.000000.1!

Xavier

On 10/08/2003 21:45:11 metacard-admin wrote:
>At 7:33 AM -0700 8/10/03, MisterX wrote:
>>put 2 ^ .5 = 1.414214
>>put pi = 3.14159265358979323846
>>put pi * 1 = 3.141593 --- ooops...
>>put 0.0005 * 0.0005 = 0
>>
>>Other than start writting out externals,
>>is there a way to use "Real" math precision?
>
>
>The numberFormat property sets the precision of reported arithmetic 
results:
>
>set the numberFormat to ".############"
>put pi * 1 -- reports 3.14159265359

Visit us at http://www.clearstream.com
                                                          
IMPORTANT MESSAGE

Internet communications are not secure and therefore Clearstream International does not accept legal responsibility for the contents of this message.

The information contained in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Any views expressed in this e-mail are those of the individual sender, except where the sender specifically states them to be the views of Clearstream International or of any of its affiliates or subsidiaries.

END OF DISCLAIMER
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.runrev.com/pipermail/metacard/attachments/20030811/a53fc0dc/attachment.htm


More information about the metacard mailing list