Re: Do we have a floatingpoint bug?

The second argument is precision, in bits. It doesn't seem to like higher precision then 65535 bits, but isn't close to 20,000 decimal digits enough precision?

/ Mirar

Previous text:

2003-02-25 11:03: Subject: Re: Do we have a floatingpoint bug?

---

i am sure, yes :-)

...

sprintf("%.10f", Gmp.mpf(3580,100));

(47) Result: "3.58e3"

...

sprintf("%.10f", Gmp.mpq(3580,100));

(48) Result: "35.8000000000"

the second is more readable, besides:

...

sprintf("%.10f", Gmp.mpq(3141593,1000000));

(50) Result: "3.1415930000"

...

sprintf("%.10f", Gmp.mpf(3141593,1000000));

Bad argument 2 to Gmp.mpf, must be <= 0x10000.

seems that mpf won't handle more precision than regular float

greetings, martin.

/ Brevbäraren