[PATCH] problems in hypotf math function

Richard Sandiford richard@codesourcery.com
Mon Aug 1 21:30:00 GMT 2005


Bob Wilson <bwilson@tensilica.com> writes:
> The attached patch combines my fix for denormal values and Richard
> Sandiford's change from newlib.  Presumably he had a good reason for
> changing the scaling factor to 2^68.

According to my notes, the reason was that:

    Scaling by 2**-60 isn't enough if both arguments are near the
    extreme end of the range, such as in hypotf (2**125, 2**125).
    We'd end up multiplying two numbers O(2**65), which overflows.

Richard



More information about the Libc-alpha mailing list