odd (?) behavior: negative integer scalar in exponent
3 Sep
2014
3 Sep
'14
9:19 p.m.
What should be the value of `2**np.int_(-32)`? It is apparently currently computed as `1. / (2**np.int_(32))`, so the computation overflows (when a C long is 32 bits). I would have hoped for it to be computed as `1./(2.**np.int_(32))`.
Cheers, Alan Isaac
3 Sep
3 Sep
11:25 p.m.
On Wed, Sep 3, 2014 at 3:19 PM, Alan G Isaac alan.isaac@gmail.com wrote:
What should be the value of `2**np.int_(-32)`? It is apparently currently computed as `1. / (2**np.int_(32))`, so the computation overflows (when a C long is 32 bits). I would have hoped for it to be computed as `1./(2.**np.int_(32))`.
Looks like a bug to me.
Chuck.
3189
Age (days ago)
3189
Last active (days ago)
1 comments
2 participants
participants (2)
-
Alan G Isaac -
Charles R Harris