[Numpy-discussion] error with large memmap

John Schulman joschu at caltech.edu
Tue Jun 9 10:51:59 EDT 2009


What's the best way to install a 64-bit python alongside my existing
installation?


On Tue, Jun 9, 2009 at 7:32 AM, John Schulman<joschu at caltech.edu> wrote:
> OK looks like that was the issue
> $ python -c "import platform; print platform.machine()"
> i386
>
> Thanks
>
>
> On Tue, Jun 9, 2009 at 2:52 AM, David
> Cournapeau<david at ar.media.kyoto-u.ac.jp> wrote:
>> Charles R Harris wrote:
>>>
>>>
>>> On Tue, Jun 9, 2009 at 2:32 AM, John Schulman <joschu at caltech.edu
>>> <mailto:joschu at caltech.edu>> wrote:
>>>
>>>     I'm getting the error
>>>     OverflowError: cannot fit 'long' into an index-sized integer
>>>     when I try to memmap a 6gb file
>>>
>>>     top of the stack trace is
>>>     mm = mmap.mmap(fid.fileno(), bytes, access=acc)
>>>     where bytes = 6528000000L
>>>
>>>     I thought that 64-bit systems with python>2.5 could memmap large
>>>     files. I'm running the latest EPD python distribution (4.2.30201),
>>>     which uses python 2.5.4 and numpy 1.2.1
>>>     Macbook Pro Core 2 Duo, OS X 10.5.6
>>>
>>>
>>> Is your python 64 bits? Try:
>>>
>>> file `which python`
>>
>> This is even better:
>>
>> python -c "import platform; print platform.machine()"
>>
>> as mac os x can be confusing with fat binaries and all :)
>>
>> David
>> _______________________________________________
>> Numpy-discussion mailing list
>> Numpy-discussion at scipy.org
>> http://mail.scipy.org/mailman/listinfo/numpy-discussion
>>
>>
>



More information about the NumPy-Discussion mailing list