[Numpy-discussion] error with large memmap

John Schulman joschu at caltech.edu
Tue Jun 9 10:32:24 EDT 2009


OK looks like that was the issue
$ python -c "import platform; print platform.machine()"
i386

Thanks


On Tue, Jun 9, 2009 at 2:52 AM, David
Cournapeau<david at ar.media.kyoto-u.ac.jp> wrote:
> Charles R Harris wrote:
>>
>>
>> On Tue, Jun 9, 2009 at 2:32 AM, John Schulman <joschu at caltech.edu
>> <mailto:joschu at caltech.edu>> wrote:
>>
>>     I'm getting the error
>>     OverflowError: cannot fit 'long' into an index-sized integer
>>     when I try to memmap a 6gb file
>>
>>     top of the stack trace is
>>     mm = mmap.mmap(fid.fileno(), bytes, access=acc)
>>     where bytes = 6528000000L
>>
>>     I thought that 64-bit systems with python>2.5 could memmap large
>>     files. I'm running the latest EPD python distribution (4.2.30201),
>>     which uses python 2.5.4 and numpy 1.2.1
>>     Macbook Pro Core 2 Duo, OS X 10.5.6
>>
>>
>> Is your python 64 bits? Try:
>>
>> file `which python`
>
> This is even better:
>
> python -c "import platform; print platform.machine()"
>
> as mac os x can be confusing with fat binaries and all :)
>
> David
> _______________________________________________
> Numpy-discussion mailing list
> Numpy-discussion at scipy.org
> http://mail.scipy.org/mailman/listinfo/numpy-discussion
>
>



More information about the NumPy-Discussion mailing list