memmap on 64bit Linux for > 2 GB files
Hi, I finally tried to do the test, to memmap a large file filesize: 2.8G a memmap call gives this error: {{{
N.memmap('20050622-1648-Y_DEMO-1') Traceback (most recent call last): File "<input>", line 1, in ? File "/jws30/haase/PrLinN64/numpy/core/memmap.py", line 67, in __new__ mm = mmap.mmap(fid.fileno(), bytes, access=acc) OverflowError: memory mapped size is too large (limited by C int) }}}
I'm using a recent numpy on a 64bit Linux (debian etch, kernel: 2.6.16-2-em64t-p4-smp) {{{
N.__version__ '1.0.2.dev3509' N.int0 <type 'numpy.int64'> }}}
Is this supposed to work ? Thanks, Sebastian
Sebastian Haase wrote:
Hi, I finally tried to do the test, to memmap a large file filesize: 2.8G
a memmap call gives this error:
{{{
N.memmap('20050622-1648-Y_DEMO-1') Traceback (most recent call last): File "<input>", line 1, in ? File "/jws30/haase/PrLinN64/numpy/core/memmap.py", line 67, in __new__ mm = mmap.mmap(fid.fileno(), bytes, access=acc) OverflowError: memory mapped size is too large (limited by C int) }}}
I'm using a recent numpy on a 64bit Linux (debian etch, kernel: 2.6.16-2-em64t-p4-smp) {{{
N.__version__ '1.0.2.dev3509' N.int0 <type 'numpy.int64'> }}}
Is this supposed to work ?
You need Python 2.5 for it to work. -- Robert Kern "I have come to believe that the whole world is an enigma, a harmless enigma that is made terrible by our own mad attempt to interpret it as though it had an underlying truth." -- Umberto Eco
Of course ! Now I remember why I didn't test it yet... Thanks, -Sebastian On 2/6/07, Robert Kern <robert.kern@gmail.com> wrote:
Sebastian Haase wrote:
Hi, I finally tried to do the test, to memmap a large file filesize: 2.8G
a memmap call gives this error:
{{{
N.memmap('20050622-1648-Y_DEMO-1') Traceback (most recent call last): File "<input>", line 1, in ? File "/jws30/haase/PrLinN64/numpy/core/memmap.py", line 67, in __new__ mm = mmap.mmap(fid.fileno(), bytes, access=acc) OverflowError: memory mapped size is too large (limited by C int) }}}
I'm using a recent numpy on a 64bit Linux (debian etch, kernel: 2.6.16-2-em64t-p4-smp) {{{
N.__version__ '1.0.2.dev3509' N.int0 <type 'numpy.int64'> }}}
Is this supposed to work ?
You need Python 2.5 for it to work.
participants (3)
-
Robert Kern -
Sebastian Haase -
Sebastian Haase