[Numpy-discussion] Memory leak/fragmentation when using np.memmap

Pauli Virtanen pav at iki.fi
Wed May 18 19:53:30 EDT 2011


On Wed, 18 May 2011 16:36:31 -0700, G Jones wrote:
[clip]
> As a followup, I managed to install tcmalloc as described in the article
> I mentioned. Running the example I sent now shows a constant memory foot
> print as expected. I am surprised such a solution was necessary.
> Certainly others must work with such large datasets using numpy/python?

Well, your example Python code works for me without any other changes,
and it shows behavior identical to the C code.

Things might depend on the version of the C library and the kernel, so it
is quite possible that many do not see these issues.

-- 
Pauli Virtanen




More information about the NumPy-Discussion mailing list