[SciPy-User] Large Memory usage while doing median filter

Jerome Kieffer Jerome.Kieffer at esrf.fr
Mon May 11 10:01:28 EDT 2015


On Mon, 11 May 2015 09:53:35 -0400
Warren Weckesser <warren.weckesser at gmail.com> wrote:

> > I guess this is because scipy creates a 1024x1024x(40000) array to do the
> > sort along the last axis.
> > maybe no the best from the memorry point of view.
> >  
> 
> 
> Maybe I didn't search hard enough, but I don't see where such an array is
> allocated.  There are several layers of calls, from python in
> ndimage/filters.py down to C in ndimage/src/ni_filters.c, so maybe I missed
> it.  Can you point to where such an array is created, or was that really a
> guess?

It is really a guess ... I did not have a look at the source code. 

To do such things, a colleague of mine did some CUDA (OpenCL would be
the same) but it is out of the scope.

Cheers.
-- 
Jérôme Kieffer
tel +33 476 882 445



More information about the SciPy-User mailing list