[Numpy-discussion] multiprocessing, numpy and 32-64 bit cohabitation

Robert Kern robert.kern at gmail.com
Thu Sep 19 04:55:05 EDT 2013


On Thu, Sep 19, 2013 at 2:40 AM, Antony Lee <antony.lee at berkeley.edu> wrote:
>
> Thanks, I didn't know that multiprocessing Managers could be used with
processes not started by multiprocessing itself...  I will give them a try.
> I just need to compute FFTs, but speed is a real issue for me (I am using
the results for real-time feedback).

I am pretty sure that the overhead of communicating a large array from one
process to another will vastly overwhelm any speed gains you get by using
pyFFTW over numpy.fft.

> To be honest I don't know yet if the FFTs are going to be the limiting
step but I thought I may as well give pyFFTW a try and ran into that
issue...

In that case, thinking about multiprocessing or even pyFFTW is far too
premature. Implement your code with numpy.fft and see what performance you
actually get.

--
Robert Kern
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20130919/4ee08ea1/attachment.html>


More information about the NumPy-Discussion mailing list