<div dir="ltr">Thanks, I didn't know that multiprocessing Managers could be used with processes not started by multiprocessing itself... I will give them a try.<br>I just need to compute FFTs, but speed is a real issue for me (I am using the results for real-time feedback). To be honest I don't know yet if the FFTs are going to be the limiting step but I thought I may as well give pyFFTW a try and ran into that issue...<br>
Antony<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/9/18 Robert Kern <span dir="ltr"><<a href="mailto:robert.kern@gmail.com" target="_blank">robert.kern@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><div class="im">On Wed, Sep 18, 2013 at 1:51 AM, Antony Lee <<a href="mailto:antony.lee@berkeley.edu" target="_blank">antony.lee@berkeley.edu</a>> wrote:<br>><br>> Hi all,<br>><br>> While I realize that this is certainly tweaking multiprocessing beyond its specifications, I would like to use it on Windows to start a 32-bit Python process from a 64-bit Python process (use case: I need to interface with a 64-bit DLL and use an extension (pyFFTW) for which I can only find a 32-bit compiled version (yes, I could try to install MSVC and compile it myself but I'm trying to avoid that...))<br>
<br></div>Just use subprocess to start up the 32-bit Python. If you want to use the multiprocessing tools for communicating data, use a Manager server in the 32-bit Python to communicate over a socket.<div><br></div><div>
<a href="http://docs.python.org/2/library/multiprocessing#managers" target="_blank">http://docs.python.org/2/library/multiprocessing#managers</a></div>
<div> <a href="http://docs.python.org/2/library/multiprocessing#using-a-remote-manager" target="_blank">http://docs.python.org/2/library/multiprocessing#using-a-remote-manager</a><br><div><br></div><div>It is possible that this won't work if the protocol assumes that the bitness is the same between server and client (e.g. struct.pack('Q', ...)), but I suspect this is not the case.</div>
<div><br></div><div>You may also consider writing a small server using pyzmq or similar. I am guessing that you are just calling one function from pyFFTW and getting the result back. A simple REQ/REP server is easy to write with pyzmq. Do you need to use pyFFTW for some specific functionality that is not available in numpy.fft or scipy.fftpack?<br>
<br>--<br>Robert Kern<br></div></div></div>
<br>_______________________________________________<br>
NumPy-Discussion mailing list<br>
<a href="mailto:NumPy-Discussion@scipy.org">NumPy-Discussion@scipy.org</a><br>
<a href="http://mail.scipy.org/mailman/listinfo/numpy-discussion" target="_blank">http://mail.scipy.org/mailman/listinfo/numpy-discussion</a><br>
<br></blockquote></div><br></div>