[IPython-dev] Aynchronously displaying stdout from parallel engines

Dave Hirschfeld dave.hirschfeld at gmail.com
Thu Jul 17 06:37:30 EDT 2014


Nathan Goldbaum <nathan12343 <at> gmail.com> writes:

> 
> Hi all,
> I'm finding myself dealing with a lengthy computation using an IPython 
parallel cluster and MPI4py.
> 
> I'd like to be able to see what my workers are doing while they are doing 
it.  In particular, I'd like to be able to get the stdout stream from each 
engine and display it somehow in the output of a client notebook.
> 
> 
> So far I've used AsyncResult.wait_interactive() to see what my workers are 
doing, but this only shows that my computations haven't completed yet - not 
what they are doing at any given moment.  
> 
> 
> Is it possible to set up something similar to wait_interactive that can 
asynchronously stream stdout from each of the workers?
> 
> Thanks for your help,
> 
> Nathan
> 

Fortunately @minrk has a time machine!

https://github.com/ipython/ipython/blob/master/examples/Parallel%20Computing
/iopubwatcher.py

HTH,
Dave




More information about the IPython-dev mailing list