[IPython-dev] Aynchronously displaying stdout from parallel engines

Nathan Faggian nathan.faggian at gmail.com
Thu Jul 17 19:38:09 EDT 2014


Hi,

A while ago I wrote a task watcher:

    https://github.com/nfaggian/ipcluster_tools

I will probably have a sprint on it at the Australian PyCon in August.

Regards,

Nathan

On 17 July 2014 20:37, Dave Hirschfeld <dave.hirschfeld at gmail.com> wrote:

> Nathan Goldbaum <nathan12343 <at> gmail.com> writes:
>
> >
> > Hi all,
> > I'm finding myself dealing with a lengthy computation using an IPython
> parallel cluster and MPI4py.
> >
> > I'd like to be able to see what my workers are doing while they are doing
> it.  In particular, I'd like to be able to get the stdout stream from each
> engine and display it somehow in the output of a client notebook.
> >
> >
> > So far I've used AsyncResult.wait_interactive() to see what my workers
> are
> doing, but this only shows that my computations haven't completed yet - not
> what they are doing at any given moment.
> >
> >
> > Is it possible to set up something similar to wait_interactive that can
> asynchronously stream stdout from each of the workers?
> >
> > Thanks for your help,
> >
> > Nathan
> >
>
> Fortunately @minrk has a time machine!
>
>
> https://github.com/ipython/ipython/blob/master/examples/Parallel%20Computing
> /iopubwatcher.py
>
> HTH,
> Dave
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev at scipy.org
> http://mail.scipy.org/mailman/listinfo/ipython-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20140718/6ab3a340/attachment-0001.html>


More information about the IPython-dev mailing list