[IPython-dev] Parallel programming dependencies

Andrea Zonca zonca at sdsc.edu
Tue Apr 29 19:25:27 EDT 2014


On Tue, Apr 29, 2014 at 3:56 PM, Andrew Jaffe <a.h.jaffe at gmail.com> wrote:
> the particular difference is passing the output of the
> earlier tasks to the later ones -- this is a use-case that is very
> specifically not addressed in those examples or the docs -- each of the
> view.apply calls there just use no arguments, where I want to use the
> value calculated by a previous view.apply.

Not sure I understand your application,
but isn't it an option to write the results to a shared filesystem
from the early task and read it from the late task?
This would work for tasks running on different nodes.

More information about the IPython-dev mailing list