[IPython-dev] multiprocessing from within notebook crashes kernel

[MinRK]

On Wed, Oct 3, 2012 at 11:17 AM, Satrajit Ghosh <satra at mit.edu> wrote:

> hi min,
>
> just getting back to this error. turns out that this error results from an
> interaction between our library's logging mechanism (using python logging
> module), the ipython kernel (happens with notebook and console but not with
> ipython on terminal) and multiprocessing. i don't get the same error
> running the same set of commands in the ipython terminal. i suspect it has
> to do with how logging output is trapped and conveyed in the
> multiprocessing context back to the browser.
>

Anything that tries to write to sys.stdout/err from a fork will definitely
crash the process: https://github.com/ipython/ipython/issues/2438


>
> cheers,
>
> satra
>
>
> On Sun, Sep 9, 2012 at 2:22 PM, MinRK <benjaminrk at gmail.com> wrote:
>
>> What version of pyzmq?  If it's less than 2.2.0.1, try upgrading.
>> -MinRK
>>
>> On Sun, Sep 9, 2012 at 6:35 AM, Satrajit Ghosh <satra at mit.edu> wrote:
>>
>>> hi all,
>>>
>>> we are using a workflow library that internally uses multiprocessing to
>>> distribute jobs locally. when we run this from the notebook, it crashes the
>>> kernel.
>>>
>>> any thoughts as to why this might happen.
>>>
>>> here is the code from the library:
>>>
>>>
>>> https://github.com/nipy/nipype/blob/master/nipype/pipeline/plugins/multiproc.py
>>>
>>> cheers,
>>>
>>> satra
>>>
>>>
>>> _______________________________________________
>>> IPython-dev mailing list
>>> IPython-dev at scipy.org
>>> http://mail.scipy.org/mailman/listinfo/ipython-dev
>>>
>>>
>>
>> _______________________________________________
>> IPython-dev mailing list
>> IPython-dev at scipy.org
>> http://mail.scipy.org/mailman/listinfo/ipython-dev
>>
>>
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev at scipy.org
> http://mail.scipy.org/mailman/listinfo/ipython-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20121003/d56f754a/attachment.html>