[scikit-learn] Estimator.predict() thread safety

Gael Varoquaux gael.varoquaux at normalesup.org
Fri Jun 17 11:51:55 EDT 2016


No, the inner loop won't be run parallel.

G

On Fri, Jun 17, 2016 at 11:46:59AM -0400, Philip Tully wrote:
> Gotcha - so perhaps I should ensure FeatureUnion[n_jobs] + GirdSearch[n_jobs] <
> # cores?

> On Fri, Jun 17, 2016 at 11:21 AM, Gael Varoquaux <gael.varoquaux at normalesup.org
> > wrote:

>     > I am typically careful with this, e.g., if my machine has 16 cores, I’d
>     > set feature union to n_jobs=3 and the gridsearch_cv to n_jobs=4 or so.
>     > Curious to hear what the scikit devs think about nesting calls
>     > n_jobs=-1; am I too conservative?

>     Nested parallelism doesn't work. It's a limitation of multiprocessing.
>     _______________________________________________
>     scikit-learn mailing list
>     scikit-learn at python.org
>     https://mail.python.org/mailman/listinfo/scikit-learn



> _______________________________________________
> scikit-learn mailing list
> scikit-learn at python.org
> https://mail.python.org/mailman/listinfo/scikit-learn


-- 
    Gael Varoquaux
    Researcher, INRIA Parietal
    NeuroSpin/CEA Saclay , Bat 145, 91191 Gif-sur-Yvette France
    Phone:  ++ 33-1-69-08-79-68
    http://gael-varoquaux.info            http://twitter.com/GaelVaroquaux


More information about the scikit-learn mailing list