[scikit-learn] Estimator.predict() thread safety

Philip Tully tully at csc.kth.se
Fri Jun 17 12:14:57 EDT 2016


Can confirm FeatureUnion[n_jobs=1] solved my issue, fwiw

Thanks for prompt replies

On Fri, Jun 17, 2016 at 11:52 AM, Sebastian Raschka <
mail at sebastianraschka.com> wrote:

> I think
>
> > FeatureUnion[n_jobs=1] + GirdSearch[n_jobs <=  cores]
>
> would be better regarding the nested parallelism limitation
>
> > On Jun 17, 2016, at 11:46 AM, Philip Tully <tully at csc.kth.se> wrote:
> >
> > Gotcha - so perhaps I should ensure FeatureUnion[n_jobs] +
> GirdSearch[n_jobs] < # cores?
> >
> > On Fri, Jun 17, 2016 at 11:21 AM, Gael Varoquaux <
> gael.varoquaux at normalesup.org> wrote:
> > > I am typically careful with this, e.g., if my machine has 16 cores, I’d
> > > set feature union to n_jobs=3 and the gridsearch_cv to n_jobs=4 or so.
> > > Curious to hear what the scikit devs think about nesting calls
> > > n_jobs=-1; am I too conservative?
> >
> > Nested parallelism doesn't work. It's a limitation of multiprocessing.
> > _______________________________________________
> > scikit-learn mailing list
> > scikit-learn at python.org
> > https://mail.python.org/mailman/listinfo/scikit-learn
> >
> > _______________________________________________
> > scikit-learn mailing list
> > scikit-learn at python.org
> > https://mail.python.org/mailman/listinfo/scikit-learn
>
> _______________________________________________
> scikit-learn mailing list
> scikit-learn at python.org
> https://mail.python.org/mailman/listinfo/scikit-learn
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/scikit-learn/attachments/20160617/8a1789d5/attachment.html>


More information about the scikit-learn mailing list