[scikit-learn] Scikit Learn in a Cray computer

Brown J.B. jbbrown at kuhp.kyoto-u.ac.jp
Wed Jun 19 20:04:54 EDT 2019


2019年6月20日(木) 8:16 Mauricio Reis <reismc at ime.eb.br>:

> But documentation (provided by a teacher in charge of the Cray computer)
> shows:
> - each node: 1 CPU, 1 GPU, 32 GBytes
>

If that's true, then it appears to me that running on any individual
compute host (node) has 1-core / 2-threads, and that would be why you
wouldn't get any more performance after n_jobs=2.
For n_jobs=3/4/..., you're just asking the same amount of compute hardware
to do the same calculations.
As instructed, you'll need to execute joblib.cpu_count() to resolve your
host environment.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/scikit-learn/attachments/20190620/1b5deb42/attachment.html>


More information about the scikit-learn mailing list