[issue34134] multiprocessing memory huge usage
INADA Naoki
report at bugs.python.org
Tue Jul 17 02:56:04 EDT 2018
INADA Naoki <songofacandy at gmail.com> added the comment:
> I think we should add something like "if you are using generator, consider use imap instead"
I think it's not good hint.
There are short generator. And there are long (or infinite) iterator other than generator too.
Maybe, "if iterator is not sequence (e.g. generator) and can be very big, consider using `imap` or `imap_unorderd` with explicit `chunksize` option for better efficiency."
But I'm not good at writing English.
Someone other than me can write better paragraph.
----------
_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue34134>
_______________________________________
More information about the Python-bugs-list
mailing list