[Python-ideas] [Python-Dev] bpo-34837: Multiprocessing.Pool API Extension - Pass Data to Workers w/o Globals

Michael Selik mike at selik.org
Mon Oct 22 15:46:37 EDT 2018

I switched this thread to the python-ideas list, since this is proposing a
new feature.

On Mon, Oct 22, 2018 at 12:13 PM Sean Harrington <seanharr11 at gmail.com>

> I contend that multiprocessing.Pool is used most frequently with a single
> task. I am proposing a feature that enforces this invariant, optimizes task
> memory-footprints & thus serialization time, and preserves the
> well-established interface to Pool through subclassing.

We've got a disagreement over interface design. That's more easily
discussed with concrete examples. In my own work, I often create a procmap
or threadmap function to make that pattern more pleasant. Since you're
making the proposal, why not share some examples of using Pool in the
manner you'd like? As real a chunk of code as you're able to share publicly
(and concisely).
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-ideas/attachments/20181022/26cca8fc/attachment.html>

More information about the Python-ideas mailing list