[New-bugs-announce] [issue12897] Support for iterators in multiprocessing map

[andrew cooke]

New submission from andrew cooke <andrew at acooke.org>:

http://stackoverflow.com/questions/7306522/combining-itertools-and-multiprocessing/7307078 suggests (and the idea itself seems reasonable) that it would sometimes be useful for multiprocessing to operate correctly (ie lazily) with lazy input (iterables).  for example, if the input is large, or perhaps generated by some other process "on demand".

obviously this complicates matters, given the asynchronous nature of a worker pool, and would mean re-allocating the results list as required.  but in principle i suspect it would be possible and might be a useful extension.

----------
components: Library (Lib)
messages: 143511
nosy: acooke
priority: normal
severity: normal
status: open
title: Support for iterators in multiprocessing map
type: feature request
versions: Python 3.4

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue12897>
_______________________________________