[Python-ideas] Add `Executor.filter`

Guido van Rossum guido at python.org
Fri May 1 17:08:06 CEST 2015


Sounds like should be an easy patch. Of course, needs to work for
ProcessPoolExecutor too.

On Fri, May 1, 2015 at 1:12 AM, Ram Rachum <ram at rachum.com> wrote:

> Hi,
>
> What do you think about adding a method: `Executor.filter`?
>
> I was using something like this:
>
> my_things = [thing for thing in things if some_condition(thing)]
>
>
> But the problem was that `some_condition` took a long time to run waiting
> on I/O, which is a great candidate for parallelizing with
> ThreadPoolExecutor. I made it work using `Executor.map` and some
> improvizing, but it would be nicer if I could do:
>
> with concurrent.futures.ThreadPoolExecutor(100) as executor:
>     my_things = executor.filter(some_condition, things)
>
> And have the condition run in parallel on all the threads.
>
> What do you think?
>
>
> Thanks,
> Ram.
>
> _______________________________________________
> Python-ideas mailing list
> Python-ideas at python.org
> https://mail.python.org/mailman/listinfo/python-ideas
> Code of Conduct: http://python.org/psf/codeofconduct/
>



-- 
--Guido van Rossum (python.org/~guido)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-ideas/attachments/20150501/7ab7e091/attachment.html>


More information about the Python-ideas mailing list