[Python-ideas] Add `Executor.filter`

[Ram Rachum]

I envisioned it being implemented directly on `Executor`, so it'll
automatically apply to all executor types. (I'll be happy to write the
implementation if we have a general feeling that this is a desired feature.)

On Fri, May 1, 2015 at 6:08 PM, Guido van Rossum <guido at python.org> wrote:

> Sounds like should be an easy patch. Of course, needs to work for
> ProcessPoolExecutor too.
>
> On Fri, May 1, 2015 at 1:12 AM, Ram Rachum <ram at rachum.com> wrote:
>
>> Hi,
>>
>> What do you think about adding a method: `Executor.filter`?
>>
>> I was using something like this:
>>
>> my_things = [thing for thing in things if some_condition(thing)]
>>
>>
>> But the problem was that `some_condition` took a long time to run waiting
>> on I/O, which is a great candidate for parallelizing with
>> ThreadPoolExecutor. I made it work using `Executor.map` and some
>> improvizing, but it would be nicer if I could do:
>>
>> with concurrent.futures.ThreadPoolExecutor(100) as executor:
>>     my_things = executor.filter(some_condition, things)
>>
>> And have the condition run in parallel on all the threads.
>>
>> What do you think?
>>
>>
>> Thanks,
>> Ram.
>>
>> _______________________________________________
>> Python-ideas mailing list
>> Python-ideas at python.org
>> https://mail.python.org/mailman/listinfo/python-ideas
>> Code of Conduct: http://python.org/psf/codeofconduct/
>>
>
>
>
> --
> --Guido van Rossum (python.org/~guido)
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-ideas/attachments/20150501/24282b19/attachment.html>