request for new Executor in `concurrent.futures`
8 Nov
2021
8 Nov
'21
10:29 p.m.
Currently, There is two types of Executor in `concurrent.futures`. They are `ThreadPoolExecutor` and `ProcessPoolExecutor`, there is GIL limitation of `ThreadPoolExecutor` and `ProcessPoolExecutor` need to use `pickle` which have limitation on decorated function. It would be nice to add new Executor `UnixForkExecutor` which is based on `os.fork` and shared memory (to return future). The drawback of UnixForkExecutor can only be used on Unix platform. This is not a problem, because the majority people use python for parallel computing on Unix platform. Anyone have any opinion about it?
8 Nov
8 Nov
10:46 p.m.
Are you looking for ProcessPoolExecutor(mp_context=multiprocessing.get_context("fork"))
1096
Age (days ago)
1096
Last active (days ago)
1 comments
2 participants
participants (2)
-
Evan Greenup
-
Mark Gordon