[issue11314] Subprocess suffers 40% process creation overhead penalty

[Antoine Pitrou]

Antoine Pitrou <pitrou at free.fr> added the comment:

Interestingly, reducing from the max open file descriptors from 8192 (my default) to 512 halves the runtime and solves the regression:

$ ulimit -n
512
$ ./python bench_subprocess.py 
pid: 31631
Time: 4903.8 ms


So, even though implemented in C, the file descriptor closing logic is still quite costly!

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue11314>
_______________________________________