[Distutils] parallelize setup.py develop/build

Andrea Crotti andrea.crotti.0 at gmail.com
Sun Dec 18 22:04:12 CET 2011


On 12/18/2011 07:47 PM, "Martin v. Löwis" wrote:
> I think your approach to parallelization would also suffer from the
> global interpreter lock, in addition to probably experiencing an
> IO bound. It may be that you can increase IO utilization with a
> threaded approach also, but I really suggest that using subprocesses
> is much better.
>
> Regards,
> Martin

Well they were two complementary questions, I know that using a pure-python
approach can't help much with parallelization..
I can still use multiprocessing/subprocess/therading also if I use this
approach,
but at least I might have control on what is happening.

If I still have to catch SystemExit and check the return codes then I
don't gain much though.
So the other question is, why setuptools doesn't have a clear API which
can be used from other
programs?

I had a look of the code too and it was quite hard to understand
anything, so I gave up and
apparently everyone else is using it in the same way...


More information about the Distutils-SIG mailing list