Multiprocessing takes higher execution time
James Mills
prologic at shortcircuit.net.au
Thu Jan 8 04:38:02 EST 2009
On Thu, Jan 8, 2009 at 7:31 PM, Nick Craig-Wood <nick at craig-wood.com> wrote:
(...)
> How many projects are you processing at once? And how many MB of zip
> files is it? As reading zip files does lots of disk IO I would guess
> it is disk limited rather than anything else, which explains why doing
> many at once is actually slower (the disk has to do more seeks).
If this is the case, this problem is not well suited to multi processing
but rather distributed processing :)
--JamesMills
More information about the Python-list
mailing list