Multiprocessing takes higher execution time

James Mills prologic at shortcircuit.net.au
Thu Jan 8 04:38:02 EST 2009


On Thu, Jan 8, 2009 at 7:31 PM, Nick Craig-Wood <nick at craig-wood.com> wrote:
(...)

> How many projects are you processing at once?  And how many MB of zip
> files is it?  As reading zip files does lots of disk IO I would guess
> it is disk limited rather than anything else, which explains why doing
> many at once is actually slower (the disk has to do more seeks).

If this is the case, this problem is not well suited to multi processing
but rather distributed processing :)

--JamesMills



More information about the Python-list mailing list