running a program on many processors
steve at REMOVE-THIS-cybersource.com.au
Mon Mar 8 02:08:32 CET 2010
On Mon, 08 Mar 2010 01:18:13 +0100, Paweł Banyś wrote:
> I have already read about Python and multiprocessing which allows using
> many processors. The idea is to split a program into separate tasks and
> run each of them on a separate processor. However I want to run a Python
> program doing a single simple task on many processors so that their
> cumulative power is available to the program as if there was one huge
> CPU instead of many separate ones. Is it possible? How can it be
Try Parallel Python.
I haven't used it, but it looks interesting.
However, the obligatory warning against premature optimization: any sort
of parallel execution (including even lightweight threads) is hard to
build and much harder to debug. You should make sure that the potential
performance benefits are worth the pain before you embark on the job: are
you sure that the naive, single process version isn't fast enough?
More information about the Python-list