Parallelization on muli-CPU hardware?
aahz at pythoncraft.com
Thu Oct 7 17:03:34 CEST 2004
In article <6db3f637.0410042045.2171ad5f at posting.google.com>,
P.M. <pcm at cpugrid.net> wrote:
>My question is, how can I best parallelize the running of separate
>autonomous Python scripts within this app? Can I run multiple
>interpreters in separate threads within a single process? In past
>newsgroup messages I've seen advice that the only way to get
>scalability, due to the GIL, is to use an IPC mechanism between
>multiple distinct processes running seperate interpreters. Is this
>still true or are there better ways to accomplish this?
I'm not sure where in the thread to hang this, so I went back to the
root to post this reminder:
One critical reason for the GIL is to support CPython's ability to call
random C libraries with little effort. Too many C libraries are not
thread-safe, let alone thread-hot. Forcing libraries that wish to
participate in threading to use Python's GIL-release mechanism is the
only safe approach.
Aahz (aahz at pythoncraft.com) <*> http://www.pythoncraft.com/
WiFi is the SCSI of the 21st Century -- there are fundamental technical
reasons for sacrificing a goat. (with no apologies to John Woods)
More information about the Python-list