Multiprocessing, shared memory vs. pickled copies

John Nagle nagle at animats.com
Sun Apr 10 12:27:31 EDT 2011


On 4/10/2011 9:11 AM, Miki Tebeka wrote:
>> Now, I don't know that I actually HAVE to pass my neural network and
>> input data as copies -- they're both READ-ONLY objects for the
>> duration of an evaluate function (which can go on for quite a while).
> One option in that case is to use "fork" (if you're on a *nix machine).
> See http://pythonwise.blogspot.com/2009/04/pmap.html for example ;)

    Unless you have a performance problem, don't bother with shared
memory.

    If you have a performance problem, Python is probably the wrong
tool for the job anyway.

				John Nagle



More information about the Python-list mailing list