Scaling on multi-processor machine

[Shalabh Chaturvedi]

Atul Kshirsagar wrote:

> Hello,
> GIL prevents my C++ application embedding and extending python to scale
> even though I spawn multiple C++ threads. I read lot of references on
> internet about using multiple processes rather than threads.
> 
> In that direction I was searching for some examples/resources/tools which
> can help me create multi-process implementation. My application does need
> to pass userdefined class objects to python interpreter. So I guess my
> implementation is going to need a protocol to marshal, de-marshal python
> objects between processes or use shared memory.
> 
> Does anyone here know of any examples/tools to implement the
> multi-processes approach with the object/data transfer between the
> processes ?

I haven't done anything similar myself but I can give a few pointers:

http://twistedmatrix.com/products/spread

http://poshmodule.sourceforge.net/

--
Shalabh