[Python-ideas] solving multi-core Python

[Antoine Pitrou]

On Sun, 21 Jun 2015 20:25:47 +1000
Nick Coghlan <ncoghlan at gmail.com> wrote:
> On 21 June 2015 at 19:48, Antoine Pitrou <solipsis at pitrou.net> wrote:
> > On Sun, 21 Jun 2015 16:31:33 +1000
> > Nick Coghlan <ncoghlan at gmail.com> wrote:
> >>
> >> For inter-interpreter communication, the worst case scenario is having
> >> to rely on a memcpy based message passing system (which would still be
> >> faster than multiprocessing's serialisation + IPC overhead)
> >
> > And memcpy() updates pointer references to dependent objects magically?
> > Surely you meant the memdeepcopy() function that's part of every
> > standard C library!
> 
> We already have the tools to do deep copies of object trees 
[...]
> "Faster message passing than multiprocessing" sets the baseline pretty
> low, after all.

What's the goal? 10% faster? Or 10x? copy.deepcopy() uses similar
internal mechanisms as pickle...

Regards

Antoine.