[Numpy-discussion] PEP 574 - zero-copy pickling with out of band data
andrea.gavana at gmail.com
Tue Jul 3 02:54:51 EDT 2018
On Tue, 3 Jul 2018 at 07.35, Gael Varoquaux <gael.varoquaux at normalesup.org>
> On Mon, Jul 02, 2018 at 05:31:05PM -0600, Charles R Harris wrote:
> > ISTR that some parallel processing applications sent pickled arrays
> around to
> > different processes, I don't know if that is still the case, but if so,
> no copy
> > might be a big gain for them.
> Yes, most parallel code that's across processes or across computers use
> some form a pickle. I hope that this PEP would enable large speed ups.
> This would be a big deal for parallelism in numerical Python.
This sound so very powerful... it’s such a pity that these type of gems
won’t be backported to Python 2 - we have so many legacy applications
smoothly running in Python 2 and nowhere near the required resources to
even start porting to Python 3, and pickle5 looks like a small revolution
in the data-persistent world.
> NumPy-Discussion mailing list
> NumPy-Discussion at python.org
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the NumPy-Discussion