[Numpy-discussion] PEP 574 - zero-copy pickling with out of band data

Gael Varoquaux gael.varoquaux at normalesup.org
Tue Jul 3 01:35:04 EDT 2018


On Mon, Jul 02, 2018 at 05:31:05PM -0600, Charles R Harris wrote:
> ISTR that some parallel processing applications sent pickled arrays around to
> different processes, I don't know if that is still the case, but if so, no copy
> might be a big gain for them.

Yes, most parallel code that's across processes or across computers use
some form a pickle. I hope that this PEP would enable large speed ups.
This would be a big deal for parallelism in numerical Python.


More information about the NumPy-Discussion mailing list