On 5 April 2017 at 01:47, Antoine Pitrou solipsis@pitrou.net wrote:
Unfortunately, the C version of pickle lacks the extensibility of the pure Python, so the pure Python has to be used in some cases. One such example is the
cloudpickle
project, which extends pickle to support many more types, such as local functions.cloudpickle
is often used by distributed executors to allow shipping Python code for remote execution on a cluster.
Perhaps a more suitable benchmark could be formulated based on that?
That way the benchmark could be pinned to a particular version of cloudpickle, and it would be testing a known real-world use case that explicitly requires the pure Python version of the underlying pickle module.
Cheers, Nick.
-- Nick Coghlan | ncoghlan@gmail.com | Brisbane, Australia