[New-bugs-announce] [issue25370] Add support of pickling very large bytes and str objects with protocol < 4

[Serhiy Storchaka]

New submission from Serhiy Storchaka:

Pickle protocols < 4 allow to pickle bytes and str object with 32-bit size. One of features of protocol 4 was the support of 64-bit sizes.

It is possible to add support of very large bytes and str objects with protocols 2 and 3. The idea is that the long string is splitted on chunks with 32-bit sizes and the resulting string is reconstructed with calling ''.join(). The main part of the feature can be implemented in Python as helpers in copyreg.

The question is: is it worthwhile to implement this feature? I already implemented two other features of protocol 4 for protocols 2 and 3: nested objects and __new__ with keyword arguments.

----------
components: Extension Modules, Library (Lib)
messages: 252745
nosy: alexandre.vassalotti, pitrou, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Add support of pickling very large bytes and str objects with protocol < 4
type: enhancement
versions: Python 3.6

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue25370>
_______________________________________