On Wed, Mar 24, 2021 at 5:35 AM Vijay Patel <vijay96238@gmail.com> wrote:
Hi,
(This is great language, sincere thanks to all!)
I took a quick glance of https://devguide.python.org/langchanges/ (20.3. Suggesting new features and language changes), while writing this post.
Please ignore this, if similar proposals are discussed earlier.
Suggestion: 1. Big Set, Big Dictionary - During design time, i am considering this question. With limited RAM (example 4 GB), how can I store a dictionary/set of size greater than RAM.
Is it possible to introduce Big Set / Big Dictionary which stores data in hard disk (based on some partition mechanism - like big data)? (i.e.Big Set/Big Dictionary with set access mechanism identical to current set and dictionary).
Background: I am working on machine learning NLP and would like to use such feature in data generator.
How would it be stored on disk? Would it be in some sort of database? If so, check out a database access module, and maybe some sort of access layer that gives you a set-like or dict-like interface. Flat files? It probably exists on PyPI, but you could easily make a set-like or dict-like interface to something that uses simple file storage. Ultimately, it's going to be a lot of tradeoffs that can't be made as part of the language, as they're heavily tied to the exact way you're going to use this. ChrisA