Mailman 3 November 2018 - Python-ideas

Python octal escape character encoding "wats"
by Joao S. O. Bueno Nov. 10, 2018

Nov. 10, 2018

I just saw some document which reminded me that strings with a backslash followed by 3 octal digits. When a backslash is followed by 3 octal digits, that means a character with the corresponding codepoint and all is well. The "valid scenaario": In [42]: "\777" Out[42]: 'ǿ' The problem is when you have just two valid octal digits In [40]: "\778" Out[40]: '?8' Which is ambiguous at least -- why is this not "\x07" "77" for example? (0ct(77) actually corresponds to the "?" (63) character) Or.… [View More]

4 5

Re: [Python-ideas] Python-ideas Digest, Vol 144, Issue 24
by Alex Shafer Nov. 10, 2018

Nov. 10, 2018

I think this about the limitation to . and .. possibly? > > Message: 6 > Date: Sat, 10 Nov 2018 11:00:16 +1100 > From: Chris Angelico <rosuav(a)gmail.com> > To: python-ideas <python-ideas(a)python.org> > Subject: Re: [Python-ideas] Relative Imports > Message-ID: > < > CAPTjJmrtApAXib4wM6FEh-XkpU_cf5RNX2TR0VzCAGgxPPgf5A(a)mail.gmail.com> > Content-Type: text/plain; charset="UTF-8" > > On Sat, Nov 10, 2018 at 10:52 AM danish … [View More]

1 0

Add "default" kwarg to list.pop()
by Giampaolo Rodola' Nov. 9, 2018

Nov. 9, 2018

Sorry in advance if this has been proposed in the past but I couldn't find anything on python-ideas: >>> l = [] >>> l.pop(default=1) 1 FWIW my use case consists in reading entries from /proc/diskstats where lines can have a variable number of fields depending on the kernel version: https://github.com/giampaolo/psutil/issues/1354#issuecomment-434495870 https://github.com/giampaolo/psutil/blob/d8b05151e65f9348aff9b58da977abd8ca… As such it would be convenient to set missing … [View More]

18 41

Re: [Python-ideas] Serialization of CSV vs. JSON
by David Shawley Nov. 7, 2018

Nov. 7, 2018

On Nov 4, 2018, at 12:43 PM, Michael Selik <michael.selik(a)gmail.com> wrote: > If you're making a module >> > > On Sun, Nov 4, 2018, 5:49 AM David Shawley <daveshawley(a)gmail.com wrote: > > Personally, I would place this sort of serialization logic outside of the > > Standard Library -- maybe following the pattern that the rust community > > adopted on this very issue. In short, they separated serialization & > > de-serialization into a … [View More]

2 1

Serialization of CSV vs. JSON
by Philip Martin Nov. 6, 2018

Nov. 6, 2018

Is there any reason why date, datetime, and UUID objects automatically serialize to default strings using the csv module, but json.dumps throws an error as a default? i.e. import csv import json import io from datetime import date stream = io.StringIO() writer = csv.writer(stream) writer.writerow([date(2018, 11, 2)]) # versus json.dumps(date(2018, 11, 2))

10 17

Re: [Python-ideas] dict.setdefault_call(), or API variations thereupon
by Alex Shafer Nov. 6, 2018

Nov. 6, 2018

I had actually managed to miss collections.defaultdict! I'd like to instead propose that a reference to that be added to the dict.setdefault docs. I can't imagine I'm the only one that has missed this. Date: Fri, 2 Nov 2018 12:12:45 +1100 > From: Chris Angelico <rosuav(a)gmail.com> > To: python-ideas <python-ideas(a)python.org> > Subject: Re: [Python-ideas] dict.setdefault_call(), or API variations > thereupon > Message-ID: > < > … [View More]

7 12

Proposal to add a key field to the bisect library
by Tiberiu Chibici Nov. 4, 2018

Nov. 4, 2018

Hi, I would like to propose an improvement to the functions in the bisect library, to add a 'key' parameter, similar to 'sorted' or other system functions. -- Chibici Tiberiu

3 4

Re: [Python-ideas] Are we supposed to be able to have our own class dictionary in python 3?
by Amit Green Nov. 4, 2018

Nov. 4, 2018

Thanks Daniel, I found my answer here (using your link): https://docs.python.org/3/reference/datamodel.html#preparing-the-class-name… """ When a new class is created by type.__new__, the object provided as the namespace parameter is copied to a new ordered mapping and the original object is discarded. """ Therefore the answer seems to be that https://www.python.org/dev/peps/pep-3115/ needs to be updated & fixed. Replace the following: """ def __new__(cls, name, bases, classdict): … [View More] # Note that we replace the classdict with a regular # dict before passing it to the superclass, so that we # don't continue to record member names after the class # has been created. result = type.__new__(cls, name, bases, dict(classdict)) result.member_names = classdict.member_names return result """ With: """ def __new__(cls, name, bases, classdict): result = type.__new__(cls, name, bases, classdict) result.member_names = classdict.member_names return result """ Removing the incorrect comments & the copying of `classdict` I will go file a bug report to that effect. Thanks, Joy Diamond. On Sat, Nov 3, 2018 at 7:55 PM Daniel Moisset <dfmoisset(a)gmail.com> wrote: > If I understood correctly what you want, it's possible with a metaclass. > Check the __prepare__ method at > https://docs.python.org/3/reference/datamodel.html#preparing-the-class-name… > and Pep 3115 > > On Sat, 3 Nov 2018, 20:55 Joy Diamond <python.gem(a)gmail.com wrote: > >> Team, >> >> Are we supposed to be able to have our own class dictionary in python 3? >> >> If we currently cannot -- do we want to be able to? >> >> That we can have out own class dictionary in python 3 is strongly implied >> in the following at https://www.python.org/dev/peps/pep-3115/ where it >> says: >> >> """ >> >> # The metaclass invocation >> def __new__(cls, name, bases, classdict): >> # Note that we replace the classdict with a regular >> # dict before passing it to the superclass, so that we >> # don't continue to record member names after the class >> # has been created. >> result = type.__new__(cls, name, bases, dict(classdict)) >> result.member_names = classdict.member_names >> return result >> >> """ >> >> I don't understand this. As far as I can tell, no matter what class >> dictionary you pass into `type.__new__` it creates a copy of it. >> >> Am I missing something? Is this supposed to work? Is the documentation >> wrong? >> >> Thanks, >> >> Joy Diamond. >> >> Program that shows that the class dictionary created is not what we pass >> in --- Shows the actual symbol table is `dict` not `SymbolTable` >> >> class SymbolTable(dict): >> pass >> >> members = SymbolTable(a = 1) >> >> X = type('X', ((object,)), members) >> >> members['b'] = 2 >> >> print('X.a: {}'.format(X.a)) >> >> try: >> print('X.b: {}'.format(X.b)) >> except AttributeError as e: >> print('X.b: does not exist') >> >> # >> # Get the actual symbol table of `X`, bypassing the mapping proxy. >> # >> X__symbol_table = __import__('gc').get_referents(X.__dict__)[0] >> >> print('The type of the actual symbol table of X is: {} with keys: >> {}'.format( >> type(X__symbol_table), >> X__symbol_table.keys())) >> >> >> # Prints out >> # X.a: 1 >> # X.b: does not exist >> # The type of the actual symbol table of X is: <class 'dict'> with keys: >> dict_keys(['a', '__module__', '__dict__', '__weakref__', '__doc__']) >> >> >> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. >> www.avast.com >> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> >> <#m_3863327966708087084_m_7370047320667964513_m_603818574152564677_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> >> _______________________________________________ >> Python-ideas mailing list >> Python-ideas(a)python.org >> https://mail.python.org/mailman/listinfo/python-ideas >> Code of Conduct: http://python.org/psf/codeofconduct/ >> > [View Less]

2 1

Re: [Python-ideas] Are we supposed to be able to have our own class dictionary in python 3?
by Daniel Moisset Nov. 3, 2018

Nov. 3, 2018

Sorry, should have replied to the list too On Sat, 3 Nov 2018, 23:55 Daniel Moisset <dfmoisset(a)gmail.com wrote: > If I understood correctly what you want, it's possible with a metaclass. > Check the __prepare__ method at > https://docs.python.org/3/reference/datamodel.html#preparing-the-class-name… > and Pep 3115 > > On Sat, 3 Nov 2018, 20:55 Joy Diamond <python.gem(a)gmail.com wrote: > >> Team, >> >> Are we supposed to be able to have our own … [View More]class dictionary in python 3? >> >> If we currently cannot -- do we want to be able to? >> >> That we can have out own class dictionary in python 3 is strongly implied >> in the following at https://www.python.org/dev/peps/pep-3115/ where it >> says: >> >> """ >> >> # The metaclass invocation >> def __new__(cls, name, bases, classdict): >> # Note that we replace the classdict with a regular >> # dict before passing it to the superclass, so that we >> # don't continue to record member names after the class >> # has been created. >> result = type.__new__(cls, name, bases, dict(classdict)) >> result.member_names = classdict.member_names >> return result >> >> """ >> >> I don't understand this. As far as I can tell, no matter what class >> dictionary you pass into `type.__new__` it creates a copy of it. >> >> Am I missing something? Is this supposed to work? Is the documentation >> wrong? >> >> Thanks, >> >> Joy Diamond. >> >> Program that shows that the class dictionary created is not what we pass >> in --- Shows the actual symbol table is `dict` not `SymbolTable` >> >> class SymbolTable(dict): >> pass >> >> members = SymbolTable(a = 1) >> >> X = type('X', ((object,)), members) >> >> members['b'] = 2 >> >> print('X.a: {}'.format(X.a)) >> >> try: >> print('X.b: {}'.format(X.b)) >> except AttributeError as e: >> print('X.b: does not exist') >> >> # >> # Get the actual symbol table of `X`, bypassing the mapping proxy. >> # >> X__symbol_table = __import__('gc').get_referents(X.__dict__)[0] >> >> print('The type of the actual symbol table of X is: {} with keys: >> {}'.format( >> type(X__symbol_table), >> X__symbol_table.keys())) >> >> >> # Prints out >> # X.a: 1 >> # X.b: does not exist >> # The type of the actual symbol table of X is: <class 'dict'> with keys: >> dict_keys(['a', '__module__', '__dict__', '__weakref__', '__doc__']) >> >> >> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. >> www.avast.com >> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> >> <#m_8752709194315235090_m_603818574152564677_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> >> _______________________________________________ >> Python-ideas mailing list >> Python-ideas(a)python.org >> https://mail.python.org/mailman/listinfo/python-ideas >> Code of Conduct: http://python.org/psf/codeofconduct/ >> > [View Less]

1 0

Are we supposed to be able to have our own class dictionary in python 3?
by Joy Diamond Nov. 3, 2018

Nov. 3, 2018

Team, Are we supposed to be able to have our own class dictionary in python 3? If we currently cannot -- do we want to be able to? That we can have out own class dictionary in python 3 is strongly implied in the following at https://www.python.org/dev/peps/pep-3115/ where it says: """ # The metaclass invocation def __new__(cls, name, bases, classdict): # Note that we replace the classdict with a regular # dict before passing it to the superclass, so that we #… [View More]

1 0

dict.setdefault_call(), or API variations thereupon
by Alex Shafer Nov. 2, 2018

Nov. 2, 2018

I'd like to propose an addition to `dict` but I'm not necessarily proposing what's written here as the API. When I initially saw the need for this myself, I hastily wrote it as: def setdefault_call(a_dict, key, default_func): try: return a_dict[key] except KeyError: default = default_func() a_dict[key] = default return default If its not clear, the purpose is to eliminate the overhead of creating an empty list or similar in situations like this: d = {} … [View More]

3 2

Allow Context Managers to Support Suspended Execution
by David Allemang Nov. 1, 2018

Nov. 1, 2018

I do not think there is currently a good way for Context Managers to support suspended execution, as in await or yield. Both of these instructions cause the interpreter to leave the with block, yet no indication of this (temporary) exit or subsequent re-entrance is given to the context manager. If the intent of a Context Manager is to say "no matter how this block is entered or exited, the context will be correctly maintained", then this needs to be possible. I would propose magic methods … [View More]__suspend__ and __resume__ as companions to the existing __enter__ and __exit__ methods (and their async variants). __suspend__, if present, would be called upon suspending execution on an await or yield statement, and __resume__, if present, would be called when execution is resumed. If __suspend__ or __resume__ are not present then nothing should be done, so that the behavior of existing context managers is preserved. Here is an example demonstrating the issue with await: https://gist.github.com/allemangD/bba8dc2d059310623f752ebf65bb6cdc and one with yield: https://gist.github.com/allemangD/f2534f16d3a0c642c2cdc02c544e854f The context manager used is clearly not thread-safe, and I'm not actually sure how to approach a thread-safe implementation with the proposed __suspend__ and __resume__ - but I don't believe that introducing these new methods would create any issues that aren't already present with __enter__ and __exit__. It's worth noting that the context manager used in those examples is, essentially, identical contextlib's redirect_stdout and decimal's localcontext managers. Any context manager such as these which modify global state or the behavior of global functions would benefit from this. It may also make sense to, for example, have the __suspend__ method on file objects flush buffers without closing the file, similar to their current __exit__ behavior, but I'm unsure what impact this would have on performance. It is important, though, that yield and await not use __enter__ or __exit__, as not all context-managers are reusable. I'm unsure what the best term would be to describe this type of context, as the documentation for contextlib already gives a different definition for "reentrant" - I would then call them "suspendable" contexts. It would make sense to have an @suspendable decorator, probably in contextlib, to indicate that a context manager can use __enter__ and __exit__ methods rather than __suspend__ and __resume__. All it would need to do is define __suspend__ to call __enter__() and __resume__ to call __exit__(None, None, None). It is also important, since __suspend__ and __resume__ would be called after a context is entered but before it is exited, that __suspend__ not accept any parameters and that __resume__ not use its return value. __suspend__ could not be triggered by an exception, only by a yield or await, and __resume__ could not have its return value named with as. Thanks, David [View Less]

5 5

Implementing a set of operation (+, /, - *) on dict consistent with linearAlgebrae
by julien tayon Nov. 1, 2018

Nov. 1, 2018

Hello :) the idea is described here:http://jul.github.io/cv/pres.html#printable Summary of the idea : Take a linear algebrae book, and implements all the rules as a TDD.https://github.com/jul/archery/blob/master/consistent_algebrae.py make it works based on abstract base class and sets of Mixins.https://archery.readthedocs.io/en/latest/ And see if we can make cos/__abs__/dot and if it gives naively the intended results ? (spoiler: yes) Making it work with dict, and "other" dictionary like … [View More]

8 12