Python-Dev October 2015

python-dev@python.org

65 participants
34 discussions

congrats on 3.5! Alas, windows 7 users are having problems installing it

by Laura Creighton

webmaster has already heard from 4 people who cannot install it. I sent them to the bug tracker or to python-list but they seem not to have gone either place. Is there some guide I should be sending them to, 'how to debug installation problems'? Laura

9 months, 3 weeks

PEP 506 secrets module

by Steven D'Aprano

Hi, As extensively discussed on Python-Ideas, the secrets module and PEP 506 is (I hope) ready for pronouncement. https://www.python.org/dev/peps/pep-0506/ There is code and tests here: https://bitbucket.org/sdaprano/secrets or you can run hg clone https://sdaprano@bitbucket.org/sdaprano/secrets The code is written for and tested on Python 2.6, 2.7, 3.1 - 3.4. -- Steve

4 years, 2 months

If you shadow a module in the standard library that IDLE depends on, bad things happen

by Laura Creighton

see the following: lac@smartwheels:~/junk$ echo "print ('hello there')" >string.py lac@smartwheels:~/junk$ idle-python3.5 hello there Traceback (most recent call last): File "<string>", line 1, in <module> File "/usr/lib/python3.5/idlelib/run.py", line 10, in <module> from idlelib import CallTips File "/usr/lib/python3.5/idlelib/CallTips.py", line 16, in <module> from idlelib.HyperParser import HyperParser File "/usr/lib/python3.5/idlelib/HyperParser.py", line 14, in <module> _ASCII_ID_CHARS = frozenset(string.ascii_letters + string.digits + "_") AttributeError: module 'string' has no attribute 'ascii_letters' IDLE then produces a popup that says: IDLE's subprocess didn't make connection. Either IDLE can't stat a subprocess por personal firewall software is blocking the connection. <ok> -------- I think that life would be a whole lot easier for people if instead we got a message: Warning: local file /u/lac/junk/string.py shadows module named string in the Standard Library I think that it is python exec that would have to do this -- though of course the popup could also warn about shadowing in general, instead of sending people on wild goose chases over their firewalls. Would this be hard to do? Laura

4 years, 8 months

Should PEP 498 specify if rf'...' is valid?

by Ryan Gonzalez

It mentions fr'...' as a formatted raw string but doesn't say anything about rf'...'. Right now, in implementing PEP 498 support in Howl (https://github.com/howl-editor/howl/pull/118 and https://github.com/howl-editor/howl/commit/1e577da89efc1c1de780634b531f6434…), I assumed both were valid. Should the PEP be more specific? BTW, at the rate language-python is going, GitHub will get syntax highlighting for f-strings in 2050. :D -- Sent from my Nexus 5 with K-9 Mail. Please excuse my brevity.

4 years, 8 months

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2015-10-23 - 2015-10-30) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 5204 (+23) closed 32073 (+30) total 37277 (+53) Open issues with patches: 2298 Issues opened (37) ================== #25467: Put “deprecated” warnings first http://bugs.python.org/issue25467 opened by Tony R. #25468: PyTraceBack_Print()/_Py_DisplaySourceLine() should take custom http://bugs.python.org/issue25468 opened by shiz #25469: multiprocessing .Condition.notify(_all) function has O(N) time http://bugs.python.org/issue25469 opened by vilnis.termanis #25470: Random Malloc error raised http://bugs.python.org/issue25470 opened by augustin rieunier #25472: Typing: Specialized subclasses of generics cannot be unpickled http://bugs.python.org/issue25472 opened by maatt #25474: Weird behavior when setting f_trace in a context manager http://bugs.python.org/issue25474 opened by Fred Gansevles #25476: close() behavior on non-blocking BufferedIO objects with socke http://bugs.python.org/issue25476 opened by dabeaz #25477: text mode for pkgutil.get_data http://bugs.python.org/issue25477 opened by Antony.Lee #25478: Consider adding a normalize() method to collections.Counter() http://bugs.python.org/issue25478 opened by rhettinger #25479: Increase unit test coverage for abc.py http://bugs.python.org/issue25479 opened by szymon #25481: PermissionError in subprocess.check_output() when an inaccessi http://bugs.python.org/issue25481 opened by jaystrict #25482: signal.set_wakeup_fd() doesn't work if the signal don't have h http://bugs.python.org/issue25482 opened by ishimoto #25483: Improve f-string implementation: FORMAT_VALUE opcode http://bugs.python.org/issue25483 opened by eric.smith #25485: Add a context manager to telnetlib.Telnet http://bugs.python.org/issue25485 opened by desbma #25486: Resurrect inspect.getargspec() in 3.6 http://bugs.python.org/issue25486 opened by yselivanov #25487: imp module DeprecationWarning in test suite http://bugs.python.org/issue25487 opened by martin.panter #25488: IDLE: Remove idlelib from sys.path when added http://bugs.python.org/issue25488 opened by terry.reedy #25489: sys.exit() caught in exception handler http://bugs.python.org/issue25489 opened by jinty #25491: ftplib.sendcmd only accepts string http://bugs.python.org/issue25491 opened by wozlaf #25492: subprocess with redirection fails after FreeConsole http://bugs.python.org/issue25492 opened by George Prekas #25493: warnings.warn: wrong stacklevel causes import of local file "s http://bugs.python.org/issue25493 opened by bevan #25495: binascii documentation incorrect http://bugs.python.org/issue25495 opened by mouse07410 #25496: tarfile: Default value for compresslevel is not documented http://bugs.python.org/issue25496 opened by Sworddragon #25497: Rewrite test_robotparser http://bugs.python.org/issue25497 opened by berker.peksag #25498: Python 3.4.3 core dump with simple sample code http://bugs.python.org/issue25498 opened by JakeMont #25500: docs claim __import__ checked for in globals, but IMPORT_NAME http://bugs.python.org/issue25500 opened by superbobry #25505: undefined name 'window' in Tools/scripts/fixdiv.py http://bugs.python.org/issue25505 opened by John.Mark.Vandenberg #25507: IDLE: user code 'import tkinter; tkinter.font' should fail http://bugs.python.org/issue25507 opened by terry.reedy #25508: LogRecord attributes are not tuple, when logging only dict http://bugs.python.org/issue25508 opened by sejvlond #25509: PyImport_ImportModule inaccurately described http://bugs.python.org/issue25509 opened by memeplex #25510: fileinput.FileInput.readline() always returns str object at th http://bugs.python.org/issue25510 opened by Ryosuke Ito #25511: multiprocessing pool blocks SIGTERM from being handled http://bugs.python.org/issue25511 opened by djones #25514: better startup error messages in IDLE when stdlib modules shad http://bugs.python.org/issue25514 opened by markroseman #25516: threading.Condition._is_owned() is wrong when using threading. http://bugs.python.org/issue25516 opened by nirs #25517: regex howto example in "Lookahead Assertions" http://bugs.python.org/issue25517 opened by Pavel #25518: Investigate implementation of PyOS_CheckStack on OSX http://bugs.python.org/issue25518 opened by ronaldoussoren #25519: Minor difflib documentation bug http://bugs.python.org/issue25519 opened by lurchman Most recent 15 issues with no replies (15) ========================================== #25519: Minor difflib documentation bug http://bugs.python.org/issue25519 #25518: Investigate implementation of PyOS_CheckStack on OSX http://bugs.python.org/issue25518 #25511: multiprocessing pool blocks SIGTERM from being handled http://bugs.python.org/issue25511 #25505: undefined name 'window' in Tools/scripts/fixdiv.py http://bugs.python.org/issue25505 #25497: Rewrite test_robotparser http://bugs.python.org/issue25497 #25491: ftplib.sendcmd only accepts string http://bugs.python.org/issue25491 #25487: imp module DeprecationWarning in test suite http://bugs.python.org/issue25487 #25486: Resurrect inspect.getargspec() in 3.6 http://bugs.python.org/issue25486 #25479: Increase unit test coverage for abc.py http://bugs.python.org/issue25479 #25477: text mode for pkgutil.get_data http://bugs.python.org/issue25477 #25474: Weird behavior when setting f_trace in a context manager http://bugs.python.org/issue25474 #25468: PyTraceBack_Print()/_Py_DisplaySourceLine() should take custom http://bugs.python.org/issue25468 #25462: Avoid repeated hash calculation in C implementation of Ordered http://bugs.python.org/issue25462 #25458: ftplib: command response shift - mismatch http://bugs.python.org/issue25458 #25455: Some repr implementations don't check for self-referential str http://bugs.python.org/issue25455 Most recent 15 issues waiting for review (15) ============================================= #25516: threading.Condition._is_owned() is wrong when using threading. http://bugs.python.org/issue25516 #25510: fileinput.FileInput.readline() always returns str object at th http://bugs.python.org/issue25510 #25505: undefined name 'window' in Tools/scripts/fixdiv.py http://bugs.python.org/issue25505 #25498: Python 3.4.3 core dump with simple sample code http://bugs.python.org/issue25498 #25497: Rewrite test_robotparser http://bugs.python.org/issue25497 #25495: binascii documentation incorrect http://bugs.python.org/issue25495 #25489: sys.exit() caught in exception handler http://bugs.python.org/issue25489 #25485: Add a context manager to telnetlib.Telnet http://bugs.python.org/issue25485 #25483: Improve f-string implementation: FORMAT_VALUE opcode http://bugs.python.org/issue25483 #25479: Increase unit test coverage for abc.py http://bugs.python.org/issue25479 #25469: multiprocessing .Condition.notify(_all) function has O(N) time http://bugs.python.org/issue25469 #25467: Put “deprecated” warnings first http://bugs.python.org/issue25467 #25464: Tix HList header_exists should be "exist" http://bugs.python.org/issue25464 #25462: Avoid repeated hash calculation in C implementation of Ordered http://bugs.python.org/issue25462 #25461: Unclear language (the word ineffective) in the documentation f http://bugs.python.org/issue25461 Top 10 most discussed issues (10) ================================= #25489: sys.exit() caught in exception handler http://bugs.python.org/issue25489 17 msgs #8231: Unable to run IDLE without write-access to home directory http://bugs.python.org/issue8231 12 msgs #25482: signal.set_wakeup_fd() doesn't work if the signal don't have h http://bugs.python.org/issue25482 11 msgs #25467: Put “deprecated” warnings first http://bugs.python.org/issue25467 10 msgs #25481: PermissionError in subprocess.check_output() when an inaccessi http://bugs.python.org/issue25481 10 msgs #25483: Improve f-string implementation: FORMAT_VALUE opcode http://bugs.python.org/issue25483 8 msgs #25485: Add a context manager to telnetlib.Telnet http://bugs.python.org/issue25485 8 msgs #25156: shutil.copyfile should internally use os.sendfile when possibl http://bugs.python.org/issue25156 6 msgs #25495: binascii documentation incorrect http://bugs.python.org/issue25495 6 msgs #25498: Python 3.4.3 core dump with simple sample code http://bugs.python.org/issue25498 6 msgs Issues closed (28) ================== #16785: Document the fact that constructing OSError with erron returns http://bugs.python.org/issue16785 closed by martin.panter #21160: incorrect comments in nturl2path.py http://bugs.python.org/issue21160 closed by serhiy.storchaka #21827: textwrap.dedent() fails when largest common whitespace is a su http://bugs.python.org/issue21827 closed by serhiy.storchaka #23391: Documentation of EnvironmentError (OSError) arguments disappea http://bugs.python.org/issue23391 closed by martin.panter #24765: Move .idlerc to %APPDATA%\IDLE on Windows http://bugs.python.org/issue24765 closed by terry.reedy #25193: itertools.accumulate should have an optional initializer argum http://bugs.python.org/issue25193 closed by rhettinger #25311: Add f-string support to tokenize.py http://bugs.python.org/issue25311 closed by eric.smith #25356: Idle (Python 3.4 on Ubuntu) does not allow typing accents http://bugs.python.org/issue25356 closed by terry.reedy #25425: white-spaces encountered in 3.4 http://bugs.python.org/issue25425 closed by terry.reedy #25432: isinstance documentation: explain behavior when type is a tupl http://bugs.python.org/issue25432 closed by terry.reedy #25447: TypeError invoking deepcopy on lru_cache http://bugs.python.org/issue25447 closed by serhiy.storchaka #25466: offer "from __future__ import" option for "raise... from" http://bugs.python.org/issue25466 closed by terry.reedy #25471: socket.recv() blocks while it's gettimeout() returns 0.0 http://bugs.python.org/issue25471 closed by python-dev #25473: socket.recv() raises correct code with the misleading descript http://bugs.python.org/issue25473 closed by benjamin.peterson #25475: use argparse instead of getopt http://bugs.python.org/issue25475 closed by SilentGhost #25480: string format in large number http://bugs.python.org/issue25480 closed by eric.smith #25484: Operator issue with "in" on same level and preceding == http://bugs.python.org/issue25484 closed by ezio.melotti #25490: small mistake in example for random.choice() http://bugs.python.org/issue25490 closed by serhiy.storchaka #25494: Four quotes used to begin docstring http://bugs.python.org/issue25494 closed by python-dev #25499: use argparse for the calendar module http://bugs.python.org/issue25499 closed by serhiy.storchaka #25501: Use async/await through asyncio docs http://bugs.python.org/issue25501 closed by brett.cannon #25502: unnecessary re-imports http://bugs.python.org/issue25502 closed by python-dev #25503: inspect.getdoc does find inherited property __doc__ http://bugs.python.org/issue25503 closed by serhiy.storchaka #25504: undefined name 'modules' in Tools/freeze/checkextensions_win32 http://bugs.python.org/issue25504 closed by benjamin.peterson #25506: test_pprint reuses test_user_dict http://bugs.python.org/issue25506 closed by serhiy.storchaka #25512: apparent memory leak using ctypes http://bugs.python.org/issue25512 closed by blindgoat #25513: collections.abc.Iterable don't implement __bool__ http://bugs.python.org/issue25513 closed by r.david.murray #25515: Always use os.urandom for generating uuid4s http://bugs.python.org/issue25515 closed by python-dev

4 years, 8 months

Re: [Python-Dev] If you shadow a module in the standard library that IDLE depends on, bad things happen

by Mark Roseman

Laura, I think what you want should actually be more-or-less doable in IDLE. The main routine that starts IDLE should be able to detect if it starts correctly (something unlikely to happen if a significant stdlib module is shadowed), watch for an attribute error of that form and try to determine if shadowing is the cause, and if so, reissue a saner error message. The subprocess/firewall error is occurring because the ‘string’ problem in your example isn’t being hit right away so a few startup things already are happening. The point where we’re showing that error (as a result of a timeout) should be able to check as per the above that IDLE was able to start alright, and if not, change or ignore the timeout error. There’ll probably be some cases (depending on exactly what gets shadowed) that may be difficult to get to work, but it should be able to handle most things. Mark

4 years, 8 months

Intended Usage of collections.abc for Custom Collections

by jab＠math.brown.edu

Dear Python-Dev, I am the author of bidict, a bidirectional map implementation for Python. A user recently filed a bug that bidict should be a subclass of dict, so that isinstance(mybidict, dict) would return True. I replied that the user should instead use isinstance(mybidict, collections.abc.Mapping), which does already return True, and is more polymorphic to boot. But before I put the issue to bed, I want to make sure I'm correctly understanding the intended usage of collections.abc, as well as any relevant interfaces I'm not currently using (collections.UserDict? __subclasshook__?), since the documentation leaves me with some doubt. Could any collections experts on this list please confirm whether bidict is implemented as the language intends it should be? Some quick references: https://bidict.readthedocs.org/en/latest/other-bidict-types.html#bidict-typ… https://github.com/jab/bidict/blob/master/bidict/_bidict.py I would be happy to try to capture what I learn from this thread and write up a guide for collections library authors in the future, or otherwise pay your help forward however I can. Thanks and best wishes. -jab

4 years, 8 months

Bytcode "magic tag"

by Eric V. Smith

In issue 25483 I'm adding an opcode to make f-string formatting more robust and faster. As part of that, I'm bumping the .pyc magic number. While doing that, I notice Lib/importlib/_bootstrap_external.h includes this comment: # Starting with the adoption of PEP 3147 in Python 3.2, every bump in magic # number also includes a new "magic tag", i.e. a human readable string used # to represent the magic number in __pycache__ directories. When you change # the magic number, you must also set a new unique magic tag. Generally this # can be named after the Python major version of the magic number bump, but # it can really be anything, as long as it's different than anything else # that's come before. The tags are included in the following table, starting # with Python 3.2a0. The "following table" is a comment, that contains a few references to the tag "cpython-<version>", specifically cpython-32. It doesn't seem that the tag is routinely updated in the comment. sys.implementation.cache_tag returns 'cpython-36', and is in fact implemented as 'cpython-{PY_MAJOR_VERSION}{PY_MINOR_VERSION}'. Do I need to do anything else? Unlike what the comment in _boostrap_external.py suggests, this "magic tag" will not change every time a bytecode is added, but only on every minor release. Which implies that if we have a micro release that adds an opcode, we'll in fact break the promise in the comment. >From my understanding on how this tag is used, this wouldn't be a problem (because the magic number in the file also changes). But I want to make sure I'm not misunderstanding something. I think the comment above is probably just misleading. Eric.

4 years, 8 months

Re: [Python-Dev] Generated Bytecode ...

by Terry Reedy

On 10/23/2015 4:23 AM, Victor Stinner wrote: > Hi, > > 2015-10-22 19:02 GMT+02:00 Brett Cannon <brett(a)python.org>: >> It's not specified anywhere; it's just what the peepholer decides to remove. >> The exact code can be found at >> https://hg.python.org/cpython/file/default/Python/peephole.c . There has >> been talk in the past for adding a -X flag to disable the peepholer, but it >> never went any farther beyond that. > > Yeah, I remember that I had the same issue than Stéphane when I worked > on my astoptimizer project :-) I wanted to completly disable the > peephole optimizer because I wanted to reimplement the optimizations > on the AST instead of rewriting the bytecode. > > I would be nice to have a "-X noopt" command line option for that. How about -x nopeep to specifically skip the peephole optimizer? -- Terry Jan Reedy

4 years, 8 months

(no subject)

by Maciej Szulik

Thanks to Nick Coghlan and Barry Warsaw we've setup a new SIG dedicated to discussing python features from different distributions point of view. Here is Nick's reasoning: > With the Python 3 migration, and the growth in interest in user level > package management for development purposes, what do you think of the idea > of setting up a new Linux SIG to have those discussions? I know it's a case > of "yet another mailing list", but I think it will be worthwhile to have a > clear point of collaboration within the Python ecosystem, rather than > expecting Pythonistas to know how to reach out to (other) distros directly. The list is available @ https://mail.python.org/mailman/listinfo/linux-sig Maciej

4 years, 8 months

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev October 2015