Python-Dev October 2019

python-dev@python.org

55 participants
47 discussions

Should we allow IPv6 scope in urllib: http://[IPv6%scope]/path?

by Victor Stinner

Hi, I wrote a PR to fix the following urllib security vulnerability: "urlparse of urllib returns wrong hostname" https://bugs.python.org/issue36338 https://github.com/python/cpython/pull/16780 While writing my fix, I found another issue about "[" and "]" characters in the user:password section of an URL: "urllib IPv6 parsing fails with special characters in passwords" https://bugs.python.org/issue33342 My PR tries to validate the "scope" part of "http://[IPv6%scope]/...": reject "%", "[" and "]" in scope. But I'm not sure that Python should really support the scope in an URL. Should we just reject URL with "%scope"? Or if we allow it, which characters should be allowed and/or rejected? It seems like Firefox and Chromium don't support an IPv6 with as a scope: when I type http://[::1%1]/ : they open a Google search on this URL. I tested Python urllib.request.urlopen() with my PR: http://[::1%1]:8080/ works as expected: it opens a connection to the IPv6 localhost in the loopback interface (TCP port 8080). Currently, my PR allows "%scope" but it rejects "%", "[" and "]" characters in the scope. I let you go through these 2 RFC about IPv6 scope / "zone identifier": https://tools.ietf.org/html/rfc4007 https://tools.ietf.org/html/rfc6874 Victor -- Night gathers, and now my watch begins. It shall not end until my death.

1 year, 5 months

PEP 607: Shared background for PEPs 602 and 605

by Nick Coghlan

Hi folks, Since we have two competing proposals for the Steering Council to consider when it comes to the target release date for Python 3.9.0, Steve, Łukasz and I put together a short-ish overview of the common set of problems that the two PEPs are both attempting to address, as well as the common risks that they're attempting to mitigate. If folks have questions or suggestions regarding the specific proposals, those discussion threads can be found on Discourse here: PEP 602 (12 month release cadence): https://discuss.python.org/t/pep-602-annual-release-cycle-for-python/2296 PEP 605 (24 month traditional release cadence with a rolling pre-release stream): https://discuss.python.org/t/pep-605-a-rolling-feature-release-stream-for-c… There's also a thread for the new overview PEP: https://discuss.python.org/t/pep-607-shared-background-for-the-release-cade… I expect most comments will be best targeted at the threads for the specific proposals, but the PEP 607 thread should still be useful if folks have questions or comments about the overview PEP itself. Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

1 year, 5 months

[RELEASE] Python 2.7.17

by Benjamin Peterson

Greetings, I'm wealful to announce the immediate availability of Python 2.7.17, another bugfix release in the Python 2.7 series. Downloads are on python.org: https://www.python.org/downloads/release/python-2717/ No code changes occurred between the 2.7.17 release candidate and the final release, but there were some documentation changes. See the 2.7.17rc1 changelog for changes between 2.7.16 and 2.7.17: https://raw.githubusercontent.com/python/cpython/c2f86d86e6c8f5fd1ef602128b… PEP 373, the Python 2.7 releases schedule, designates 2.7.17 as the penultimate Python 2.7 release. So, be aware that the upstream demise of Python 2 is not far away. For the time being, bugs may be reported to https://bugs.python.org. See you soon for The End, Benjamin

1 year, 5 months

Summary of Python tracker Issues

by Python tracker

ACTIVITY SUMMARY (2019-10-11 - 2019-10-18) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7074 ( +6) closed 43195 (+61) total 50269 (+67) Open issues with patches: 2806 Issues opened (41) ================== #22347: mimetypes.guess_type("//example.com") misinterprets host name https://bugs.python.org/issue22347 reopened by maxking #32856: Optimize the `for y in [x]` idiom in comprehensions https://bugs.python.org/issue32856 reopened by serhiy.storchaka #33604: HMAC default to MD5 marked as to be removed in 3.6 https://bugs.python.org/issue33604 reopened by rhettinger #38453: ntpath.realpath() does not fully resolve relative paths https://bugs.python.org/issue38453 opened by steve.dower #38454: test_listdir is failing on ubuntu with WSL https://bugs.python.org/issue38454 opened by BTaskaya #38456: Reduce the time test_subprocess takes to complete. https://bugs.python.org/issue38456 opened by gregory.p.smith #38457: __package__ is None in __init__.py until an import is used https://bugs.python.org/issue38457 opened by Yuval S #38460: 3.8 Release Notes: document asyncio exception changes https://bugs.python.org/issue38460 opened by srittau #38465: The type of ob_exports in PyByteArrayObject become Py_ssize_t. https://bugs.python.org/issue38465 opened by shihai1991 #38466: [Easy doc] threading.excepthook doc talks about "object" https://bugs.python.org/issue38466 opened by srittau #38471: _ProactorDatagramTransport: If close() is called when write bu https://bugs.python.org/issue38471 opened by primal #38472: GCC detection in setup.py is broken https://bugs.python.org/issue38472 opened by Alex Grund #38473: AttributeError on asserting autospecced mock object added usin https://bugs.python.org/issue38473 opened by xtreak #38475: Break Statement https://bugs.python.org/issue38475 opened by dev40573 #38476: test_multiprocessing_fork.test_terminate() failed on AMD64 Deb https://bugs.python.org/issue38476 opened by vstinner #38480: resource.setrlimit() should raise PermissionError https://bugs.python.org/issue38480 opened by giampaolo.rodola #38482: BUG in codecs.BufferedIncrementalDecoder https://bugs.python.org/issue38482 opened by jamercee #38483: [venv] Add ~/.venvrc to change module defaults https://bugs.python.org/issue38483 opened by cooperlees #38484: HTMLParser.handle_starttag should mention that value can be No https://bugs.python.org/issue38484 opened by srittau #38485: BUG Modules/_io/texio.c https://bugs.python.org/issue38485 opened by jamercee #38486: Dead links in mailbox doc https://bugs.python.org/issue38486 opened by inada.naoki #38487: expat infinite loop https://bugs.python.org/issue38487 opened by StyXman #38488: Update bundled pip to 19.3 https://bugs.python.org/issue38488 opened by Xavier Fernandez #38490: statistics: add covariance and Pearson's correlation https://bugs.python.org/issue38490 opened by twolodzko #38493: os.CLD_KILLED and os.CLD_STOPPED should be implemented https://bugs.python.org/issue38493 opened by clintolsen #38494: Add assert_not_called_with https://bugs.python.org/issue38494 opened by valkheim #38495: print built-in function docs bug https://bugs.python.org/issue38495 opened by Alex Mashianov #38497: Wrong argument name in documentation for pipes.Template.open https://bugs.python.org/issue38497 opened by ilai #38500: Provide a way to get/set PyInterpreterState.frame_eval without https://bugs.python.org/issue38500 opened by fabioz #38501: multiprocessing.Pool hangs atexit (and garbage collection some https://bugs.python.org/issue38501 opened by Eric Larson #38502: regrtest: use process groups https://bugs.python.org/issue38502 opened by vstinner #38505: Mock.call_args and Mock.call_args_list not propagated to paren https://bugs.python.org/issue38505 opened by Caris Moses #38506: Launcher for Windows (py.exe) may rank Python 3.xx (in the fut https://bugs.python.org/issue38506 opened by ynyyn #38509: Insufficient description of relative imports in docs.python.or https://bugs.python.org/issue38509 opened by Aniruddha Bhattacharjee #38510: build python with --enable-shared with static linked python ag https://bugs.python.org/issue38510 opened by Chiu Speq #38511: Multiprocessing does not work properly when using the trace mo https://bugs.python.org/issue38511 opened by rls1004 #38512: bug of the v3.7 API document demo case code https://bugs.python.org/issue38512 opened by zr22122 #38514: pathlib's mkdir documentation improvement https://bugs.python.org/issue38514 opened by jlaurens #38515: regrtest main process timed out after 5 min on AMD64 FreeBSD C https://bugs.python.org/issue38515 opened by vstinner #38516: PEP 3132 -- Extended Iterable Unpacking inconsistent assignmen https://bugs.python.org/issue38516 opened by mjaquier #38517: functools.cached_property should support partial functions and https://bugs.python.org/issue38517 opened by Ricardo Branco Most recent 15 issues with no replies (15) ========================================== #38517: functools.cached_property should support partial functions and https://bugs.python.org/issue38517 #38514: pathlib's mkdir documentation improvement https://bugs.python.org/issue38514 #38510: build python with --enable-shared with static linked python ag https://bugs.python.org/issue38510 #38509: Insufficient description of relative imports in docs.python.or https://bugs.python.org/issue38509 #38505: Mock.call_args and Mock.call_args_list not propagated to paren https://bugs.python.org/issue38505 #38500: Provide a way to get/set PyInterpreterState.frame_eval without https://bugs.python.org/issue38500 #38488: Update bundled pip to 19.3 https://bugs.python.org/issue38488 #38487: expat infinite loop https://bugs.python.org/issue38487 #38486: Dead links in mailbox doc https://bugs.python.org/issue38486 #38485: BUG Modules/_io/texio.c https://bugs.python.org/issue38485 #38484: HTMLParser.handle_starttag should mention that value can be No https://bugs.python.org/issue38484 #38483: [venv] Add ~/.venvrc to change module defaults https://bugs.python.org/issue38483 #38473: AttributeError on asserting autospecced mock object added usin https://bugs.python.org/issue38473 #38472: GCC detection in setup.py is broken https://bugs.python.org/issue38472 #38471: _ProactorDatagramTransport: If close() is called when write bu https://bugs.python.org/issue38471 Most recent 15 issues waiting for review (15) ============================================= #38517: functools.cached_property should support partial functions and https://bugs.python.org/issue38517 #38510: build python with --enable-shared with static linked python ag https://bugs.python.org/issue38510 #38502: regrtest: use process groups https://bugs.python.org/issue38502 #38493: os.CLD_KILLED and os.CLD_STOPPED should be implemented https://bugs.python.org/issue38493 #38490: statistics: add covariance and Pearson's correlation https://bugs.python.org/issue38490 #38483: [venv] Add ~/.venvrc to change module defaults https://bugs.python.org/issue38483 #38482: BUG in codecs.BufferedIncrementalDecoder https://bugs.python.org/issue38482 #38480: resource.setrlimit() should raise PermissionError https://bugs.python.org/issue38480 #38473: AttributeError on asserting autospecced mock object added usin https://bugs.python.org/issue38473 #38471: _ProactorDatagramTransport: If close() is called when write bu https://bugs.python.org/issue38471 #38465: The type of ob_exports in PyByteArrayObject become Py_ssize_t. https://bugs.python.org/issue38465 #38456: Reduce the time test_subprocess takes to complete. https://bugs.python.org/issue38456 #38453: ntpath.realpath() does not fully resolve relative paths https://bugs.python.org/issue38453 #38449: regression - mimetypes guess_type is confused by ; in the file https://bugs.python.org/issue38449 #38446: Ambiguous signature for builtins.__build_class__ https://bugs.python.org/issue38446 Top 10 most discussed issues (10) ================================= #38449: regression - mimetypes guess_type is confused by ; in the file https://bugs.python.org/issue38449 16 msgs #33604: HMAC default to MD5 marked as to be removed in 3.6 https://bugs.python.org/issue33604 6 msgs #37224: test__xxsubinterpreters fails randomly https://bugs.python.org/issue37224 6 msgs #37759: Polish whatsnew for 3.8 https://bugs.python.org/issue37759 6 msgs #38490: statistics: add covariance and Pearson's correlation https://bugs.python.org/issue38490 6 msgs #22347: mimetypes.guess_type("//example.com") misinterprets host name https://bugs.python.org/issue22347 5 msgs #38410: Possible fatal errors due to _PyEval_SetAsyncGen{Finalizer,Fir https://bugs.python.org/issue38410 5 msgs #38456: Reduce the time test_subprocess takes to complete. https://bugs.python.org/issue38456 5 msgs #38482: BUG in codecs.BufferedIncrementalDecoder https://bugs.python.org/issue38482 5 msgs #38502: regrtest: use process groups https://bugs.python.org/issue38502 5 msgs Issues closed (61) ================== #6462: bsddb3 intermittent test failures https://bugs.python.org/issue6462 closed by jcea #18734: Berkeley DB versions 4.4-4.9 are not discovered by setup.py https://bugs.python.org/issue18734 closed by jcea #24302: Dead Code of Handler check in function faulthandler_fatal_erro https://bugs.python.org/issue24302 closed by vstinner #32758: Stack overflow when parse long expression to AST https://bugs.python.org/issue32758 closed by serhiy.storchaka #34508: return of non-parenthesized star-unpacking expression a Syntax https://bugs.python.org/issue34508 closed by gvanrossum #34688: Segfault in pandas that works fine on 3.7 https://bugs.python.org/issue34688 closed by xtreak #34953: Implement `mmap.mmap.__repr__` https://bugs.python.org/issue34953 closed by xiang.zhang #35031: test_asyncio test_start_tls_server_1 fails in AMD64 FreeBSD CU https://bugs.python.org/issue35031 closed by vstinner #36274: http.client cannot send non-ASCII request lines https://bugs.python.org/issue36274 closed by larry #37431: test_asyncio: test_start_tls_server_1() failed on ARMv7 Debian https://bugs.python.org/issue37431 closed by vstinner #37587: JSON loads performance improvement for long strings https://bugs.python.org/issue37587 closed by inada.naoki #37731: Possible redifinition of _POSIX_C_SOURCE in ./pyconfig.h https://bugs.python.org/issue37731 closed by pablogsal #37961: Tracemalloc traces do not include original stack trace length https://bugs.python.org/issue37961 closed by vstinner #38112: Compileall improvements https://bugs.python.org/issue38112 closed by vstinner #38154: test__xxsubinterpreters: random failures on AMD64 FreeBSD CURR https://bugs.python.org/issue38154 closed by vstinner #38202: A fatal error in test_dictviews https://bugs.python.org/issue38202 closed by serhiy.storchaka #38282: socketmodule.c: _FORTIFY_SOURCE=2 warning in AF_ALG case of ge https://bugs.python.org/issue38282 closed by vstinner #38332: invalid content-transfer-encoding in encoded-word causes KeyEr https://bugs.python.org/issue38332 closed by maxking #38341: Add SMTPNotSupportedError in the exports of smtplib https://bugs.python.org/issue38341 closed by maxking #38344: activate.bat else needs to be on the same line as the if https://bugs.python.org/issue38344 closed by lukasz.langa #38355: ntpath.realpath() fails on sys.executable https://bugs.python.org/issue38355 closed by lukasz.langa #38359: pyw.exe opens console window in Windows 10 https://bugs.python.org/issue38359 closed by lukasz.langa #38378: os.sendfile() has improperly named parameter https://bugs.python.org/issue38378 closed by serhiy.storchaka #38379: finalizer resurrection in gc https://bugs.python.org/issue38379 closed by tim.peters #38401: Make dataclass attribute docstrings accessible https://bugs.python.org/issue38401 closed by taleinat #38417: Add support for settting umask in subprocess children https://bugs.python.org/issue38417 closed by gregory.p.smith #38418: Audit event for os.system is incorrect https://bugs.python.org/issue38418 closed by steve.dower #38424: typing.Generator shorthand https://bugs.python.org/issue38424 closed by levkivskyi #38431: dataclasses.InitVar breaks with typing.Optional https://bugs.python.org/issue38431 closed by serhiy.storchaka #38436: Improved performance for list addition. https://bugs.python.org/issue38436 closed by brandtbucher #38450: 3.8 Release Notes: IDLE section dupe https://bugs.python.org/issue38450 closed by ned.deily #38451: Datetime definition does not work in function definition as li https://bugs.python.org/issue38451 closed by terry.reedy #38452: unittest setUpClass missing 1 required positional argument: 'c https://bugs.python.org/issue38452 closed by zach.ware #38455: ‘memset’ offset [17, 88] from the object at ‘addrbuf’ https://bugs.python.org/issue38455 closed by pablogsal #38458: lists https://bugs.python.org/issue38458 closed by pablogsal #38459: typing: Classes that inherit `Generic[...]` indirectly aren't https://bugs.python.org/issue38459 closed by levkivskyi #38461: 3.8 Release Notes: "curses" misspelled as "ncurses" https://bugs.python.org/issue38461 closed by rhettinger #38462: Typo (nam ing) in import system docs https://bugs.python.org/issue38462 closed by eric.smith #38463: 3.8 Release Notes: Link to SSLContext.post_handshake_auth miss https://bugs.python.org/issue38463 closed by rhettinger #38464: documentation for NormalDist.quantiles(): missing argument https://bugs.python.org/issue38464 closed by rhettinger #38467: Misspelled argument names for typing.get_origin and get_args https://bugs.python.org/issue38467 closed by levkivskyi #38468: Refactor python-config.in - use getvar() https://bugs.python.org/issue38468 closed by nanjekyejoannah #38469: PEP 572 : assignment expression to a global variable in a comp https://bugs.python.org/issue38469 closed by pablogsal #38470: test_compileall fails in AMD64 Windows7 SP1 3.x https://bugs.python.org/issue38470 closed by vstinner #38474: digit check logic can be replaced by Py_ISDIGIT on prepare_s https://bugs.python.org/issue38474 closed by corona10 #38477: magiccube2x2 permutations 28% slower with Python 3.8.0rc1 vs 3 https://bugs.python.org/issue38477 closed by inada.naoki #38478: inspect.signature.bind does not correctly handle keyword argum https://bugs.python.org/issue38478 closed by pablogsal #38479: Segmentation fault: 11 Python3.6 on Macbook https://bugs.python.org/issue38479 closed by ned.deily #38481: Class static property not static https://bugs.python.org/issue38481 closed by eric.smith #38489: Python 3.7 documentation is unavailable for download https://bugs.python.org/issue38489 closed by ned.deily #38491: Can not build Python 3.8.0 on Linux - missing dependencies https://bugs.python.org/issue38491 closed by ned.deily #38492: Microsoft Store app IDLE (Python 3.8) needs msvcp140.dll https://bugs.python.org/issue38492 closed by steve.dower #38496: Python3 allows mixture of tabs and spaces for indentation https://bugs.python.org/issue38496 closed by eric.smith #38498: The expression '' in '' == '' is evaluated as True https://bugs.python.org/issue38498 closed by kigawas #38499: Add rmtree() to pathlib.Path https://bugs.python.org/issue38499 closed by serhiy.storchaka #38503: bug: string search can find \n, but can NEVER find \r https://bugs.python.org/issue38503 closed by inada.naoki #38504: Reduce the size of deb package https://bugs.python.org/issue38504 closed by ned.deily #38507: Improve the documentation of the nested list initialization https://bugs.python.org/issue38507 closed by krnick #38508: Tracing events anomaly when creating a multi-line list https://bugs.python.org/issue38508 closed by fabioz #38513: Should we maintain Jython related code? https://bugs.python.org/issue38513 closed by vstinner #38518: Pickle protocol 5 is not documented in the data-stream-format https://bugs.python.org/issue38518 closed by pablogsal

1 year, 5 months

PEP for libffi + _ctypes

by Kacvinsky, Tom

I have been comiling Python 3.8 from source and have had a really difficult time with getting _ctypes to compile. I see that libffi is no longer distributed with the Python source code, in preference for what is on the system. I searched for a PEP that describes the rationale behind this, but my Google fu must be weak. I have also seen requests that a patch be committed that makes configuring the use of libffi easier, but as far as I can tell, these have not been committed. It is something I would like to see as I am in a situation where I cannot depend on the system libffi - we support older Linux distributions that don't have libffi - an so I am making a static libffi to be linked in. Any guidance on this issue would be helpful. Thanks, TOm

1 year, 5 months

Setting frame evaluation function (i.e.:PyInterpreterState.frame_eval)

by Fabio Zadrozny

Hi All, I'm trying to upgrade the pydevd debugger to the latest version of CPython (3.8), however I'm having some issues being able to access `PyInterpreterState.eval_frame` when compiling, so, I'd like to ask if someone can point me in the right direction. What I'm trying to do is compile something like: #include "pystate.h" ... PyThreadState *ts = PyThreadState_Get(); PyInterpreterState *interp = ts->interp; interp->eval_frame = my_frame_eval_func; and the error I'm having is: _pydevd_frame_eval/pydevd_frame_evaluator.c(7534): error C2037: left of 'eval_frame' specifies undefined struct/union '_is' So, it seems that now "pystate.h" only has a forward reference to "_is" and a typedef from " PyInterpreterState" to "_is" and "_is" is defined in "include/internal/pycore_pystate.h", which doesn't seem like I should be including (in fact, if I try to include it I get an error saying that I would need to define Py_BUILD_CORE)... so, can someone point me to the proper way to set the frame evaluation function on CPython 3.8? Thanks, Fabio

1 year, 5 months

How official binaries are built?

by Inada Naoki

Hi, all. I want Homebrew uses `--enable-optimizations` and `--with-lto` option for building Python. But maintainer said: > Given this is not a default option, probably not, unless it is done in upstream (“official”) binaries. https://github.com/Homebrew/homebrew-core/pull/45337 Are these options used for official macOS binaries? Is there official information about the build step of official binaries? Regards, -- Inada Naoki <songofacandy(a)gmail.com>

1 year, 5 months

How do I install Python 3.8.0 on Linux (not possible? no one is doing this?)

by devlocalca＠gmail.com

I cannot get Python 3.8.0 installed on Linux ( RHEL 8 / CentOS 8). It's not available in any package repo. When I try to build from source, there are dependencies missing (3), that I cannot find anywhere. More info here: (I did not want to write this up twice) https://www.reddit.com/r/Python/comments/digewe/python_38_not_possible_to_i… The latest version of Python 3 available to me on Linux was released over three years ago ( Python 3.6.0 ), I don't understand why.

1 year, 5 months

[RELEASE] Python 3.8.0 is now available

by Łukasz Langa

On behalf of the Python development community and the Python 3.8 release team, I’m pleased to announce the availability of Python 3.8.0. Python 3.8.0 is the newest feature release of the Python language, and it contains many new features and optimizations. You can find Python 3.8.0 here: https://www.python.org/downloads/release/python-380/ <https://www.python.org/downloads/release/python-380/> Most third-party distributors of Python should be making 3.8.0 packages available soon. See the “What’s New in Python 3.8 <https://docs.python.org/3.8/whatsnew/3.8.html>” document for more information about features included in the 3.8 series. Detailed information about all changes made in 3.8.0 can be found in its change log. Maintenance releases for the 3.8 series will follow at regular bi-monthly intervals starting in December of 2019. We hope you enjoy Python 3.8! Thanks to all of the many volunteers who help make Python Development and these releases possible! Please consider supporting our efforts by volunteering yourself or through organization contributions to the Python Software Foundation. https://www.python.org/psf/ <https://www.python.org/psf/> - Ł

1 year, 5 months

[RELEASE] Python 3.7.5 is now available

by Ned Deily

Python 3.7.5 is now available, the next maintenance release of Python 3.7. You can find the release files, a link to the changelog, and more information here: https://www.python.org/downloads/release/python-375/ Note that the next feature release of Python 3, Python 3.8.0, is also now available. Python 3.8 contains many new features and optimizations. You should consider upgrading to it. We plan to continue regular bugfix releases of Python 3.7.x through mid-year 2020 and provide security fixes for it until mid-year 2023. More details are available in PEP 537, the Python 3.7 Release Schedule (https://www.python.org/dev/peps/pep-0537/). Thanks to all of the many volunteers who help make Python Development and these releases possible! Please consider supporting our efforts by volunteering yourself or through organization contributions to the Python Software Foundation. -- Ned Deily nad(a)python.org -- []

1 year, 5 months

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

Python-Dev October 2019