Mailman 3 March 2019 - Python-Dev

Another update for PEP 394 -- The "python" Command on Unix-Like Systems
by Petr Viktorin 01 Mar '19

01 Mar '19

PEP 394 says: > This recommendation will be periodically reviewed over the next few > years, and updated when the core development team judges it > appropriate. As a point of reference, regular maintenance releases > for the Python 2.7 series will continue until at least 2020. I think it's time for another review. I'm especially worried about the implication of these: - If the `python` command is installed, it should invoke the same version of Python as the `python2` command - scripts that are deliberately written to be source compatible with both Python 2.x and 3.x [...] may continue to use `python` on their shebang line. So, to support scripts that adhere to the recommendation, Python 2 needs to be installed :( Please see this PR for details and a suggested change: https://github.com/python/peps/pull/893

25 64

Summary of Python tracker Issues
by Python tracker 01 Mar '19

01 Mar '19

ACTIVITY SUMMARY (2019-02-22 - 2019-03-01) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 7012 (+13) closed 40898 (+64) total 47910 (+77) Open issues with patches: 2791 Issues opened (44) ================== #35459: Use PyDict_GetItemWithError() instead of PyDict_GetItem() https://bugs.python.org/issue35459 reopened by vstinner #35931: pdb: "debug print(" crashes with SyntaxError https://bugs.python.org/issue35931 reopened by blueyed #36084: Threading: add builtin TID attribute to Thread objects https://bugs.python.org/issue36084 opened by jaketesler #36085: Enable better DLL resolution https://bugs.python.org/issue36085 opened by steve.dower #36086: Split IDLE into separate feature in Windows installer https://bugs.python.org/issue36086 opened by kimsey0 #36091: clean up async generator from types module https://bugs.python.org/issue36091 opened by scotchka #36092: unittest.mock's patch.object and patch.dict are not supported https://bugs.python.org/issue36092 opened by xtreak #36093: UnicodeEncodeError raise from smtplib.verify() method https://bugs.python.org/issue36093 opened by Windson Yang #36094: When using an SMTP SSL connection,, get ValueError. https://bugs.python.org/issue36094 opened by tyrone-zhao #36095: Better NaN sorting. https://bugs.python.org/issue36095 opened by brandtbucher #36097: Use only public C-API in _xxsubinterpreters module. https://bugs.python.org/issue36097 opened by eric.snow #36098: asyncio: ssl client-server with "slow" read https://bugs.python.org/issue36098 opened by MultiSosnooley #36099: Clarify the difference between mu and xbar in the statistics d https://bugs.python.org/issue36099 opened by steven.daprano #36100: Document the differences between str.isdigit, isdecimal and is https://bugs.python.org/issue36100 opened by StyXman #36103: Increase shutil.COPY_BUFSIZE https://bugs.python.org/issue36103 opened by inada.naoki #36107: aarch64 python3 buffer overflow with stack protector on rpi3 ( https://bugs.python.org/issue36107 opened by Natanael Copa #36108: Avoid failing the build on race condition in clean https://bugs.python.org/issue36108 opened by steve.dower #36114: test_multiprocessing_spawn changes the execution environment https://bugs.python.org/issue36114 opened by pablogsal #36116: test_multiprocessing_spawn fails on AMD64 Windows8 3.x https://bugs.python.org/issue36116 opened by pablogsal #36121: csv: Non global alternative to csv.field_size_limit https://bugs.python.org/issue36121 opened by Carlos Ramos #36124: Provide convenient C API for storing per-interpreter state https://bugs.python.org/issue36124 opened by ncoghlan #36127: Argument Clinic: inline parsing code for functions with keywor https://bugs.python.org/issue36127 opened by serhiy.storchaka #36128: ResourceReader for FileLoader inconsistently handles path sepa https://bugs.python.org/issue36128 opened by indygreg #36129: io documentation unclear about flush() and close() semantics f https://bugs.python.org/issue36129 opened by indygreg #36130: Pdb(skip=[...]) + module without __name__ => TypeError https://bugs.python.org/issue36130 opened by Anthony Sottile #36132: Python cannot access hci_channel field in sockaddr_hci https://bugs.python.org/issue36132 opened by bsder #36133: ThreadPoolExecutor and ProcessPoolExecutor, dynamic worker cou https://bugs.python.org/issue36133 opened by Fabian Dill #36136: Windows: python._pth sets isolated mode late during Python ini https://bugs.python.org/issue36136 opened by vstinner #36137: SSL verification fails for some sites inside windows docker co https://bugs.python.org/issue36137 opened by Mika Fischer #36138: Improve documentation about converting datetime.timedelta to s https://bugs.python.org/issue36138 opened by p-ganssle #36139: release GIL on mmap dealloc https://bugs.python.org/issue36139 opened by davide.rizzo #36140: An incorrect check in _msi.c's msidb_getsummaryinformation() https://bugs.python.org/issue36140 opened by ZackerySpytz #36141: configure: error: could not find pthreads on your system durin https://bugs.python.org/issue36141 opened by muhzi #36142: Add a new _PyPreConfig step to Python initialization to setup https://bugs.python.org/issue36142 opened by vstinner #36143: Auto-generate Lib/keyword.py https://bugs.python.org/issue36143 opened by gvanrossum #36144: Dictionary addition. https://bugs.python.org/issue36144 opened by brandtbucher #36145: android arm cross compilation fails, config issue https://bugs.python.org/issue36145 opened by muhzi #36147: [2.7] Coverity scan: Modules/_ctypes/cfield.c , Variable "resu https://bugs.python.org/issue36147 opened by cstratak #36149: use of uninitialised memory in cPickle. https://bugs.python.org/issue36149 opened by twouters #36153: Freeze support documentation is misleading. https://bugs.python.org/issue36153 opened by Sridhar Iyer #36154: Python quit unexpectedly error https://bugs.python.org/issue36154 opened by kellena #36157: Document PyInterpreterState_Main(). https://bugs.python.org/issue36157 opened by eric.snow #36158: Regex search behaves differently in list comprehension https://bugs.python.org/issue36158 opened by Matthew Drago #36159: Modify Formatter Class to handle arbitrary objects https://bugs.python.org/issue36159 opened by Ross Biro Most recent 15 issues with no replies (15) ========================================== #36159: Modify Formatter Class to handle arbitrary objects https://bugs.python.org/issue36159 #36157: Document PyInterpreterState_Main(). https://bugs.python.org/issue36157 #36149: use of uninitialised memory in cPickle. https://bugs.python.org/issue36149 #36140: An incorrect check in _msi.c's msidb_getsummaryinformation() https://bugs.python.org/issue36140 #36138: Improve documentation about converting datetime.timedelta to s https://bugs.python.org/issue36138 #36136: Windows: python._pth sets isolated mode late during Python ini https://bugs.python.org/issue36136 #36133: ThreadPoolExecutor and ProcessPoolExecutor, dynamic worker cou https://bugs.python.org/issue36133 #36130: Pdb(skip=[...]) + module without __name__ => TypeError https://bugs.python.org/issue36130 #36108: Avoid failing the build on race condition in clean https://bugs.python.org/issue36108 #36097: Use only public C-API in _xxsubinterpreters module. https://bugs.python.org/issue36097 #36092: unittest.mock's patch.object and patch.dict are not supported https://bugs.python.org/issue36092 #36084: Threading: add builtin TID attribute to Thread objects https://bugs.python.org/issue36084 #36081: Cannot set LDFLAGS containing $ https://bugs.python.org/issue36081 #36079: pdb on setuptools "ValueError: underlying buffer has been deta https://bugs.python.org/issue36079 #36076: ssl.get_server_certificate should use SNI https://bugs.python.org/issue36076 Most recent 15 issues waiting for review (15) ============================================= #36149: use of uninitialised memory in cPickle. https://bugs.python.org/issue36149 #36147: [2.7] Coverity scan: Modules/_ctypes/cfield.c , Variable "resu https://bugs.python.org/issue36147 #36144: Dictionary addition. https://bugs.python.org/issue36144 #36142: Add a new _PyPreConfig step to Python initialization to setup https://bugs.python.org/issue36142 #36140: An incorrect check in _msi.c's msidb_getsummaryinformation() https://bugs.python.org/issue36140 #36139: release GIL on mmap dealloc https://bugs.python.org/issue36139 #36130: Pdb(skip=[...]) + module without __name__ => TypeError https://bugs.python.org/issue36130 #36127: Argument Clinic: inline parsing code for functions with keywor https://bugs.python.org/issue36127 #36121: csv: Non global alternative to csv.field_size_limit https://bugs.python.org/issue36121 #36103: Increase shutil.COPY_BUFSIZE https://bugs.python.org/issue36103 #36097: Use only public C-API in _xxsubinterpreters module. https://bugs.python.org/issue36097 #36095: Better NaN sorting. https://bugs.python.org/issue36095 #36094: When using an SMTP SSL connection,, get ValueError. https://bugs.python.org/issue36094 #36091: clean up async generator from types module https://bugs.python.org/issue36091 #36086: Split IDLE into separate feature in Windows installer https://bugs.python.org/issue36086 Top 10 most discussed issues (10) ================================= #33944: Deprecate and remove pth files https://bugs.python.org/issue33944 21 msgs #36030: add internal API function to create tuple without items array https://bugs.python.org/issue36030 12 msgs #36100: Document the differences between str.isdigit, isdecimal and is https://bugs.python.org/issue36100 11 msgs #36144: Dictionary addition. https://bugs.python.org/issue36144 11 msgs #36085: Enable better DLL resolution https://bugs.python.org/issue36085 10 msgs #36095: Better NaN sorting. https://bugs.python.org/issue36095 10 msgs #35975: Put back the ability to parse files where async/await aren't k https://bugs.python.org/issue35975 9 msgs #33608: [subinterpreters] Add a cross-interpreter-safe mechanism to in https://bugs.python.org/issue33608 8 msgs #35813: shared memory construct to avoid need for serialization betwee https://bugs.python.org/issue35813 8 msgs #36103: Increase shutil.COPY_BUFSIZE https://bugs.python.org/issue36103 8 msgs Issues closed (62) ================== #8747: Autoconf tests in python not portably correct https://bugs.python.org/issue8747 closed by ngie #10308: Modules/getpath.c bugs https://bugs.python.org/issue10308 closed by vstinner #13497: Fix for broken nice test on non-broken platforms with pedantic https://bugs.python.org/issue13497 closed by benjamin.peterson #22123: Provide a direct function for types.SimpleNamespace() https://bugs.python.org/issue22123 closed by rhettinger #24235: ABCs don't fail metaclass instantiation https://bugs.python.org/issue24235 closed by cheryl.sabella #24310: Idle documentation -- what to do if you do not see an undersco https://bugs.python.org/issue24310 closed by terry.reedy #24643: VS 2015 pyconfig.h #define timezone _timezone conflicts with t https://bugs.python.org/issue24643 closed by steve.dower #24740: make patchcheck doesn't detect changes if commit is done first https://bugs.python.org/issue24740 closed by terry.reedy #27313: test case failures in test_widgets.ComboboxTest.of test_ttk_gu https://bugs.python.org/issue27313 closed by ned.deily #28450: Misleading/inaccurate documentation about unknown escape seque https://bugs.python.org/issue28450 closed by serhiy.storchaka #29397: linux/random.h present but cannot be compiled https://bugs.python.org/issue29397 closed by christian.heimes #29659: Expose the `length` arg from shutil.copyfileobj for public use https://bugs.python.org/issue29659 closed by inada.naoki #31652: make install fails: no module _ctypes https://bugs.python.org/issue31652 closed by inada.naoki #31916: ensurepip not honoring value of $(DESTDIR) - pip not installed https://bugs.python.org/issue31916 closed by cheryl.sabella #34211: Cygwin build broken due to use of &PyType_Type in static decla https://bugs.python.org/issue34211 closed by inada.naoki #34623: _elementtree.c doesn't call XML_SetHashSalt() https://bugs.python.org/issue34623 closed by larry #35178: Typo/trivial mistake in warnings.py (may be related to 2.x to https://bugs.python.org/issue35178 closed by vstinner #35512: patch.dict resolves in_dict eagerly (should be late resolved) https://bugs.python.org/issue35512 closed by xtreak #35652: Add use_srcentry parameter to shutil.copytree() II https://bugs.python.org/issue35652 closed by giampaolo.rodola #35724: Check for main interpreter when checking for "main" thread (fo https://bugs.python.org/issue35724 closed by eric.snow #35802: os.stat / os.lstat always present, but code checks hastattr(os https://bugs.python.org/issue35802 closed by Anthony Sottile #35886: Move PyInterpreterState into Include/internal/pycore_pystate.h https://bugs.python.org/issue35886 closed by eric.snow #36016: Allow gc.getobjects to return the objects tracked by a specifi https://bugs.python.org/issue36016 closed by inada.naoki #36018: Add a Normal Distribution class to the statistics module https://bugs.python.org/issue36018 closed by rhettinger #36048: Deprecate implicit truncating when convert Python numbers to C https://bugs.python.org/issue36048 closed by serhiy.storchaka #36066: Add `empty` block to `for` and `while` loops. https://bugs.python.org/issue36066 closed by terry.reedy #36072: str.translate() behaves differently for ASCII-only and other s https://bugs.python.org/issue36072 closed by terry.reedy #36083: Misformated manpage: --check-hash-based-pycs ´default´|´alw https://bugs.python.org/issue36083 closed by benjamin.peterson #36087: ThreadPoolExecutor max_workers none issue https://bugs.python.org/issue36087 closed by asvetlov #36088: zipfile cannot handle zip in zip https://bugs.python.org/issue36088 closed by serhiy.storchaka #36089: Formatting/Spelling errors in SimpleHTTPServer docs https://bugs.python.org/issue36089 closed by serhiy.storchaka #36090: spelling error in PEP219 introduction https://bugs.python.org/issue36090 closed by nanjekyejoannah #36096: IDLE: Refactor class variables to instance variables in colori https://bugs.python.org/issue36096 closed by terry.reedy #36101: remove non-ascii characters in docstring https://bugs.python.org/issue36101 closed by inada.naoki #36102: TestSharedMemory fails on AMD64 FreeBSD CURRENT Shared 3.x https://bugs.python.org/issue36102 closed by davin #36104: test_httplib and test_nntplib fail on ARMv7 Ubuntu https://bugs.python.org/issue36104 closed by vstinner #36105: Windows: use GetNativeSystemInfo instead of GetSystemInfo https://bugs.python.org/issue36105 closed by steve.dower #36106: resolve sinpi() name clash with libm https://bugs.python.org/issue36106 closed by serhiy.storchaka #36109: test_descr: test_vicious_descriptor_nonsense() fails randomly https://bugs.python.org/issue36109 closed by pablogsal #36110: test_descr: test_vicious_descriptor_nonsense() fails randomly https://bugs.python.org/issue36110 closed by pablogsal #36111: Non-zero `offset`s are no longer acceptable with SEEK_END/SEEK https://bugs.python.org/issue36111 closed by inada.naoki #36112: os.path.realpath on windows and substed drives https://bugs.python.org/issue36112 closed by eryksun #36113: Problem With SciPy Computation of sigma https://bugs.python.org/issue36113 closed by berker.peksag #36115: test_ctypes leaks references and memory blocks https://bugs.python.org/issue36115 closed by miss-islington #36117: Allow rich comparisons for real-valued complex objects. https://bugs.python.org/issue36117 closed by serhiy.storchaka #36118: Cannot correctly concatenate nested list that contains more th https://bugs.python.org/issue36118 closed by josh.r #36119: Can't add/append in set/list inside shared dict https://bugs.python.org/issue36119 closed by josh.r #36120: Regression - Concurrent Futures https://bugs.python.org/issue36120 closed by cheryl.sabella #36122: Second run of 2to3 continues to modify output https://bugs.python.org/issue36122 closed by bers #36123: Race condition in test_socket https://bugs.python.org/issue36123 closed by nanjekyejoannah #36125: Cannot cross-compile to more featureful but same tune https://bugs.python.org/issue36125 closed by ned.deily #36126: Reference count leakage in structseq_repr https://bugs.python.org/issue36126 closed by serhiy.storchaka #36131: test.test_urllib2net.TimeoutTest ftp related tests fail due to https://bugs.python.org/issue36131 closed by vstinner #36134: test failure : test_re; recipe for target 'test' failed https://bugs.python.org/issue36134 closed by serhiy.storchaka #36135: altinstall error Makefile:1140: recipe for target 'altinstall' https://bugs.python.org/issue36135 closed by matrixise #36146: Refactor setup.py https://bugs.python.org/issue36146 closed by vstinner #36148: smtplib.SMTP.sendmail: mta status codes only accessible by loc https://bugs.python.org/issue36148 closed by r.david.murray #36150: Possible assertion failures due to _ctypes.c's PyCData_reduce( https://bugs.python.org/issue36150 closed by christian.heimes #36151: Incorrect answer when calculating 11/3 https://bugs.python.org/issue36151 closed by zach.ware #36152: IDLE: Remove close_when_done from colorizer close() https://bugs.python.org/issue36152 closed by cheryl.sabella #36155: ./python -m test -m test_gc fails https://bugs.python.org/issue36155 closed by pablogsal #36156: different method, but id function return same value. https://bugs.python.org/issue36156 closed by inada.naoki

1 0

before I open an issue re: posix.stat and/or os.stat
by Michael 01 Mar '19

01 Mar '19

My focus is AIX - and I believe I found a bug in AIX include files in 64-bit mode. I'll take that up with IBM and AIX support. However, this issue might also be valid in Python3. The following is from Centos, not AIX Python 2.7.5 (default, Jul 13 2018, 13:06:57) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import sys >>> sys.maxsize 9223372036854775807 >>> import posix >>> posix.stat("/tmp/xxx") posix.stat_result(st_mode=33188, st_ino=33925869, st_dev=64768L, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1550742595, st_mtime=1550742595, st_ctime=1550742595) >>> st=posix.stat("/tmp/xxx") >>> dev=st.st_dev >>> min=posix.minor(dev) >>> maj=posix.major(dev) >>> min,max (0, <built-in function max>) >>> min 0 >>> max <built-in function max> >>> maj 253 >>> posix.minor(dev) 0 >>> posix.major(655536) 2560 >>> posix.major(65536) 256 >>> posix.major(256) 1 >>> import os >>> os.major(256) 1 >>> In AIX - 64-bit mode Python 3.8.0a1+ (heads/master:e7a4bb554e, Feb 20 2019, 18:40:08) [C] on aix7 Type "help", "copyright", "credits" or "license" for more information. >>> import sys,os,posix >>> sys.maxsize 9223372036854775807 >>> posix.major(256) 0 >>> posix.major(65536) 1 >>> posix.stat("/tmp/xxx") os.stat_result(st_mode=33188, st_ino=12, st_dev=-9223371993905102841, st_nlink=1, st_uid=202, st_gid=1954, st_size=0, st_atime=1550690105, st_mtime=1550690105, st_ctime=1550690105) AIX 32-bit: root@x066:[/data/prj/python/git/python3-3.8.0.66]./python Python 3.8.0a1+ (heads/master:e7a4bb554e, Feb 19 2019, 11:22:56) [C] on aix6 Type "help", "copyright", "credits" or "license" for more information. >>> import os,sys,posix >>> sys.maxsize 2147483647 >>> posix.major(65536) 1 >>> posix.stat("/tmp/xxx") os.stat_result(st_mode=33188, st_ino=149, st_dev=655367, st_nlink=1, st_uid=0, st_gid=0, st_size=0, st_atime=1550743517, st_mtime=1550743517, st_ctime=1550743517) To make it easier to view: buildbot@x064:[/home/buildbot]cat osstat.c #include <sys/types.h> #include <sys/stat.h> #include <sys/sysmacros.h> #include <stdio.h> main() { dev_t dev; char *path = "/tmp/xxx"; struct stat st; int minor,major; lstat(path,&st); printf("size: %d\n", sizeof(st.st_dev)); dev = st.st_dev; minor = minor(dev); major = major(dev); printf("%016lx %ld %ld\n",dev,dev, (unsigned) dev); printf("%d,%d\n",major,minor); } buildbot@x064:[/home/buildbot]OBJECT_MODE=32 cc osstat.c -o osstat-32 && ./osstat-32 size: 4 00000000000a0007 655367 655367 10,7 And here is the AIX behavior (and bug - major() macro!) buildbot@x064:[/home/buildbot]OBJECT_MODE=64 cc osstat.c -o osstat-64 && ./osstat-64 size: 8 8000000a00000007 -9223371993905102841 7 0,7 The same on AIX 6 (above is AIX7) - and also with gcc: root@x068:[/data/prj]gcc -maix64 osstat.c -o osstat-64 && ./osstat-64 size: 8 8000000a00000007 -9223371993905102841 42949672967 0,7 root@x068:[/data/prj]gcc -maix32 osstat.c -o osstat-32 && ./osstat-32 size: 4 00000000000a0007 655367 0 10,7 root@x068:[/data/prj] So, the AIX 'bug' with the macro major() has been around for ages - but ALSO setting the MSB of the st_dev. +++++ Now my question: Will this continue to be enough space - i.e., is the Dev size going to be enough? +2042 #ifdef MS_WINDOWS +2043 PyStructSequence_SET_ITEM(v, 2, PyLong_FromUnsignedLong(st->st_dev)); +2044 #else +2045 PyStructSequence_SET_ITEM(v, 2, _PyLong_FromDev(st->st_dev)); +2046 #endif +711 #define _PyLong_FromDev PyLong_FromLongLong It seems so - however, Is there something such as PyUnsignedLong and is that large enough for a "long long"? and if it exists, would that make the value positive (for the first test). posix.major and os.major will need to mask away the MSB and posix.makedev and os.makedev will need to add it back. OR - do I need to make the PyStat values "the same" in both 32-bit and 64-bit? Puzzled on what you think is the correct approach. Michael

3 2

Update from the Python Steering Council about CPython Development
by Carol Willing 01 Mar '19

01 Mar '19

The Python Steering Council is pleased to provide an update to the Python community about Steering Council activity and CPython development. We've created a GitHub repo for Steering Council updates and helpful documents: https://github.com/python/steering-council Here's the latest update written after our meeting on February 26th: https://github.com/python/steering-council/blob/master/updates/2019-02-26_s… (https://link.getmailspring.com/link/2AACF155-36B1-4D80-A2C1-A948561C45E4@ge…) We'll be posting updates after each steering council meeting which will be roughly twice a month.

1 0

[RELEASE] Python 3.8.0a1 is now available for testing
by Łukasz Langa 01 Mar '19

01 Mar '19

I packaged another release. Go get it here: https://www.python.org/downloads/release/python-380a2/ Python 3.8.0a2 is the second of four planned alpha releases of Python 3.8, the next feature release of Python. During the alpha phase, Python 3.8 remains under heavy development: additional features will be added and existing features may be modified or deleted. Please keep in mind that this is a preview release and its use is not recommended for production environments. The next preview release, 3.8.0a3, is planned for 2019-03-25. This time around the stable buildbots were a bit less green than they should have. This early in the cycle, I didn't postpone the release and I didn't use the revert hammer. But soon enough, I will. Let's make sure future changes keep the buildbots happy. - Ł

4 4