Mailman 3 December 2018 - Python-Dev

3.7.2rc1 and 3.6.8rc1 cutoffs ahead, last 3.6.x bugfix release!
by Ned Deily Dec. 19, 2018

Dec. 19, 2018

https://discuss.python.org/t/3-7-2rc1-and-3-6-8rc1-cutoffs-ahead-last-3-6-x… We're reaching the end of the year and it's time for another pair of Python 3 maintenance releases, 3.7.2 and 3.6.8, before we ring out 2018. Since there are still some open release blocker issues and I haven't been bugging you about them, I've moved the code cutoff for the release candidates to this coming Friday, 12-07, by the end of the day (AOE). That gives us all another 4 days to review open issues and PRs. Please give highest attention to any release blockers you have been shepherding or reviewing. Thanks! A reminder: as previously announced, 3.6.8 is planned to be the last bugfix release of the 3.6 series. Python 3.6.0 was released on 2016-12-23, so by the time 3.6.8 is released, 3.6.x will have been in bugfix mode almost exactly 2 years. When a new feature release is made and enters "bugfix" mode, our policy has long been to continue to maintain the previous bugfix branch for at least one more release and then move that branch to "security fix only" mode. 3.7.0 (and 3.6.6) was released nearly six months ago and, with the release of 3.6.8, there will have been two additional 3.6.x bugfix releases since then. So, barring any showstopper issues that might arise, the upcoming 3.6.8rc1 is your last chance to make bugfix changes for 3.6.x. Following the successful release of 3.6.8, only security fixes will be accepted for the 3.6 branch and future 3.6.x releases will be source-only and scheduled as needed; no further binary installers will be produced for 3.6. Refer to the Dev Guide sections and release PEPs linked below for more information. https://devguide.python.org/devcycle/ https://devguide.python.org/#branchstatus https://www.python.org/dev/peps/pep-0494/ https://www.python.org/dev/peps/pep-0537/ -- Ned Deily nad(a)python.org -- []

6 9

Governance vote results
by Antoine Pitrou Dec. 17, 2018

Dec. 17, 2018

Hello, I think readers of this mailing-list could be interested in the vote's results, which have been published just today: https://discuss.python.org/t/python-governance-vote-december-2018-results/5… In short, PEP 8016 ("The Steering Council Model", by Nathaniel and Donald) will define how Python development operates going forward. I encourage people to read the long-form results at the URL above, since the detailed rankings provide valuable information about the committers' overall preference as well. The next step will probably be to elect the first Steering Council: https://discuss.python.org/t/organizing-the-council-elections/549 That election again will be reserved to Python committers. Regards Antoine.

1 0

Julien Palard joins the Python Release Team as Documentation Expert
by Ned Deily Dec. 16, 2018

Dec. 16, 2018

https://discuss.python.org/t/julien-palard-joins-the-python-release-team-as… -- Ned Deily nad(a)python.org -- []

3 2

Summary of Python tracker Issues
by Python tracker Dec. 14, 2018

Dec. 14, 2018

ACTIVITY SUMMARY (2018-12-07 - 2018-12-14) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6908 ( +4) closed 40341 (+57) total 47249 (+61) Open issues with patches: 2751 Issues opened (41) ================== #35440: Setup failed 0x80072f7d - Unspecified error https://bugs.python.org/issue35440 opened by DesignEngineer #35441: Dead (and buggy) code due to mishandling of PyList_SetItem() e https://bugs.python.org/issue35441 opened by ZackerySpytz #35442: Chain of several subcommands in argparse https://bugs.python.org/issue35442 opened by porton #35448: ConfigParser .read() - handling of nonexistent files https://bugs.python.org/issue35448 opened by Adrian Wielgosik #35449: documenting objects https://bugs.python.org/issue35449 opened by stefan #35450: venv module doesn't create a copy of python binary by default https://bugs.python.org/issue35450 opened by mkkot #35453: pathlib.Path: glob and rglob should accept PathLike patterns https://bugs.python.org/issue35453 opened by ciupicri #35455: Solaris thread_time doesn't work with current implementation https://bugs.python.org/issue35455 opened by kulikjak #35457: robotparser reads empty robots.txt file as "all denied" https://bugs.python.org/issue35457 opened by larsfuse #35459: Use PyDict_GetItemWithError() instead of PyDict_GetItem() https://bugs.python.org/issue35459 opened by serhiy.storchaka #35460: Add PyDict_GetItemStringWithError https://bugs.python.org/issue35460 opened by ronaldoussoren #35461: Document C API functions which swallow exceptions https://bugs.python.org/issue35461 opened by serhiy.storchaka #35462: test_imaplib.test_enable_UTF8_True_append() failed on AMD64 Fr https://bugs.python.org/issue35462 opened by vstinner #35463: mock uses incorrect signature for partial and partialmethod wi https://bugs.python.org/issue35463 opened by xtreak #35465: [asyncio] Document loop.add_signal_handler https://bugs.python.org/issue35465 opened by hniksic #35466: Use a linked list for the ceval pending calls. https://bugs.python.org/issue35466 opened by eric.snow #35467: IDLE: unrequested pasting into Shell after restart https://bugs.python.org/issue35467 opened by terry.reedy #35469: [2.7] time.asctime() regression https://bugs.python.org/issue35469 opened by vstinner #35470: A deadly decref in _PyImport_FindExtensionObjectEx() https://bugs.python.org/issue35470 opened by ZackerySpytz #35472: python 3.7.2 rc1 bumped the build requirements for no reason https://bugs.python.org/issue35472 opened by doko #35473: Intel compiler (icc) does not fully support C11 Features, incl https://bugs.python.org/issue35473 opened by jamie schnaitter #35474: mimetypes.guess_all_extensions potentially mutates list https://bugs.python.org/issue35474 opened by rmccampbell7 #35475: Docs do not show PyImport_AddModuleObject() returns a borrowed https://bugs.python.org/issue35475 opened by eric.snow #35476: _imp_create_dynamic_impl() does not clear error. https://bugs.python.org/issue35476 opened by eric.snow #35478: multiprocessing: ApplyResult.get() hangs if the pool is termin https://bugs.python.org/issue35478 opened by vstinner #35479: multiprocessing.Pool.join() always takes at least 100 ms https://bugs.python.org/issue35479 opened by vstinner #35480: argparse: add a full fledged parser as a subparser https://bugs.python.org/issue35480 opened by porton #35482: python372rc1.chm is ill https://bugs.python.org/issue35482 opened by Ma Lin #35483: tarfile.extractall on existing symlink in Ubuntu overwrites ta https://bugs.python.org/issue35483 opened by michael.brandl(a)aid-driving.eu #35484: Segmentation fault due to faulthandler on Solaris https://bugs.python.org/issue35484 opened by kulikjak #35485: Mac: tkinter windows turn black while resized https://bugs.python.org/issue35485 opened by terry.reedy #35486: subprocess module breaks backwards compatibility with import h https://bugs.python.org/issue35486 opened by dw #35488: pathlib Path.match does not behave as described https://bugs.python.org/issue35488 opened by anthony shaw #35490: Remove the DecodeFSDefault return converter in Argument Clinic https://bugs.python.org/issue35490 opened by serhiy.storchaka #35492: Missing colon on func statement in library/sys doc https://bugs.python.org/issue35492 opened by seluj78 #35493: multiprocessing.Pool._worker_handler(): use SIGCHLD to be noti https://bugs.python.org/issue35493 opened by vstinner #35494: Inaccurate error message for f-string https://bugs.python.org/issue35494 opened by seblin #35495: argparse does not honor default argument for nargs=argparse.RE https://bugs.python.org/issue35495 opened by rgov #35496: left-to-right violation in match order https://bugs.python.org/issue35496 opened by steve.newcomb #35497: Libary select docs enhance https://bugs.python.org/issue35497 opened by Manjusaka #35498: Parents objects in pathlib.Path don't support slices as __geti https://bugs.python.org/issue35498 opened by thejcannon Most recent 15 issues with no replies (15) ========================================== #35498: Parents objects in pathlib.Path don't support slices as __geti https://bugs.python.org/issue35498 #35497: Libary select docs enhance https://bugs.python.org/issue35497 #35496: left-to-right violation in match order https://bugs.python.org/issue35496 #35495: argparse does not honor default argument for nargs=argparse.RE https://bugs.python.org/issue35495 #35490: Remove the DecodeFSDefault return converter in Argument Clinic https://bugs.python.org/issue35490 #35483: tarfile.extractall on existing symlink in Ubuntu overwrites ta https://bugs.python.org/issue35483 #35482: python372rc1.chm is ill https://bugs.python.org/issue35482 #35476: _imp_create_dynamic_impl() does not clear error. https://bugs.python.org/issue35476 #35474: mimetypes.guess_all_extensions potentially mutates list https://bugs.python.org/issue35474 #35473: Intel compiler (icc) does not fully support C11 Features, incl https://bugs.python.org/issue35473 #35463: mock uses incorrect signature for partial and partialmethod wi https://bugs.python.org/issue35463 #35461: Document C API functions which swallow exceptions https://bugs.python.org/issue35461 #35457: robotparser reads empty robots.txt file as "all denied" https://bugs.python.org/issue35457 #35455: Solaris thread_time doesn't work with current implementation https://bugs.python.org/issue35455 #35448: ConfigParser .read() - handling of nonexistent files https://bugs.python.org/issue35448 Most recent 15 issues waiting for review (15) ============================================= #35497: Libary select docs enhance https://bugs.python.org/issue35497 #35494: Inaccurate error message for f-string https://bugs.python.org/issue35494 #35492: Missing colon on func statement in library/sys doc https://bugs.python.org/issue35492 #35490: Remove the DecodeFSDefault return converter in Argument Clinic https://bugs.python.org/issue35490 #35479: multiprocessing.Pool.join() always takes at least 100 ms https://bugs.python.org/issue35479 #35478: multiprocessing: ApplyResult.get() hangs if the pool is termin https://bugs.python.org/issue35478 #35475: Docs do not show PyImport_AddModuleObject() returns a borrowed https://bugs.python.org/issue35475 #35470: A deadly decref in _PyImport_FindExtensionObjectEx() https://bugs.python.org/issue35470 #35466: Use a linked list for the ceval pending calls. https://bugs.python.org/issue35466 #35465: [asyncio] Document loop.add_signal_handler https://bugs.python.org/issue35465 #35461: Document C API functions which swallow exceptions https://bugs.python.org/issue35461 #35459: Use PyDict_GetItemWithError() instead of PyDict_GetItem() https://bugs.python.org/issue35459 #35455: Solaris thread_time doesn't work with current implementation https://bugs.python.org/issue35455 #35450: venv module doesn't create a copy of python binary by default https://bugs.python.org/issue35450 #35441: Dead (and buggy) code due to mishandling of PyList_SetItem() e https://bugs.python.org/issue35441 Top 10 most discussed issues (10) ================================= #35348: Problems with handling the file command output in platform.arc https://bugs.python.org/issue35348 11 msgs #35402: Upgrade macOS and Windows installers to Tcl 8.6.9 and Tk 8.6.9 https://bugs.python.org/issue35402 11 msgs #33725: Python crashes on macOS after fork with no exec https://bugs.python.org/issue33725 10 msgs #35292: Make SimpleHTTPRequestHandler load mimetypes lazily https://bugs.python.org/issue35292 10 msgs #35208: IDLE: Squeezed lines count ignores window width https://bugs.python.org/issue35208 8 msgs #35449: documenting objects https://bugs.python.org/issue35449 8 msgs #32417: fromutc does not respect datetime subclasses https://bugs.python.org/issue32417 7 msgs #34616: implement "Async exec" https://bugs.python.org/issue34616 6 msgs #35493: multiprocessing.Pool._worker_handler(): use SIGCHLD to be noti https://bugs.python.org/issue35493 6 msgs #34313: Tkinter crashes with Tk-related error on macOS with ActiveTcl https://bugs.python.org/issue34313 5 msgs Issues closed (55) ================== #6835: doctest problem with decorated function when decorator is defi https://bugs.python.org/issue6835 closed by serhiy.storchaka #9960: test_structmembers fails on s390x (bigendian 64-bit): int/Py_s https://bugs.python.org/issue9960 closed by serhiy.storchaka #9999: test_shutil cross-file-system tests are fragile (may not test https://bugs.python.org/issue9999 closed by serhiy.storchaka #15095: test_imaplib problem - intermittent skips and LOGINDISABLED no https://bugs.python.org/issue15095 closed by vstinner #17185: unittest mock create_autospec doesn't correctly replace mocksi https://bugs.python.org/issue17185 closed by cjw296 #20118: test_imaplib test_linetoolong fails on 2.7 in SSL test on some https://bugs.python.org/issue20118 closed by vstinner #20800: Cannot run gui tests twice. https://bugs.python.org/issue20800 closed by terry.reedy #22005: datetime.__setstate__ fails decoding python2 pickle https://bugs.python.org/issue22005 closed by serhiy.storchaka #23874: Encrypted MSI fails to install with code 2755 https://bugs.python.org/issue23874 closed by terry.reedy #25219: Update doc for Idle command line options. https://bugs.python.org/issue25219 closed by terry.reedy #26704: unittest.mock.patch: Double patching instance method: Attribut https://bugs.python.org/issue26704 closed by cjw296 #31374: expat: warning: "_POSIX_C_SOURCE" redefined https://bugs.python.org/issue31374 closed by vstinner #31446: _winapi.CreateProcess (used by subprocess) is not thread-safe https://bugs.python.org/issue31446 closed by serhiy.storchaka #31823: Opaque default value for close_fds argument in Popen.__init__ https://bugs.python.org/issue31823 closed by gregory.p.smith #32153: mock.create_autospec fails if an attribute is a partial functi https://bugs.python.org/issue32153 closed by cjw296 #32788: Better error handling in sqlite3 https://bugs.python.org/issue32788 closed by serhiy.storchaka #33106: Deleting a key in a read-only gdbm results in KeyError, not gd https://bugs.python.org/issue33106 closed by xiang.zhang #33747: Failed separate test_patch_propogrates_exc_on_exit in test_uni https://bugs.python.org/issue33747 closed by serhiy.storchaka #34245: Python library should be installed writable https://bugs.python.org/issue34245 closed by ned.deily #34977: Release Windows Store app containing Python https://bugs.python.org/issue34977 closed by steve.dower #35050: Off-by-one bug in AF_ALG https://bugs.python.org/issue35050 closed by vstinner #35052: Coverity scan: copy/paste error in Lib/xml/dom/minidom.py https://bugs.python.org/issue35052 closed by vstinner #35097: IDLE add doc subsection for editor windows https://bugs.python.org/issue35097 closed by terry.reedy #35122: Process not exiting on unhandled exception when using multipro https://bugs.python.org/issue35122 closed by pablogsal #35213: IDLE: use 'macOS' where appropriate. https://bugs.python.org/issue35213 closed by terry.reedy #35330: When using mock to wrap an existing object, side_effect requir https://bugs.python.org/issue35330 closed by cjw296 #35338: set union/intersection/difference could accept zero arguments https://bugs.python.org/issue35338 closed by josh.r #35346: Modernize Lib/platform.py code https://bugs.python.org/issue35346 closed by vstinner #35351: LTOFLAGS are passed to BASECFLAGS when using LTO https://bugs.python.org/issue35351 closed by ned.deily #35383: lib2to3 raises ParseError on argument called "print" https://bugs.python.org/issue35383 closed by martin.panter #35401: Upgrade Windows and macOS installers to use OpenSSL 1.1.0j / 1 https://bugs.python.org/issue35401 closed by ned.deily #35413: test_multiprocessing_fork: test_del_pool() leaks dangling thre https://bugs.python.org/issue35413 closed by vstinner #35426: test_signal.test_interprocess_signal() race condition https://bugs.python.org/issue35426 closed by vstinner #35429: Incorrect use of raise NotImplemented https://bugs.python.org/issue35429 closed by brett.cannon #35433: Correctly detect installed SDK versions https://bugs.python.org/issue35433 closed by steve.dower #35438: Cleanup extension functions using _PyObject_LookupSpecial https://bugs.python.org/issue35438 closed by josh.r #35439: New class instance not initializing variables of type list https://bugs.python.org/issue35439 closed by ammar2 #35443: Add Tail Call Optimization https://bugs.python.org/issue35443 closed by midnio #35444: Unify and optimize the helper for getting a builtin object https://bugs.python.org/issue35444 closed by serhiy.storchaka #35445: Do not ignore errors when create posix.environ https://bugs.python.org/issue35445 closed by serhiy.storchaka #35446: incorrect example https://bugs.python.org/issue35446 closed by serhiy.storchaka #35447: Redundant try-except block in urllib https://bugs.python.org/issue35447 closed by serhiy.storchaka #35451: Incorrect reference counting for sys.warnoptions and sys._xopt https://bugs.python.org/issue35451 closed by serhiy.storchaka #35452: Make PySys_HasWarnOptions() to never raise an exception https://bugs.python.org/issue35452 closed by serhiy.storchaka #35454: Fix miscellaneous issues in error handling https://bugs.python.org/issue35454 closed by serhiy.storchaka #35456: asyncio.Task.set_result() and set_exception() missing docstrin https://bugs.python.org/issue35456 closed by yselivanov #35458: test_shutil.test_disk_usage() randomly fails when tests are ru https://bugs.python.org/issue35458 closed by vstinner #35464: json.dumps very unclear exception https://bugs.python.org/issue35464 closed by serhiy.storchaka #35468: [3.6/3.7] idlelib/help.html mentions 3.8alpha0 docs https://bugs.python.org/issue35468 closed by terry.reedy #35471: Remove macpath module https://bugs.python.org/issue35471 closed by vstinner #35477: multiprocessing.Pool.__enter__() should raise an exception if https://bugs.python.org/issue35477 closed by vstinner #35481: Run Tasks cannot Concurrent https://bugs.python.org/issue35481 closed by asvetlov #35487: setup()'s package_data not following directory symlink https://bugs.python.org/issue35487 closed by F. Eugene Aumson #35489: Argument Clinic should use "const Py_UNICODE *" for the Py_UNI https://bugs.python.org/issue35489 closed by serhiy.storchaka #35491: multiprocessing: enhance repr() to ease debugging https://bugs.python.org/issue35491 closed by vstinner

1 0

[RELEASE] Python 3.7.2rc1 and 3.6.8rc1 now available for testing
by Ned Deily Dec. 12, 2018

Dec. 12, 2018

https://blog.python.org/2018/12/python-372rc1-and-368rc1-now-available.html Python 3.7.2rc1 and 3.6.8rc1 are now available. 3.7.2rc1 is the release preview of the next maintenance release of Python 3.7, the latest feature release of Python. 3.6.8rc1 is the release preview of the next and last maintenance release of Python 3.6, the previous feature release of Python. Assuming no critical problems are found prior to 2018-12-20, no code changes are planned between these release candidates and the final releases. These release candidates are intended to give you the opportunity to test the new security and bug fixes in 3.7.2 and 3.6.8. We strongly encourage you to test your projects and report issues found to bugs.python.org as soon as possible. Please keep in mind that these are preview releases and, thus, their use is not recommended for production environments. You can find these releases and more information here: https://www.python.org/downloads/release/python-372rc1/ https://www.python.org/downloads/release/python-368rc1/ -- Ned Deily nad(a)python.org -- []

2 3

Usage of the multiprocessing API and object lifetime
by Victor Stinner Dec. 11, 2018

Dec. 11, 2018

Hi, tzickel reported a reference cycle bug in multiprocessing which keeps threads and processes alive: https://bugs.python.org/issue34172 He wrote a fix which has been merged in 3.6, 3.7 and master branches. But Pablo Galindo noticed that the fix breaks the following code (he added "I found the weird code in the example in several projects."): import multiprocessing def the_test(): print("Begin") for x in multiprocessing.Pool().imap(int, ["4", "3"]): print(x) print("End") the_test() Pablo proposed to add a strong reference to the Pool from multiprocessing iterators: https://bugs.python.org/issue35378 I blocked his pull request because I see this change as a risk of new reference cycles. Since we are close to 3.6 and 3.7 releases, I decided to revert the multiprocessing fix instead. Pablo's issue35378 evolved to add a weak reference in iterators to try to detect when the Pool is destroyed: raise an exception from the iterator, if possible. Then a discussion started on how the multiprocessing API is supposed to be used and about the lifetime of multiprocessing objects. I would prefer to make the multiprocessing API stricter: Python shouldn't try to guess how long an object is going to live. The API user has to *explicitly* release resources. tzickel noted that the documentations says: "When the pool object is garbage collected terminate() will be called immediately." And that multiprocessing rely on the garbage collector to release resources, especially using multiprocessing.util.Finalize tool: class Finalize(object): ''' Class which supports object finalization using weakrefs ''' def __init__(self, obj, callback, ...): ... if obj is not None: self._weakref = weakref.ref(obj, self) else: assert exitpriority is not None ... _finalizer_registry[self._key] = self I propose to start to emit ResourceWarning in Python 3.8 when objects are not released explicitly. I wrote a first change to emit ResourceWarning in the Pool object: https://bugs.python.org/issue35424 https://github.com/python/cpython/pull/10974 By the way, I'm surprised that "with pool:" doesn't release all resources. An additional "pool.join()" is needed to ensure that all resources are released. It's a little bit surprising to have to emit a ResourceWarning if join() has not been called, even if the code uses "with pool:". I don't know well the multiprocessing API, so I'm not sure in which directions we should go: best effort to support strange legacy code with "implicit object lifetime", or become stricter in Python 3.8? >From a technical point of view, I would prefer to become stricter. Relying on the garbage collector means that the code is going to behave badly on PyPy which uses a different garbage collector implementation :-( Victor -- Night gathers, and now my watch begins. It shall not end until my death.

4 8

Re: [Python-Dev] Usage of the multiprocessing API and object lifetime
by Pablo Galindo Salgado Dec. 11, 2018

Dec. 11, 2018

> > Pablo's issue35378 evolved to add a weak reference in iterators to try > > to detect when the Pool is destroyed: raise an exception from the > > iterator, if possible. > That's an ok fix for me. I am playing with weakreferences inside the iterator and result objects, but this may not be enough/a complete solution. For example, take the code of ApplyResult.get: def get(self, timeout=None): if self._pool() is None: # self._pool is a weakref raise RuntimeError("The pool is dead. Aborting") <--- new code self.wait(timeout) It can be that the pool is alive when we check for it (self._pool() is None) but while the code is waiting with no timeout (timeout=None) the pool dies, effectively leaving the program deadlocked with no error. -- I agree that misusage of the pool should not be encouraged but in this situation the fact that this code hangs: import multiprocessing for x in multiprocessing.Pool().imap(int, ["4", "3"]): print(x) is a bit worriying because although is incorrect and an abuse of the API, users can do this easily with no error message other than a misterious hang. I have found this on several places and people were very confused because usually the interpreter throws some kind of error indication. In my humble opinion, we should try to avoid hanging as a consequence of the misusage, whatever we do. Pablo

2 2

windows compiler list missing 3.7 details on wiki
by Barry Scott Dec. 9, 2018

Dec. 9, 2018

On https://wiki.python.org/moin/WindowsCompilers details for 3.7 are missing. I'm assuming its still VC V14 Barry

2 2

I reverted "Add Windows App Store package" change
by Victor Stinner Dec. 9, 2018

Dec. 9, 2018

Hi, I had to revert a change since it broke buildbots. Sadly, I don't have the bandwidth to investigate the failures and try to fix the change :-( A large change has been pushed into the 3.7 and master branches to "Add Windows App Store package": "Release Windows Store app containing Python" https://bugs.python.org/issue34977 These changes broke all Windows buildbots: "Almost all Windows buildbots are failing to compile" https://bugs.python.org/issue35437 So I reverted these two changes. It's a large change which mostly add new files, but also make changes in different files: --- commit 468a15aaf9206448a744fc5eab3fc21f51966aad Author: Steve Dower <steve.dower(a)microsoft.com> Date: Thu Dec 6 21:09:20 2018 -0800 bpo-34977: Add Windows App Store package (GH-10245) .azure-pipelines/windows-appx-test.yml | 65 +++ .gitattributes | 1 + Doc/make.bat | 2 + Lib/test/test_pathlib.py | 2 +- Lib/test/test_venv.py | 1 + Lib/venv/__init__.py | 49 +- .../2018-10-30-13-39-17.bpo-34977.0l7_QV.rst | 1 + PC/classicAppCompat.can.xml | Bin 0 -> 3978 bytes PC/classicAppCompat.cat | Bin 0 -> 10984 bytes PC/classicAppCompat.sccd | Bin 0 -> 18503 bytes PC/getpathp.c | 8 +- PC/icons/pythonwx150.png | Bin 0 -> 8187 bytes PC/icons/pythonwx44.png | Bin 0 -> 2232 bytes PC/icons/pythonx150.png | Bin 0 -> 8271 bytes PC/icons/pythonx44.png | Bin 0 -> 2178 bytes PC/icons/pythonx50.png | Bin 0 -> 2190 bytes PC/launcher.c | 220 +++++++- PC/layout/__init__.py | 0 PC/layout/__main__.py | 14 + PC/layout/main.py | 612 +++++++++++++++++++++ PC/layout/support/__init__.py | 0 PC/layout/support/appxmanifest.py | 487 ++++++++++++++++ PC/layout/support/catalog.py | 44 ++ PC/layout/support/constants.py | 28 + .../support/distutils.command.bdist_wininst.py | 25 + PC/layout/support/filesets.py | 100 ++++ PC/layout/support/logging.py | 93 ++++ PC/layout/support/options.py | 122 ++++ PC/layout/support/pip.py | 79 +++ PC/layout/support/props.py | 110 ++++ {Tools/nuget => PC/layout/support}/python.props | 0 PC/pylauncher.rc | 6 + PC/python_uwp.cpp | 226 ++++++++ PC/store_info.txt | 146 +++++ PCbuild/_tkinter.vcxproj | 6 + PCbuild/find_msbuild.bat | 10 + PCbuild/pcbuild.proj | 3 + PCbuild/pcbuild.sln | 72 +++ PCbuild/python.props | 3 +- PCbuild/python_uwp.vcxproj | 86 +++ PCbuild/pythoncore.vcxproj | 15 + PCbuild/pythonw_uwp.vcxproj | 86 +++ PCbuild/venvlauncher.vcxproj | 85 +++ PCbuild/venvwlauncher.vcxproj | 85 +++ Tools/msi/buildrelease.bat | 13 +- Tools/msi/make_appx.ps1 | 71 +++ Tools/msi/make_cat.ps1 | 34 ++ Tools/msi/make_zip.proj | 9 +- Tools/msi/make_zip.py | 250 --------- Tools/msi/sdktools.psm1 | 43 ++ Tools/msi/sign_build.ps1 | 34 ++ Tools/nuget/make_pkg.proj | 38 +- 52 files changed, 3053 insertions(+), 331 deletions(-) --- Note: the commit message is a single line. Now I have questions :-) It seems like the change is "experimental": https://bugs.python.org/issue34977#msg331267 """ Making the *release experimental* as part of the next 3.7 update was approved by Ned (over email), so I merged the build. As soon as we snap for the RC I'll kick off an update and make the store page public, and hopefully can promote it enough to get eyes on it. Unfortunately, I discovered as part of a test submission that the minimum Windows version matters, and it's a version that hasn't been rolled out fully yet *because of some bugs*, so there may not be that many people who can use it this first time. But that will *improve over time*, and I'm sure I can find enough people to flush out issues before the next release (anyone on the Windows Insiders program should be fine). """ If it's experimental, why pushing it *right now* to the 3.7 branch? Can't we wait until it's stable enough? Even if it's stable, I'm not sure sure that it should go into 3.7 which is a stable branch. I guess that Steve would like to get this feature into 3.7.2. Ned Deily (3.7 release changer) approved this change. The pull request was merged one week after it has been created, I don't see any review. https://github.com/python/cpython/pull/10245 In general, I'm fine with merging changes without any kind of review, when the change is small. I'm doing it *frequently* when I'm confident that the change is small and safe enough. But here, the change is quite large. Sadly, I know the problem: the lack of available developers for review. There are very few developers who know Windows and are available to provide a review. Sometimes, Zachary Ware or Eryk Sun are around and can help. I'm fine with iterating in the master branch, since the change seems to be separated from CPython core: it mostly add new files. My concern is more about changes on "Python itself": the venv and tests changes. In the middle of the large change, there is small change on the venv module: diff --git a/Lib/venv/__init__.py b/Lib/venv/__init__.py index 043420897e..5438b0d4e5 100644 --- a/Lib/venv/__init__.py +++ b/Lib/venv/__init__.py @@ -64,10 +64,11 @@ class EnvBuilder: self.system_site_packages = False self.create_configuration(context) self.setup_python(context) + if not self.upgrade: + self.setup_scripts(context) if self.with_pip: self._setup_pip(context) if not self.upgrade: - self.setup_scripts(context) self.post_setup(context) if true_system_site_packages: Moreover, the commit also changes tests: * Lib/test/test_pathlib.py * Lib/test/test_venv.py The commit message is just "bpo-34977: Add Windows App Store package (GH-10245)", it doesn't explain these changes. I would prefer to see these changes extracted into separated commits. Sadly, right now on the cpython project on GitHub, we are only allowed to squash all commits into a single commit (note: the individual commit in the PR doesn't explain these venv/tests changes neither). So I suggest to create multiple PRs (at least one for venv+pathlib changes and a second for the Windows AppStore). I guess that these changes are bugfixes or enhancement. Having a separated change should also ease to backport these changes up to 3.6 ;-) -- Jeremy Kloth just created: "Correctly detect installed SDK versions" https://bugs.python.org/issue35433 I'm not sure if it's related to the AppStore change? Victor -- Night gathers, and now my watch begins. It shall not end until my death.

6 10

Summary of Python tracker Issues
by Python tracker Dec. 7, 2018

Dec. 7, 2018

ACTIVITY SUMMARY (2018-11-30 - 2018-12-07) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6904 (+24) closed 40284 (+50) total 47188 (+74) Open issues with patches: 2743 Issues opened (49) ================== #35364: Datetime “fromtimestamp()” ignores inheritance if timezone https://bugs.python.org/issue35364 opened by Delgan #35366: Monkey Patching class derived from ctypes.Union doesn't work https://bugs.python.org/issue35366 opened by rvijayc #35368: [2.7] Make PyMem_Malloc() thread-safe in debug mode https://bugs.python.org/issue35368 opened by vstinner #35370: Provide API to set the tracing function to be used for running https://bugs.python.org/issue35370 opened by fabioz #35374: Windows doc build does not find autodetected hhc.exe https://bugs.python.org/issue35374 opened by chrullrich #35376: modulefinder skips nested modules with same name as top-level https://bugs.python.org/issue35376 opened by rdb #35377: urlparse doesn't validate the scheme https://bugs.python.org/issue35377 opened by devkral #35378: multiprocessing.Pool.imaps iterators do not maintain alive the https://bugs.python.org/issue35378 opened by pablogsal #35379: IDLE's close fails when io.filename set to None https://bugs.python.org/issue35379 opened by rhettinger #35381: Heap-allocated posixmodule types https://bugs.python.org/issue35381 opened by eelizondo #35383: lib2to3 raises ParseError on argument called "print" https://bugs.python.org/issue35383 opened by n_rosenstein #35385: time module: why not using tzname from the glibc? https://bugs.python.org/issue35385 opened by vstinner #35387: Dialogs on IDLE are accompanied by a small black window https://bugs.python.org/issue35387 opened by wordtech #35388: _PyRuntime_Initialize() called after Py_Finalize() does nothin https://bugs.python.org/issue35388 opened by vstinner #35391: threading.RLock exception handling while waiting https://bugs.python.org/issue35391 opened by Omer Bartal #35392: Create asyncio/sockutils.py https://bugs.python.org/issue35392 opened by asvetlov #35393: Typo in documentation https://bugs.python.org/issue35393 opened by autom #35394: Add __slots__ = () to asyncio protocols https://bugs.python.org/issue35394 opened by asvetlov #35397: Undeprecate and document urllib.parse.unwrap https://bugs.python.org/issue35397 opened by steven.daprano #35398: SQLite incorrect row count for UPDATE https://bugs.python.org/issue35398 opened by Montana Low #35399: Sysconfig bug https://bugs.python.org/issue35399 opened by neyuru #35400: PGOMGR : warning PG0188: https://bugs.python.org/issue35400 opened by neyuru #35401: Upgrade Windows and macOS installers to use OpenSSL 1.1.0j / 1 https://bugs.python.org/issue35401 opened by ned.deily #35402: Upgrade macOS (and Windows?) installer to Tcl/Tk 8.6.9.1 https://bugs.python.org/issue35402 opened by ned.deily #35403: support application/wasm in mimetypes and http.server https://bugs.python.org/issue35403 opened by pmpp #35404: Document how to import _structure in email.message https://bugs.python.org/issue35404 opened by charlax #35409: Async generator might re-throw GeneratorExit on aclose() https://bugs.python.org/issue35409 opened by vxgmichel #35410: copy.deepcopy does not respect metaclasses with __deepcopy__ i https://bugs.python.org/issue35410 opened by elibixby #35412: test_future4 ran no test https://bugs.python.org/issue35412 opened by vstinner #35413: test_multiprocessing_fork: test_del_pool() leaks dangling thre https://bugs.python.org/issue35413 opened by vstinner #35414: A reference counting bug in PyState_RemoveModule() https://bugs.python.org/issue35414 opened by ZackerySpytz #35415: fileno argument to socket.socket is not validated https://bugs.python.org/issue35415 opened by Dima.Tisnek #35416: Fix potential resource warnings in distutils https://bugs.python.org/issue35416 opened by Tiger-222 #35417: Double parenthesis in print function running 2to3 in already c https://bugs.python.org/issue35417 opened by jondaa #35419: Thread.is_alive while running Process.is_alive causes either p https://bugs.python.org/issue35419 opened by Hexorg #35420: how to migrate a c-extension module to one that supports subin https://bugs.python.org/issue35420 opened by mattip #35422: misleading error message from ssl.get_server_certificate() whe https://bugs.python.org/issue35422 opened by cedricvanrompay #35423: Signal handling machinery still relies on "pending calls". https://bugs.python.org/issue35423 opened by eric.snow #35424: multiprocessing.Pool: emit ResourceWarning https://bugs.python.org/issue35424 opened by vstinner #35425: test_eintr fails randomly on AMD64 FreeBSD 10-STABLE Non-Debug https://bugs.python.org/issue35425 opened by vstinner #35426: test_signal.test_interprocess_signal() race condition https://bugs.python.org/issue35426 opened by vstinner #35427: logging UnicodeDecodeError from undecodable strftime output https://bugs.python.org/issue35427 opened by mark.dickinson #35428: xml.etree.ElementTree.tostring violates W3 standards allowing https://bugs.python.org/issue35428 opened by Zim #35429: Incorrect use of raise NotImplemented https://bugs.python.org/issue35429 opened by rth #35431: The math module should provide a function for computing binomi https://bugs.python.org/issue35431 opened by kellerfuchs #35432: str.format and string.Formatter bug with French (and other) lo https://bugs.python.org/issue35432 opened by canuck7 #35433: Correctly detect installed SDK versions https://bugs.python.org/issue35433 opened by jkloth #35435: Documentation of 3.3 is available https://bugs.python.org/issue35435 opened by matrixise #35436: Add missing PyErr_NoMemory() calls https://bugs.python.org/issue35436 opened by ZackerySpytz Most recent 15 issues with no replies (15) ========================================== #35425: test_eintr fails randomly on AMD64 FreeBSD 10-STABLE Non-Debug https://bugs.python.org/issue35425 #35420: how to migrate a c-extension module to one that supports subin https://bugs.python.org/issue35420 #35419: Thread.is_alive while running Process.is_alive causes either p https://bugs.python.org/issue35419 #35415: fileno argument to socket.socket is not validated https://bugs.python.org/issue35415 #35413: test_multiprocessing_fork: test_del_pool() leaks dangling thre https://bugs.python.org/issue35413 #35410: copy.deepcopy does not respect metaclasses with __deepcopy__ i https://bugs.python.org/issue35410 #35409: Async generator might re-throw GeneratorExit on aclose() https://bugs.python.org/issue35409 #35404: Document how to import _structure in email.message https://bugs.python.org/issue35404 #35402: Upgrade macOS (and Windows?) installer to Tcl/Tk 8.6.9.1 https://bugs.python.org/issue35402 #35401: Upgrade Windows and macOS installers to use OpenSSL 1.1.0j / 1 https://bugs.python.org/issue35401 #35400: PGOMGR : warning PG0188: https://bugs.python.org/issue35400 #35399: Sysconfig bug https://bugs.python.org/issue35399 #35397: Undeprecate and document urllib.parse.unwrap https://bugs.python.org/issue35397 #35394: Add __slots__ = () to asyncio protocols https://bugs.python.org/issue35394 #35392: Create asyncio/sockutils.py https://bugs.python.org/issue35392 Most recent 15 issues waiting for review (15) ============================================= #35436: Add missing PyErr_NoMemory() calls https://bugs.python.org/issue35436 #35433: Correctly detect installed SDK versions https://bugs.python.org/issue35433 #35431: The math module should provide a function for computing binomi https://bugs.python.org/issue35431 #35429: Incorrect use of raise NotImplemented https://bugs.python.org/issue35429 #35424: multiprocessing.Pool: emit ResourceWarning https://bugs.python.org/issue35424 #35423: Signal handling machinery still relies on "pending calls". https://bugs.python.org/issue35423 #35416: Fix potential resource warnings in distutils https://bugs.python.org/issue35416 #35415: fileno argument to socket.socket is not validated https://bugs.python.org/issue35415 #35414: A reference counting bug in PyState_RemoveModule() https://bugs.python.org/issue35414 #35409: Async generator might re-throw GeneratorExit on aclose() https://bugs.python.org/issue35409 #35404: Document how to import _structure in email.message https://bugs.python.org/issue35404 #35398: SQLite incorrect row count for UPDATE https://bugs.python.org/issue35398 #35394: Add __slots__ = () to asyncio protocols https://bugs.python.org/issue35394 #35381: Heap-allocated posixmodule types https://bugs.python.org/issue35381 #35378: multiprocessing.Pool.imaps iterators do not maintain alive the https://bugs.python.org/issue35378 Top 10 most discussed issues (10) ================================= #34172: multiprocessing.Pool and ThreadPool leak resources after being https://bugs.python.org/issue34172 25 msgs #35431: The math module should provide a function for computing binomi https://bugs.python.org/issue35431 18 msgs #10496: Python startup should not require passwd entry https://bugs.python.org/issue10496 13 msgs #34977: Release Windows Store app containing Python https://bugs.python.org/issue34977 12 msgs #35378: multiprocessing.Pool.imaps iterators do not maintain alive the https://bugs.python.org/issue35378 11 msgs #22005: datetime.__setstate__ fails decoding python2 pickle https://bugs.python.org/issue22005 9 msgs #34850: Emit a syntax warning for "is" with a literal https://bugs.python.org/issue34850 7 msgs #35377: urlparse doesn't validate the scheme https://bugs.python.org/issue35377 7 msgs #35433: Correctly detect installed SDK versions https://bugs.python.org/issue35433 7 msgs #35364: Datetime “fromtimestamp()” ignores inheritance if timezone https://bugs.python.org/issue35364 6 msgs Issues closed (50) ================== #16865: ctypes arrays >=2GB in length causes exception https://bugs.python.org/issue16865 closed by serhiy.storchaka #20371: datetime.datetime.replace bypasses a subclass's __new__ https://bugs.python.org/issue20371 closed by belopolsky #22496: urllib2 fails against IIS (urllib2 can't parse 401 reply www-a https://bugs.python.org/issue22496 closed by deronnax #25862: TextIOWrapper assertion failure after read() and SEEK_CUR https://bugs.python.org/issue25862 closed by serhiy.storchaka #29564: ResourceWarning: suggest to enable tracemalloc in the message https://bugs.python.org/issue29564 closed by vstinner #31177: unittest mock's reset_mock throws an error when an attribute h https://bugs.python.org/issue31177 closed by xtreak #32787: Better error handling in ctypes https://bugs.python.org/issue32787 closed by serhiy.storchaka #33709: test.support.FS_NONASCII returns incorrect result in Windows w https://bugs.python.org/issue33709 closed by serhiy.storchaka #34052: sqlite's create_function() raises exception on unhashable call https://bugs.python.org/issue34052 closed by serhiy.storchaka #34185: Lib/test/test_bdb.py failed when ran as a script https://bugs.python.org/issue34185 closed by serhiy.storchaka #34604: Possible mojibake in pwd.getpwnam and grp.getgrnam https://bugs.python.org/issue34604 closed by serhiy.storchaka #34738: Distutils: ZIP files don't include directory entries https://bugs.python.org/issue34738 closed by serhiy.storchaka #34784: Heap-allocated StructSequences https://bugs.python.org/issue34784 closed by petr.viktorin #34987: A possible null pointer dereference in _pickle.c's save_reduce https://bugs.python.org/issue34987 closed by ZackerySpytz #35226: mock.call equality surprisingly broken https://bugs.python.org/issue35226 closed by cjw296 #35250: Minor parameter documentation mismatch for turtle https://bugs.python.org/issue35250 closed by serhiy.storchaka #35305: subprocess.Popen(['/sbin/ldconfig', '-p'], stdin=PIPE) itself https://bugs.python.org/issue35305 closed by vstinner #35310: select which was interrupted by EINTR isn't re-run if the time https://bugs.python.org/issue35310 closed by vstinner #35316: test_eintr fails randomly on macOS https://bugs.python.org/issue35316 closed by vstinner #35341: Add generic version of OrderedDict to typing module https://bugs.python.org/issue35341 closed by levkivskyi #35344: platform: get macOS version rather than darwin version https://bugs.python.org/issue35344 closed by vstinner #35352: test_asyncio fails on RHEL8, or on Fedora using NEXT security https://bugs.python.org/issue35352 closed by vstinner #35357: unittest.mock.call can't represent calls to a method called 'p https://bugs.python.org/issue35357 closed by cjw296 #35359: [2.7][Windows] Define _CRT_SECURE_NO_WARNINGS to build Modules https://bugs.python.org/issue35359 closed by vstinner #35363: test_eintr: test_open() hangs randomly on x86-64 El Capitan 3. https://bugs.python.org/issue35363 closed by vstinner #35365: Use wchar_t* buffer instead of Unicode object in code page dec https://bugs.python.org/issue35365 closed by serhiy.storchaka #35367: FileExistsError During os.symlink() Displays Arrow in the Wron https://bugs.python.org/issue35367 closed by eryksun #35369: List sorting makes duplicate comparisons https://bugs.python.org/issue35369 closed by rhettinger #35371: Fix undefined behavior in os.utime() on Windows https://bugs.python.org/issue35371 closed by serhiy.storchaka #35372: Code page decoder incorrectly handles input >2GiB https://bugs.python.org/issue35372 closed by serhiy.storchaka #35373: PyInit_timezone() must return a value https://bugs.python.org/issue35373 closed by vstinner #35375: name shadowing while a module tries to import another https://bugs.python.org/issue35375 closed by ksriram #35380: Enable TCP_NODELAY for proactor event loop https://bugs.python.org/issue35380 closed by asvetlov #35382: Something wrong with pymysql https://bugs.python.org/issue35382 closed by mark.dickinson #35384: The repr of ctypes.CArgObject fails for non-ascii character https://bugs.python.org/issue35384 closed by serhiy.storchaka #35386: ftp://www.pythontest.net/ returns error 500 https://bugs.python.org/issue35386 closed by vstinner #35389: Use gnu_get_libc_version() in platform.libc_ver()? https://bugs.python.org/issue35389 closed by vstinner #35390: ctypes not possible to pass NULL c_void_p in structure by refe https://bugs.python.org/issue35390 closed by dtamayo #35395: Typo in asyncio eventloop documentation https://bugs.python.org/issue35395 closed by asvetlov #35396: Add support for __fspath__ to fnmatch.fnmatchase and filter https://bugs.python.org/issue35396 closed by adelfino #35405: Wrong traceback for AssertionError while running under pdb https://bugs.python.org/issue35405 closed by xtreak #35406: calendar.nextmonth and calendar.prevmonth functions doesn't ch https://bugs.python.org/issue35406 closed by asocia #35407: Datetime function with selenium https://bugs.python.org/issue35407 closed by steven.daprano #35408: Python3.7 crash in PyCFunction_New due to broken _PyObject_GC_ https://bugs.python.org/issue35408 closed by vstinner #35411: FTP tests of test_urllib2net fail on Travis CI: 425 Security: https://bugs.python.org/issue35411 closed by vstinner #35418: python hung or stuck somtimes randomly on windows server 2008R https://bugs.python.org/issue35418 closed by Cao Hongfu #35421: Expected result is not clear in case of list.append(list) https://bugs.python.org/issue35421 closed by eric.smith #35430: Lib/argparse.py uses `is` for string comparison https://bugs.python.org/issue35430 closed by serhiy.storchaka #35434: Wrong bpo linked in What's New in 3.8 https://bugs.python.org/issue35434 closed by Mariatta #35437: Almost all Windows buildbots are failing to compile https://bugs.python.org/issue35437 closed by vstinner

1 0