Mailman 3 September 2018 - Python-Dev

Official citation for Python
by Jacqueline Kazil 23 Sep '18

23 Sep '18

The PSF has received a few inquiries asking the question — “How do I cite Python?”So, I am reaching out to you all to figure this out. (For those that don’t know my background, I have been in academia for a bit as a Ph.D student and have worked at the Library of Congress writing code to process Marc records <https://www.loc.gov/marc/bibliographic/>, among other things.) IMHO the citation for Python should be decided upon by the Python developers and should live somewhere on the site. Two questions to be answered… 1. What format should it take? 2. Where does it live on the site? To help frame the first one, I quickly wrote this up — https://docs.google.com/document/d/1R0mo8EYVIPNkmNBImpcZTbk0e78T2oU71ioX5Nv… tldr; Summary of possibilities… 1. Article for one citation (1 DOI, generated by the publication) 2. No article (many DOIs — one for each major version through Zenodo <https://zenodo.org/record/1404209> (or similar service)) Discuss. -Jackie Jackie Kazil Board of Directors, PSF

13 34

(no subject)
by R Alshammrei 23 Sep '18

23 Sep '18

------------------------------ في 8 سبتمبر ، 2017 في تمام الساعة 12:30 بعد منتصف الليل ، سيقوم Masayuki YAMAMOTO < ma3yuki.8mamo10 at gmail.com <https://mail.python.org/mailman/listinfo/python-dev> > كتب: > *مرحبا يا قوم، * > > *I إرسال PEP 539 المسودة الثالثة للالنهاية. شكرا لجميع النصائح * > *والمساعدة! * شكرا لك إريك وياماموتو سان لجميع عملك على هذا PEP! تبدو التحديثات جيدة ، لذلك يسعدني أن أقول إن BDFL-Delegate ذلك الاقتراح مقبول الآن :) مع تحياتي، نيك. - نيك كوغلان ncoghlan في gmail.com <https://mail.python.org/mailman/listinfo/python-dev> | بريسبان، أستراليا ------------------------------ - Previous message (by thread): [Python-Dev] PEP 539 v3: A C new API for Thread-Local Storage in CPython <https://mail.python.org/pipermail/python-dev/2017-September/149354.html> - الرسالة التالية (بواسطة مؤشر الترابط): [Python-Dev] PEP 539 v3: واجهة برمجة تطبيقات C جديدة للتخزين المحلي الخيطي في CPython <https://mail.python.org/pipermail/python-dev/2017-September/149371.html> - *تم فرز الرسائل حسب: *[date] <https://mail.python.org/pipermail/python-dev/2017-September/date.html#149358> [thread] <https://mail.python.org/pipermail/python-dev/2017-September/thread.html#149…> [subject] <https://mail.python.org/pipermail/python-dev/2017-September/subject.html#14…> [author] <https://mail.python.org/pipermail/python-dev/2017-September/author.html#149…> ------------------------------ مزيد من المعلومات حول القائمة البريدية لـ Python-Dev <https://mail.python.org/mailman/listinfo/python-dev>

1 0

SEC: Spectre variant 2: GCC: -mindirect-branch=thunk -mindirect-branch-register
by Wes Turner 21 Sep '18

21 Sep '18

Should Python builds add `-mindirect-branch=thunk -mindirect-branch-register` to CFLAGS? Where would this be to be added in the build scripts with which architectures? /QSpectre is the MSVC build flag for Spectre Variant 1: > The /Qspectre option is available in Visual Studio 2017 version 15.7 and later. https://docs.microsoft.com/en-us/cpp/build/reference/qspectre?view=vs-2017 security@ directed me to the issue tracker / lists, so I'm forwarding this to python-dev and python-ideas, as well. # Forwarded message From: *Wes Turner* <wes.turner(a)gmail.com> Date: Wednesday, September 12, 2018 Subject: SEC: Spectre variant 2: GCC: -mindirect-branch=thunk -mindirect-branch-register To: distutils-sig <distutils-sig(a)python.org> Should C extensions that compile all add `-mindirect-branch=thunk -mindirect-branch-register` [1] to mitigate the risk of Spectre variant 2 (which does indeed affect user space applications as well as kernels)? [1] https://github.com/speed47/spectre-meltdown-checker/ issues/119#issuecomment-361432244 [2] https://en.wikipedia.org/wiki/Spectre_(security_vulnerability) [3] https://en.wikipedia.org/wiki/Speculative_Store_Bypass# Speculative_execution_exploit_variants On Wednesday, September 12, 2018, Wes Turner <wes.turner(a)gmail.com> wrote: > >> On Wednesday, September 12, 2018, Joni Orponen <j.orponen(a)4teamwork.ch> >> wrote: >> >>> On Wed, Sep 12, 2018 at 8:48 PM Wes Turner <wes.turner(a)gmail.com> wrote: >>> >>>> Should C extensions that compile all add >>>> `-mindirect-branch=thunk -mindirect-branch-register` [1] to mitigate >>>> the risk of Spectre variant 2 (which does indeed affect user space >>>> applications as well as kernels)? >>>> >>> >>> Are those available on GCC <= 4.2.0 as per PEP 513? >>> >> >> AFAIU, only >> GCC 7.3 and 8 have the retpoline (indirect-branch=thunk) support enabled >> by the `-mindirect-branch=thunk -mindirect-branch-register` CFLAGS. >> > On Wednesday, September 12, 2018, Wes Turner <wes.turner(a)gmail.com> wrote: > "What is a retpoline and how does it work?" > https://stackoverflow.com/questions/48089426/what-is-a- > retpoline-and-how-does-it-work > >

7 17

Summary of Python tracker Issues
by Python tracker 21 Sep '18

21 Sep '18

ACTIVITY SUMMARY (2018-09-14 - 2018-09-21) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6795 (-24) closed 39723 (+111) total 46518 (+87) Open issues with patches: 2711 Issues opened (63) ================== #19756: test_nntplib: sporadic failures, network isses? server down? https://bugs.python.org/issue19756 reopened by berker.peksag #34682: Typo reports on docs@ https://bugs.python.org/issue34682 opened by zach.ware #34683: Caret positioned wrong for SyntaxError reported by ast.c https://bugs.python.org/issue34683 opened by gvanrossum #34686: Add `-r`, as opposed to `-R` to Python core interpreter https://bugs.python.org/issue34686 opened by lepaperwan #34687: asyncio: is it time to make ProactorEventLoop as the default e https://bugs.python.org/issue34687 opened by vstinner #34688: Segfault in pandas that works fine on 3.7 https://bugs.python.org/issue34688 opened by xtreak #34689: Lib/sysconfig.py expands non-variables https://bugs.python.org/issue34689 opened by lepaperwan #34690: Store startup modules as C structures for 20%+ startup speed i https://bugs.python.org/issue34690 opened by larry #34691: _contextvars missing in x64 master branch Windows build? https://bugs.python.org/issue34691 opened by tim.peters #34696: PyByteArray_FromObject() has undocumented (and untested) behav https://bugs.python.org/issue34696 opened by ZackerySpytz #34697: ctypes: Crash if manually-created CField instance is used https://bugs.python.org/issue34697 opened by izbyshev #34698: urllib.request.Request.set_proxy doesn't (necessarily) replace https://bugs.python.org/issue34698 opened by tburke #34699: allow path-like objects in program arguments in Windows https://bugs.python.org/issue34699 opened by guoci #34700: typing.get_type_hints doesn't know about typeshed https://bugs.python.org/issue34700 opened by Ben.Darnell #34701: Asyncio documentation for recursive coroutines is lacking https://bugs.python.org/issue34701 opened by azaria.zornberg #34702: urlopen doesn't handle query strings with "file" scheme https://bugs.python.org/issue34702 opened by liZe #34704: Do not access ob_type directly, introduce Py_TP https://bugs.python.org/issue34704 opened by nascheme #34705: Python 3.8 changes how returns through finally clauses are tra https://bugs.python.org/issue34705 opened by nedbat #34706: Signature.from_callable sometimes drops subclassing https://bugs.python.org/issue34706 opened by bukzor #34707: Python not reentrant https://bugs.python.org/issue34707 opened by skaller #34708: Odd crashes/freezes when sys.stdout.shell.console is typed https://bugs.python.org/issue34708 opened by Harrison Chudleigh #34709: Suggestion: make getuser.getpass() also look at SUDO_USER envi https://bugs.python.org/issue34709 opened by Amos S #34711: return ENOTDIR when open() accepts filenames with a trailing s https://bugs.python.org/issue34711 opened by Michael.Felt #34713: csvwriter.writerow()'s return type is undocumented https://bugs.python.org/issue34713 opened by nchammas #34714: timeout in test_multiprocessing_spawn x86 Windows7 3.x buildbo https://bugs.python.org/issue34714 opened by pablogsal #34716: MagicMock.__divmod__ should return a pair https://bugs.python.org/issue34716 opened by serhiy.storchaka #34720: Fix test_importlib.test_bad_traverse for AIX https://bugs.python.org/issue34720 opened by Michael.Felt #34722: Non-deterministic bytecode generation https://bugs.python.org/issue34722 opened by Peter Ebden #34724: argparse subparser help indent too short https://bugs.python.org/issue34724 opened by TakingItCasual #34725: Py_GetProgramFullPath() odd behaviour in Windows https://bugs.python.org/issue34725 opened by mariofutire #34726: Add support of checked hash-based pycs in zipimport https://bugs.python.org/issue34726 opened by serhiy.storchaka #34728: deprecate *loop* argument for asyncio.sleep https://bugs.python.org/issue34728 opened by yselivanov #34730: aclose() doesn't stop raise StopAsyncIteration / GeneratorExit https://bugs.python.org/issue34730 opened by dfee #34732: uuid returns version more than 5 https://bugs.python.org/issue34732 opened by jophine pranjal #34734: Azure linux buildbot failure https://bugs.python.org/issue34734 opened by xtreak #34736: Confusing base64.b64decode output https://bugs.python.org/issue34736 opened by mark.dickinson #34737: Python upgrade with SYSTEM account uninstalls python https://bugs.python.org/issue34737 opened by JatinGoel #34738: Distutils: ZIP files don't include directory entries https://bugs.python.org/issue34738 opened by serhiy.storchaka #34739: Get rid of tp_getattro in xml.etree.ElementTree.XMLParser https://bugs.python.org/issue34739 opened by serhiy.storchaka #34740: Get rid of tp_getattro in ossaudiodev.oss_audio_device https://bugs.python.org/issue34740 opened by serhiy.storchaka #34741: Get rid of tp_getattro and tp_setattro in pyexpat.xmlparser https://bugs.python.org/issue34741 opened by serhiy.storchaka #34742: Add optional argument for exit status in argparse.ArgumentPars https://bugs.python.org/issue34742 opened by Ankit Goel #34744: New %(flag)s format specifier for argparse.add_argument help s https://bugs.python.org/issue34744 opened by helmsman helmsman #34745: asyncio ssl memory leak https://bugs.python.org/issue34745 opened by thehesiod #34747: SSLSocket.context cannot be changed on non-connected sockets https://bugs.python.org/issue34747 opened by vincent-nexedi #34748: Incorrect HTML link in functools.partial https://bugs.python.org/issue34748 opened by xitop #34749: improve performance of binascii.a2b_base64() https://bugs.python.org/issue34749 opened by sir-sigurd #34750: locals().update doesn't work in Enum body, even though direct https://bugs.python.org/issue34750 opened by Antony.Lee #34751: Hash collisions for tuples https://bugs.python.org/issue34751 opened by jdemeyer #34752: warnings.warn fails silently with unicode input https://bugs.python.org/issue34752 opened by nparslow #34753: Use coroutine object or coroutine function instead of coroutin https://bugs.python.org/issue34753 opened by Windson Yang #34756: Few changes in sys.breakpointhook() https://bugs.python.org/issue34756 opened by serhiy.storchaka #34757: Placeholder for discussion on Combined patches for AIX - to re https://bugs.python.org/issue34757 opened by Michael.Felt #34758: http.server module sets incorrect mimetype for WebAssembly fil https://bugs.python.org/issue34758 opened by travisoneill #34759: Possible regression in ssl module in 3.7.1 and master https://bugs.python.org/issue34759 opened by njs #34760: Regression in abc in combination with passing a function to is https://bugs.python.org/issue34760 opened by glaubich #34761: str(super()) != super().__str__() https://bugs.python.org/issue34761 opened by Guillaume Dominici #34762: Change contextvars C API to use PyObject https://bugs.python.org/issue34762 opened by yselivanov #34763: Python lacks 0x4E17 https://bugs.python.org/issue34763 opened by 草木建 #34764: Improve documentation example for using iter() with sentinel v https://bugs.python.org/issue34764 opened by ChrisRands #34765: Update install-sh https://bugs.python.org/issue34765 opened by cstratak #34766: BaseProxy cache should be cleaned when Manager client is recon https://bugs.python.org/issue34766 opened by wynfred #34767: Optimize asyncio.Lock https://bugs.python.org/issue34767 opened by yselivanov Most recent 15 issues with no replies (15) ========================================== #34767: Optimize asyncio.Lock https://bugs.python.org/issue34767 #34766: BaseProxy cache should be cleaned when Manager client is recon https://bugs.python.org/issue34766 #34764: Improve documentation example for using iter() with sentinel v https://bugs.python.org/issue34764 #34763: Python lacks 0x4E17 https://bugs.python.org/issue34763 #34758: http.server module sets incorrect mimetype for WebAssembly fil https://bugs.python.org/issue34758 #34757: Placeholder for discussion on Combined patches for AIX - to re https://bugs.python.org/issue34757 #34752: warnings.warn fails silently with unicode input https://bugs.python.org/issue34752 #34749: improve performance of binascii.a2b_base64() https://bugs.python.org/issue34749 #34748: Incorrect HTML link in functools.partial https://bugs.python.org/issue34748 #34747: SSLSocket.context cannot be changed on non-connected sockets https://bugs.python.org/issue34747 #34741: Get rid of tp_getattro and tp_setattro in pyexpat.xmlparser https://bugs.python.org/issue34741 #34740: Get rid of tp_getattro in ossaudiodev.oss_audio_device https://bugs.python.org/issue34740 #34720: Fix test_importlib.test_bad_traverse for AIX https://bugs.python.org/issue34720 #34716: MagicMock.__divmod__ should return a pair https://bugs.python.org/issue34716 #34714: timeout in test_multiprocessing_spawn x86 Windows7 3.x buildbo https://bugs.python.org/issue34714 Most recent 15 issues waiting for review (15) ============================================= #34763: Python lacks 0x4E17 https://bugs.python.org/issue34763 #34762: Change contextvars C API to use PyObject https://bugs.python.org/issue34762 #34759: Possible regression in ssl module in 3.7.1 and master https://bugs.python.org/issue34759 #34758: http.server module sets incorrect mimetype for WebAssembly fil https://bugs.python.org/issue34758 #34757: Placeholder for discussion on Combined patches for AIX - to re https://bugs.python.org/issue34757 #34756: Few changes in sys.breakpointhook() https://bugs.python.org/issue34756 #34751: Hash collisions for tuples https://bugs.python.org/issue34751 #34749: improve performance of binascii.a2b_base64() https://bugs.python.org/issue34749 #34744: New %(flag)s format specifier for argparse.add_argument help s https://bugs.python.org/issue34744 #34741: Get rid of tp_getattro and tp_setattro in pyexpat.xmlparser https://bugs.python.org/issue34741 #34740: Get rid of tp_getattro in ossaudiodev.oss_audio_device https://bugs.python.org/issue34740 #34739: Get rid of tp_getattro in xml.etree.ElementTree.XMLParser https://bugs.python.org/issue34739 #34738: Distutils: ZIP files don't include directory entries https://bugs.python.org/issue34738 #34732: uuid returns version more than 5 https://bugs.python.org/issue34732 #34728: deprecate *loop* argument for asyncio.sleep https://bugs.python.org/issue34728 Top 10 most discussed issues (10) ================================= #34589: Py_Initialize() and Py_Main() should not enable C locale coerc https://bugs.python.org/issue34589 21 msgs #34751: Hash collisions for tuples https://bugs.python.org/issue34751 14 msgs #19756: test_nntplib: sporadic failures, network isses? server down? https://bugs.python.org/issue19756 13 msgs #17239: XML vulnerabilities in Python https://bugs.python.org/issue17239 10 msgs #34759: Possible regression in ssl module in 3.7.1 and master https://bugs.python.org/issue34759 10 msgs #34732: uuid returns version more than 5 https://bugs.python.org/issue34732 9 msgs #34623: _elementtree.c doesn't call XML_SetHashSalt() https://bugs.python.org/issue34623 7 msgs #34686: Add `-r`, as opposed to `-R` to Python core interpreter https://bugs.python.org/issue34686 7 msgs #31635: test_strptime failure on OpenBSD https://bugs.python.org/issue31635 6 msgs #32557: allow shutil.disk_usage to take a file path on Windows also https://bugs.python.org/issue32557 6 msgs Issues closed (105) =================== #8450: httplib: false BadStatusLine() raised https://bugs.python.org/issue8450 closed by miss-islington #9148: os.execve puts process to background on windows https://bugs.python.org/issue9148 closed by eryksun #15713: PEP 3121, 384 Refactoring applied to zipimport module https://bugs.python.org/issue15713 closed by serhiy.storchaka #18174: Make regrtest with --huntrleaks check for fd leaks https://bugs.python.org/issue18174 closed by vstinner #18295: Possible integer overflow in PyCode_New() https://bugs.python.org/issue18295 closed by vstinner #19431: Document PyFrame_FastToLocals() and PyFrame_FastToLocalsWithEr https://bugs.python.org/issue19431 closed by vstinner #20414: Python 3.4 has two Overlapped types https://bugs.python.org/issue20414 closed by vstinner #21702: asyncio: remote_addr of create_datagram_endpoint() is not docu https://bugs.python.org/issue21702 closed by vstinner #23236: asyncio: add timeout to StreamReader read methods https://bugs.python.org/issue23236 closed by vstinner #23295: [Windows] asyncio: add UDP support to ProactorEventLoop https://bugs.python.org/issue23295 closed by vstinner #23327: zipimport to import from non-ascii pathname on Windows https://bugs.python.org/issue23327 closed by serhiy.storchaka #25750: tp_descr_get(self, obj, type) is called without owning a refer https://bugs.python.org/issue25750 closed by jdemeyer #26119: Windows Installer can sometimes silently fail pip stage https://bugs.python.org/issue26119 closed by steve.dower #26568: Add a new warnings.showwarnmsg() function taking a warnings.Wa https://bugs.python.org/issue26568 closed by vstinner #28955: Not matched behavior of numeric comparison with the documentat https://bugs.python.org/issue28955 closed by benjamin.peterson #29306: Check usage of Py_EnterRecursiveCall() and Py_LeaveRecursiveCa https://bugs.python.org/issue29306 closed by vstinner #29419: Argument Clinic: inline PyArg_UnpackTuple and PyArg_ParseStack https://bugs.python.org/issue29419 closed by vstinner #29451: Use _PyArg_Parser for _PyArg_ParseStack(): support positional https://bugs.python.org/issue29451 closed by vstinner #29465: Modify _PyObject_FastCall() to reduce stack consumption https://bugs.python.org/issue29465 closed by vstinner #29471: AST: add an attribute to FunctionDef to distinguish functions https://bugs.python.org/issue29471 closed by vstinner #29674: Use GCC __attribute__((alloc_size(x, y))) on PyMem_Malloc() fu https://bugs.python.org/issue29674 closed by vstinner #29881: Add a new private API clear private variables, which are initi https://bugs.python.org/issue29881 closed by vstinner #30170: "tests may fail, unable to create temporary directory" warning https://bugs.python.org/issue30170 closed by vstinner #30198: distutils build_ext: don't run newer_group() in parallel in mu https://bugs.python.org/issue30198 closed by vstinner #30227: test_site must not write outside the build directory: must not https://bugs.python.org/issue30227 closed by vstinner #30244: Emit a ResourceWarning in concurrent.futures executor destruct https://bugs.python.org/issue30244 closed by vstinner #30317: test_timeout() of test_multiprocessing_spawn.WithManagerTestBa https://bugs.python.org/issue30317 closed by vstinner #30318: test_distutils is too verbose on Windows https://bugs.python.org/issue30318 closed by vstinner #30816: test_open() of test_eintr timeout after 10 min on "x86-64 El C https://bugs.python.org/issue30816 closed by vstinner #30884: regrtest -jN --timeout=TIMEOUT should kill child process runni https://bugs.python.org/issue30884 closed by vstinner #31321: traceback.clear_frames() doesn't clear *all* frames https://bugs.python.org/issue31321 closed by vstinner #31392: Upgrade installers to OpenSSL 1.1.0g and 1.0.2n https://bugs.python.org/issue31392 closed by ned.deily #31531: crash and SystemError in case of a bad zipimport._zip_director https://bugs.python.org/issue31531 closed by serhiy.storchaka #31687: test_semaphore_tracker() of test_multiprocessing_spawn fails r https://bugs.python.org/issue31687 closed by vstinner #31958: UUID versions are not validated to lie in the documented range https://bugs.python.org/issue31958 closed by berker.peksag #32075: Expose ZipImporter Type Object in the include header files. https://bugs.python.org/issue32075 closed by serhiy.storchaka #32093: macOS: implement time.thread_time() using thread_info() https://bugs.python.org/issue32093 closed by vstinner #32128: test_nntplib: test_article_head_body() fails in SSL mode https://bugs.python.org/issue32128 closed by vstinner #32183: Coverity: CID 1423264: Insecure data handling (TAINTED_SCALA https://bugs.python.org/issue32183 closed by vstinner #32245: OSError: raw write() returned invalid length on latest Win 10 https://bugs.python.org/issue32245 closed by eryksun #32455: PyCompile_OpcodeStackEffect() and dis.stack_effect() are not p https://bugs.python.org/issue32455 closed by serhiy.storchaka #33070: Add platform triplet for RISC-V https://bugs.python.org/issue33070 closed by benjamin.peterson #33216: [3.5] Wrong order of stack for CALL_FUNCTION_VAR and CALL_FUNC https://bugs.python.org/issue33216 closed by serhiy.storchaka #33486: regen autotools related files https://bugs.python.org/issue33486 closed by petr.viktorin #33531: test_asyncio: test_subprocess test_stdin_broken_pipe() failure https://bugs.python.org/issue33531 closed by vstinner #33613: test_multiprocessing_fork: test_semaphore_tracker_sigint() fai https://bugs.python.org/issue33613 closed by vstinner #33649: asyncio docs overhaul https://bugs.python.org/issue33649 closed by yselivanov #33676: test_multiprocessing_fork: dangling threads warning https://bugs.python.org/issue33676 closed by vstinner #33680: regrtest: re-run failed tests in a subprocess https://bugs.python.org/issue33680 closed by vstinner #33683: asyncio: sendfile tests ignore SO_SNDBUF on Windows https://bugs.python.org/issue33683 closed by vstinner #33686: test_concurrent_futures: test_pending_calls_race() failed on x https://bugs.python.org/issue33686 closed by vstinner #33717: Enhance test.pythoninfo: meta-ticket for multiple changes https://bugs.python.org/issue33717 closed by vstinner #33718: Enhance regrtest: meta-ticket for multiple changes https://bugs.python.org/issue33718 closed by vstinner #33721: os.path.exists() ought to return False if pathname contains NU https://bugs.python.org/issue33721 closed by serhiy.storchaka #33868: test__xxsubinterpreters: test_subinterpreter() fails randomly https://bugs.python.org/issue33868 closed by vstinner #33920: test_asyncio: test_run_coroutine_threadsafe_with_timeout() fai https://bugs.python.org/issue33920 closed by vstinner #33966: test_multiprocessing_spawn.WithProcessesTestPool.test_tracebac https://bugs.python.org/issue33966 closed by vstinner #34011: Default preference not given to venv DLL's https://bugs.python.org/issue34011 closed by steve.dower #34125: Profiling depends on whether **kwargs is given https://bugs.python.org/issue34125 closed by jdemeyer #34131: test_threading: BarrierTests.test_default_timeout() failed on https://bugs.python.org/issue34131 closed by vstinner #34150: test_multiprocessing_spawn: Dangling processes leaked on AMD64 https://bugs.python.org/issue34150 closed by vstinner #34247: PYTHONOPTIMIZE ignored in 3.7.0 when using custom launcher https://bugs.python.org/issue34247 closed by ncoghlan #34285: regrtest: in case of test failure, add "always look on the bri https://bugs.python.org/issue34285 closed by vstinner #34341: Appending to ZIP archive blows up existing Central Directory e https://bugs.python.org/issue34341 closed by serhiy.storchaka #34354: Memory leak on _testCongestion https://bugs.python.org/issue34354 closed by petr.viktorin #34363: dataclasses.asdict() mishandles dataclass instance attributes https://bugs.python.org/issue34363 closed by eric.smith #34382: test_os.test_mode fails when directory base directory has g+s https://bugs.python.org/issue34382 closed by Michael.Felt #34458: No way to alternate options https://bugs.python.org/issue34458 closed by paul.j3 #34479: ArgumentParser subparser error display at the wrong level https://bugs.python.org/issue34479 closed by paul.j3 #34515: lib2to3: support non-ASCII identifiers https://bugs.python.org/issue34515 closed by benjamin.peterson #34560: Backport of uuid1() failure fix https://bugs.python.org/issue34560 closed by Riccardo Mottola #34585: Don't use AC_RUN_IFELSE to determine float endian https://bugs.python.org/issue34585 closed by benjamin.peterson #34587: test_socket: testCongestion() hangs on my Fedora 28 https://bugs.python.org/issue34587 closed by vstinner #34595: PyUnicode_FromFormat(): add %T format for an object type name https://bugs.python.org/issue34595 closed by vstinner #34603: ctypes on Windows: error calling C function that returns a str https://bugs.python.org/issue34603 closed by vstinner #34639: PYTHONCOERCECLOCALE is ignored when using -E or -I option https://bugs.python.org/issue34639 closed by vstinner #34651: Disallow fork in a subinterpreter. https://bugs.python.org/issue34651 closed by eric.snow #34656: memory exhaustion in Modules/_pickle.c:1393 https://bugs.python.org/issue34656 closed by benjamin.peterson #34663: Support POSIX_SPAWN_USEVFORK flag in posix_spawn https://bugs.python.org/issue34663 closed by pablogsal #34673: make the eval loop more editable https://bugs.python.org/issue34673 closed by benjamin.peterson #34681: Incorrect class name Pattern in sre_parse.py https://bugs.python.org/issue34681 closed by serhiy.storchaka #34684: Generate _geoslib.c with Cython 0.28.2 for Python 3.7 transiti https://bugs.python.org/issue34684 closed by zach.ware #34685: scheduler tests for posix_spawn fail on AMD64 FreeBSD 10.x Sha https://bugs.python.org/issue34685 closed by pablogsal #34692: ok https://bugs.python.org/issue34692 closed by serhiy.storchaka #34693: PEPping distutils/core.py https://bugs.python.org/issue34693 closed by berker.peksag #34694: Dismiss To Avoid Slave/Master wording cause it easier for non https://bugs.python.org/issue34694 closed by Mariatta #34695: sqlite3: Cache.get() crashes if Cache.__init__() was not calle https://bugs.python.org/issue34695 closed by berker.peksag #34703: Unexpected Arithmetic Result https://bugs.python.org/issue34703 closed by mark.dickinson #34710: SSL Module build fails with more pedantic compiler flags https://bugs.python.org/issue34710 closed by christian.heimes #34712: Style fixes in examples of "Input and Output" tutorial section https://bugs.python.org/issue34712 closed by ned.deily #34715: timemodule.c fails to compile on BSD https://bugs.python.org/issue34715 closed by benjamin.peterson #34717: docs: disable numbered sections for stdlib in html https://bugs.python.org/issue34717 closed by yselivanov #34718: Syntax error on factorial example https://bugs.python.org/issue34718 closed by magmax #34719: Deprecate set to frozenset conversion in set.__contains__ https://bugs.python.org/issue34719 closed by rhettinger #34721: json module loads function https://bugs.python.org/issue34721 closed by ammar2 #34723: lower() on Turkish letter "İ" returns a 2-chars-long string https://bugs.python.org/issue34723 closed by vstinner #34727: Windows/2.7.15 IOError [Errno 0] when user interacts with cmd https://bugs.python.org/issue34727 closed by eryksun #34729: bz2/lzma: Compressor/decompressor crash if __init__ is not cal https://bugs.python.org/issue34729 closed by izbyshev #34731: pathlib path.match misshandles multiple `**` https://bugs.python.org/issue34731 closed by Ronny.Pfannschmidt #34733: Missing search bar on docs.python.org https://bugs.python.org/issue34733 closed by yselivanov #34735: Modules/timemodule.c: Memory leak in time_strftime() https://bugs.python.org/issue34735 closed by serhiy.storchaka #34743: test_database_source_name fails with SQLite 3.7.9 https://bugs.python.org/issue34743 closed by berker.peksag #34746: Asyncio documentation have a error https://bugs.python.org/issue34746 closed by yselivanov #34754: test_flush_return_value fails on FreeBSD https://bugs.python.org/issue34754 closed by berker.peksag #34755: Few minor optimizations in _asynciomodule.c https://bugs.python.org/issue34755 closed by serhiy.storchaka

1 0

Late Python 3.7.1 changes to fix the C locale coercion (PEP 538) implementation
by Victor Stinner 21 Sep '18

21 Sep '18

Hi Unicode and locales lovers, tl; dr Nick, Ned, INADA-san: I modified 3.7.1 to add a new "-X coerce_c_locale=value" option and make sure that the C locale coercion cannot be when Python in embedded: are you ok with these changes? Before 3.7.0 release, during the implementation of the UTF-8 Mode (PEP 540), I changed two things in Nick Coghlan's implementation of the C locale coercion (PEP 538): (1) PYTHONCOERCECLOCALE environment variable is now ignored when -E or -I command line option is used. (2) When Python is embeded, the C locale coercion is now enabled if the LC_CTYPE locale is "C". Nick asked me to change the behavior: https://bugs.python.org/issue34589 I just pushed this change in the 3.7 branch which adds a new "-X coerce_c_locale=value" option: https://github.com/python/cpython/commit/144f1e2c6f4a24bd288c045986842c65cc… Examples using Pyhon 3.7 (future 3.7.1) with UTF-8 Mode disabled, to only test the C locale coercion: --- $ cat test.py import codecs, locale enc = locale.getpreferredencoding() enc = codecs.lookup(enc).name print(enc) $ export LC_ALL= LC_CTYPE=C LANG= # Disable C locale coercion: get ASCII as expected $ PYTHONCOERCECLOCALE=0 ./python -X utf8=0 test.py ascii # -E ignores PYTHONCOERCECLOCALE=0: # C locale is coerced, we get UTF-8 $ PYTHONCOERCECLOCALE=0 ./python -E -X utf8=0 test.py utf-8 # -X coerce_c_locale=0 is not affected by -E: # C locale coercion disabled as expected, get ASCII as expected $ ./python -E -X utf8=0 -X coerce_c_locale=0 test.py ascii --- For (1), Nick's use case is to get Python 3.6 behavior (C locale not coerced) on Python 3.7 using PYTHONCOERCECLOCALE. Nick proposed to use PYTHONCOERCECLOCALE even with -E or -I, but I dislike introducing a special case for -E option. I chose to add a new "-X coerce_c_locale=0" to Python 3.7.1 to provide a solution for this use case. (Python 3.7.0 and older ignore this option.) Note: Python 3.7.0 is fine with PYTHONCOERCECLOCALE=0, we are only talking about the special case of -E and -I options. For (2), I modified Python 3.7.1 to make sure the C locale is never coerced when the C API is used to embed Python inside an application: Py_Initialize() and Py_Main(). The C locale can only be coerced by the official Python program ("python3.7"). I don't know if it should be possible to enable C locale coercion when Python is embedded. So I just made the change requested by Nick :-) I dislike doing such late changes in 3.7.1, especially since PEP 538 has been designed by Nick Coghlan, and we disagree on the fix. But Ned Deily, our Python 3.7 release manager, wants to see last 3.7 fixes merged before Tuesday, so here we are. Nick, Ned, INADA-san: are you ok with these changes? The other choices for 3.7.1 are: * Revert my change: C locale coercion can still be enabled when Python is embedded, -E option ignores PYTHONCOERCECLOCALE env var. * Revert my change and apply Nick's PR 9257: C locale coercion cannot be enabled when Python is embedded and -E option doesn't ignore PYTHONCOERCECLOCALE env var. I spent months to fix the master branch to support all possible locales and encodings, and get a consistent CLI: https://vstinner.github.io/python3-locales-encodings.html So I'm not excited by Nick's PR which IMHO moves Python backward, especially it breaks the -E option contract: it doesn't ignore PYTHONCOERCECLOCALE env var. Victor

4 12

3.7.1 and 3.6.7 Releases Coming Soon
by Ned Deily 21 Sep '18

21 Sep '18

I have updated the schedules for the next maintenance releases of Python 3.7.x and 3.6.x. My original plan had been to get 3.7.1, the first 3.7 maintenance release, out by the end of July. It was solely my fault that that did not happen so I hope you'll accept my apologies; I will try to not let it happen again. I have now scheduled a 3.7.1 release candidate and rescheduled the 3.6.7 release candidate for 2018-09-18, about a week from today, and 3.7.1 final and 3.6.7 final for 2018-09-28. That allows us to take advantage of fixes generated at the Core Developers sprint taking place this week. Please review any open issues you are working on or are interested in and try to get them merged in to the 3.7 and/or 3.6 branches soon - by the beginning of next week at the latest. As usual, if there are any issues you believe need to be addressed prior to these releases, please ensure there are open issues for them in the bug tracker (bugs.python.org) and that their priorities are set accordingly (e.g. "release blocker"). Thanks for your support! --Ned -- Ned Deily nad(a)python.org -- []

2 3

Nearly - all tests PASS for AIX
by Michael 20 Sep '18

20 Sep '18

Dear all, The last two months I have spent nearly all my free time to cleanup "a frustration" - from my side - the long list of failing tests for AIX (there were nearly 20 when I started). atm - I am stuck on one - test_importlib (mail elsewhere), and the one I just finished (test_httpservers) may be overly simplified (just skipping the trailing-slash tests) - see issue34711 for a discussion. I would be grateful for feedback before I post it as a PR - to avoid working in circles. I hope you, the developers and development-minded community consider in a useful contribution. Currently - with all my proposed patches combined I have: 393 tests OK. 1 test failed: test_importlib 25 tests skipped: test_dbm_gnu test_devpoll test_epoll test_gdb test_idle test_kqueue test_lzma test_msilib test_ossaudiodev test_readline test_spwd test_sqlite test_startfile test_tcl test_tix test_tk test_ttk_guionly test_ttk_textonly test_turtle test_unicode_file test_unicode_file_functions test_winconsoleio test_winreg test_winsound test_zipfile64 1 re-run test: test_importlib Awaiting comments and suggestions. Many thanks for your time. Michael Felt

2 3

debugging test_importlib.test_bad_traverse - script status is SUCCESS - but FAIL is expected.
by Michael 20 Sep '18

20 Sep '18

I read the discussion related to issue32374. That seems to be sure that other events that could cause the test to fail (i.e., the program executes successfully) are caught early, and/or ignored so that the program fails - and the test succeeds. I am having trouble figuring out why the script below does not fail on AIX, and would appreciate your assistance in debugging what is happening, i.e., getting deeper. Many thanks! +270 @unittest.skipIf(not hasattr(sys, 'gettotalrefcount'), +271 '--with-pydebug has to be enabled for this test') +272 def test_bad_traverse(self): +273 ''' Issue #32374: Test that traverse fails when accessing per-module +274 state before Py_mod_exec was executed. +275 (Multiphase initialization modules only) +276 ''' +277 script = """if True: +278 try: +279 from test import support +280 import importlib.util as util +281 spec = util.find_spec('_testmultiphase') +282 spec.name = '_testmultiphase_with_bad_traverse' +283 +284 with support.SuppressCrashReport(): +285 m = spec.loader.create_module(spec) +286 except: +287 # Prevent Python-level exceptions from +288 # ending the process with non-zero status +289 # (We are testing for a crash in C-code) +290 pass""" +291 assert_python_failure("-c", script) To make sure the full debug info is loaded I added "-X dev", and for your reading added some additional print statements - and for speed run the command directly. Regardless of how I run it (calling as a test, or directly) the end-result is the same. # Note: I was not able to fine the default "loader.create_module() code" to add debugging statements. # Pointer for that is welcome! ./python -X dev '-X' 'faulthandler' '-I' '-c' "if True: try: from test import support import importlib.util as util spec = util.find_spec('_testmultiphase') spec.name = '_testmultiphase_with_bad_traverse' m = spec.loader.create_module(spec) print(m) print(dir(m)) print(m.__doc__) print(m.__loader__) print(m.__name__) print(m.__package__) print(m.__spec__) except: # Prevent Python-level exceptions from # ending the process with non-zero status # (We are testing for a crash in C-code) print('in except')" <module '_testmultiphase_with_bad_traverse'> ['__doc__', '__loader__', '__name__', '__package__', '__spec__'] Test module _testmultiphase_with_bad_traverse None _testmultiphase_with_bad_traverse None None root@x066:[/data/prj/python/git/Python3-3.8.0]echo $? 0 To get some additional idea of what is happening I added some fprintf statements: The additional debug info is: (see diff below) 1. bad_traverse:0 2. bad_traverse:0 1. bad_traverse:0 2. bad_traverse:0 1. bad_traverse:0 2. bad_traverse:0 *** To my SURPRISE *** only one routine with these print statements is ever called. I was expecting at more. (only bad_traverse(...) gets called, I was expecting both bad_traverse_test (Objects/moduleobject.c) and some kind of initialization of m_state->integer. Since the macro Py_VISIT includes a return() statement, and my debug statement always print the second line - I assume Py_VISIT(m_state->integer) is not doing anything (i.e., vret == 0) /* Utility macro to help write tp_traverse functions. * To use this macro, the tp_traverse function must name its arguments * "visit" and "arg". This is intended to keep tp_traverse functions * looking as much alike as possible. */ #define Py_VISIT(op) \ do { \ if (op) { \ int vret = visit((PyObject *)(op), arg); \ if (vret) \ return vret; \ } \ } while (0) Is this what it should be? root@x066:[/data/prj/python/git/Python3-3.8.0]git status On branch aix-pr Changes not staged for commit: (use "git add <file>..." to update what will be committed) (use "git checkout -- <file>..." to discard changes in working directory) modified: Modules/_testmultiphase.c modified: Objects/moduleobject.c no changes added to commit (use "git add" and/or "git commit -a") root@x066:[/data/prj/python/git/Python3-3.8.0]git diff root@x066:[/data/prj/python/git/Python3-3.8.0]git diff | cat diff --git a/Modules/_testmultiphase.c b/Modules/_testmultiphase.c index 5776df7d76..c28aef1455 100644 --- a/Modules/_testmultiphase.c +++ b/Modules/_testmultiphase.c @@ -622,23 +622,34 @@ PyInit__testmultiphase_exec_unreported_exception(PyObject *spec) static int bad_traverse(PyObject *self, visitproc visit, void *arg) { testmultiphase_state *m_state; +FILE *errmsg = fopen("/tmp/err", "a"); m_state = PyModule_GetState(self); +fprintf(errmsg,"1. bad_traverse:%ld\n", m_state->integer); Py_VISIT(m_state->integer); +fprintf(errmsg,"2. bad_traverse:%ld\n", m_state->integer); +fclose(errmsg); return 0; } static int execfunc_with_bad_traverse(PyObject *mod) { testmultiphase_state *m_state; +FILE *errmsg; +errmsg = fopen("/tmp/err", "a"); m_state = PyModule_GetState(mod); if (m_state == NULL) { +fprintf(errmsg,"0.execfunc:\n"); +fclose(errmsg); return -1; } m_state->integer = PyLong_FromLong(0x7fffffff); +fprintf(errmsg,"1.execfunc:%ld\n", m_state->integer); Py_INCREF(m_state->integer); +fprintf(errmsg,"2.execfunc:%ld\n", m_state->integer); +fclose(errmsg); return 0; } diff --git a/Objects/moduleobject.c b/Objects/moduleobject.c index ccf5f8e6d1..603611c686 100644 --- a/Objects/moduleobject.c +++ b/Objects/moduleobject.c @@ -27,6 +27,9 @@ static PyMemberDef module_members[] = { #ifdef Py_DEBUG static int bad_traverse_test(PyObject *self, void *arg) { +FILE *errmsg = fopen("/tmp/err","a"); +fprintf(errmsg,"bad_traverse_test: self!=NULL:%d\n", self != NULL); +fclose(errmsg); assert(self != NULL); return 0; } root@x066:[/data/prj/python/git/Python3-3.8.0] ~

2 2

[help] where to learn how to upgrade from 2.7 to 3
by Avery Richards 19 Sep '18

19 Sep '18

I am having so much fun learning python! I did not install the best version into my mac at first. Now I can't find out how to upgrade, (pip is awesome but not as conversational as I need it to be on the subject). I've downloaded the packages from python.org, installed all sorts of stuff, I configured my text editor to recognize python3, resolving formatting strings output, but now as I progress the [end = ' '] is not recognized. I have figured out a lot on my own, can you help me upgrade to 3.6 once and for all? Again I consulted with pip and followed faq websites (maybe a mistake there, idk). please please thank you! ~Avery

3 2

Request review of bpo-34125/GH-8416
by Jeroen Demeyer 18 Sep '18

18 Sep '18

The gist of bpo-34125 is that the following two statements behave differently with respect to sys.setprofile() profiling: >>> list.append([], None) >>> list.append([], None, **{}) More precisely: the former call is profiled, but the latter is not. The fix at GH-8416 is simply to make this consistent by also profiling the latter. Victor Stinner did not want to accept the pull request because he wanted "a wider discussion on function calls". I think that GH-8416 is a simple bugfix which can be merged anyway and which won't make future "discussions on function calls" any harder. In any case, it would be good to have any *decision* (accepted or rejected) on that PR. I find the current uncertainty worse than a decision either way. Right now, my reference implementation of PEP 580 conflicts with that branch and I would like to resolve that conflict after GH-8416 has been decided. Links: https://bugs.python.org/issue34125 https://github.com/python/cpython/pull/8416 Thanks, Jeroen Demeyer.

1 0