Mailman 3 March 2017 - Python-Dev

__del__ is not called after creating a new reference
by Oleg Nesterov 02 Apr '17

02 Apr '17

Hello, I already tried to ask on python-list, see https://mail.python.org/pipermail/python-list/2017-March/720037.html but it seems that this list is not for technical questions. Let me resend my question to python-dev. Please tell me if I should not spam this list with newbiesh questions, and thanks in advance. --------------------------------------------------------------------------- I started to learn python a few days ago and I am trying to understand what __del__() actually does. https://docs.python.org/3/reference/datamodel.html says: object.__del__(self) ... Note that it is possible (though not recommended!) for the __del__() method to postpone destruction of the instance by creating a new reference to it. It may then be called at a later time when this new reference is deleted. However, this trivial test-case class C: def __del__(self): print("DEL") global X X = self C() print(X) X = 0 print(X) shows that __del__ is called only once, it is not called again after "X = 0": DEL <__main__.C object at 0x7f067695f4a8> 0 (Just in case, I verified later that this object actually goes away and its memory is freed, so the problem is not that it still has a reference). I've cloned https://github.com/python/cpython.git and everything looks clear at first glance (but let me repeat that I am very new to python): PyObject_CallFinalizerFromDealloc() calls PyObject_CallFinalizer() which finally calls "__del__" method in slot_tp_finalize(), then it notices that "X = self" creates the new reference and does: /* tp_finalize resurrected it! Make it look like the original Py_DECREF * never happened. */ refcnt = self->ob_refcnt; _Py_NewReference(self); self->ob_refcnt = refcnt; However, PyObject_CallFinalizer() also does _PyGC_SET_FINALIZED(self, 1) and that is why __del__ is not called again after "X = 0": /* tp_finalize should only be called once. */ if (PyType_IS_GC(tp) && _PyGC_FINALIZED(self)) return; The comment and the code are very explicit, so this does nt look like a bug in cpython. Probably the docs should be fixed? Or this code is actually wrong? The test-case works as documented if I remove _PyGC_SET_FINALIZED() in PyObject_CallFinalizer() or add another _PyGC_SET_FINALIZED(self, 0) into PyObject_CallFinalizerFromDealloc() after _Py_NewReference(self), but yes, yes, I understand that this is not correct and won't really help. Oleg.

5 6

Developing a Python JIT and have troubld
by Yuheng Zou 01 Apr '17

01 Apr '17

I am building a Python JIT, so I want to change the interp->eval_frame to my own function. I built a C++ library which contains EvalFrame function, and then use dlopen and dlsym to use it. It looks like this: extern "C" PyObject *EvalFrame(PyFrameObject *f, int throwflag) { return _PyEval_EvalFrameDefault(f, throwflag);} I added following code to Python/pylifecycle.c at function _Py_InitializeEx_ Private(Python version is 3.6.1): void *pyjit = NULL; pyjit = dlopen("../cmake-build-debug/libPubbon.dylib", 0);if (pyjit != NULL) { interp->eval_frame = (_PyFrameEvalFunction)dlsym(pyjit, "EvalFrame"); //interp->eval_frame = _PyEval_EvalFrameDefault;} Then something strange happened. I used LLDB to trace the variables. When it ran at EvalFrame, the address of f pointer didn't change, but f->f_lineno changed. Why the address of the pointer didn't change, but the context change? I am working on Mac OS X and Python 3.6.1. I want to know how to replace _PyEval_EvalFrameDefault in interp->eval_frame with my own function.

2 2

Questions on the CPython Git master branch: how to exclude commits of 3.x branches?
by Victor Stinner 31 Mar '17

31 Mar '17

Hi, The CPython repository was converted from Mercurial to Git. Before with Mercurial, we used extensively merges. For example, a bug was fixed in branche 3.5, merged into 3.6 and then merged into master. With the conversion to Git, some merges commit are removed, some others are kept. My question is how to list commits which are only part of the "master" branch, as "hg log default" in Mercurial. "git log origin/master" lists also commits coming from 3.x branches and their merges. The problem is that if you pick a commit from a different branch, you compile Python 3.x, instead of compiling Python for the master branch. Right now, my need is to find the first commit in the "master" branch after a specific date. For example, find the first commit after 2016-01-01 00:00. Naive solution: --- $ git log --since="2016-01-01 00:00" origin/master --reverse|head commit 75e3630c6071819d3674d956ea754ccb4fed5271 Author: Benjamin Peterson <benjamin(a)python.org> Date: Fri Jan 1 10:23:45 2016 -0600 2016 will be another year of writing copyrighted code --- If you compile the revision 75e3630c6071819d3674d956ea754ccb4fed5271, you get Python 3.3: --- $ grep PY_M Include/patchlevel.h #define PY_MAJOR_VERSION 3 #define PY_MINOR_VERSION 3 #define PY_MICRO_VERSION 6 --- But if you exclude manually commits which are in branches 3.x, you get the commit 71db903563906cedfc098418659d1200043cd14c which gives a different Python version: --- $ grep PY_M Include/patchlevel.h #define PY_MAJOR_VERSION 3 #define PY_MINOR_VERSION 6 #define PY_MICRO_VERSION 0 --- In fact, I wrote a tool to manually exclude commits of branches 3.x: https://github.com/haypo/misc/blob/master/misc/find_git_revisions_by_date.py But it's super slow! Are there builtin options to only show Git commits which are in master branch but not in 3.x branches? Asked differently: how can I only see two commits on the following range? What are [options]? git rev-list 288cb25f1a208fe09b9e06ba479e11c1157da4b5..71db903563906cedfc098418659d1200043cd14c [options] Commits after 2016-01-01: --- $ git checkout 71db903563906cedfc098418659d1200043cd14c $ git log --graph * commit 71db903563906cedfc098418659d1200043cd14c |\ Merge: 288cb25 4c70293 | | Author: Benjamin Peterson <benjamin(a)python.org> | | Date: Fri Jan 1 10:25:22 2016 -0600 | | | | merge 3.5 | | | * commit 4c70293755ce8ea0adc5b224c714da2b7625d232 | |\ Merge: 42bf8fc e8c2a95 | | | Author: Benjamin Peterson <benjamin(a)python.org> | | | Date: Fri Jan 1 10:25:12 2016 -0600 | | | | | | merge 3.4 | | | | | * commit e8c2a957c87980a1fd79c39597d40e5c5aeb7048 | | |\ Merge: 52d6c2c 75e3630 | | | | Author: Benjamin Peterson <benjamin(a)python.org> | | | | Date: Fri Jan 1 10:24:21 2016 -0600 | | | | | | | | merge 3.3 | | | | | | | * commit 75e3630c6071819d3674d956ea754ccb4fed5271 | | | | Author: Benjamin Peterson <benjamin(a)python.org> | | | | Date: Fri Jan 1 10:23:45 2016 -0600 | | | | | | | | 2016 will be another year of writing copyrighted code | | | | * | | | commit 288cb25f1a208fe09b9e06ba479e11c1157da4b5 |\ \ \ \ Merge: 58f8833 42bf8fc | |/ / / Author: Serhiy Storchaka <storchaka(a)gmail.com> | | | | Date: Wed Dec 30 21:41:53 2015 +0200 | | | | | | | | Issue #25961: Disallowed null characters in the type name. | | | | Simplified testing for null characters in __name__ setter. | | | | --- Victor

3 3

Summary of Python tracker Issues
by Python tracker 31 Mar '17

31 Mar '17

ACTIVITY SUMMARY (2017-03-24 - 2017-03-31) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 5855 ( -8) closed 35854 (+65) total 41709 (+57) Open issues with patches: 2419 Issues opened (36) ================== #11913: sdist refuses README.rst http://bugs.python.org/issue11913 reopened by pitrou #29880: python3.6 install readline ,and then cpython exit http://bugs.python.org/issue29880 reopened by pz #29897: itertools.chain behaves strangly when copied with copy.copy http://bugs.python.org/issue29897 opened by MSeifert #29898: PYTHONLEGACYWINDOWSIOENCODING isn't implemented http://bugs.python.org/issue29898 opened by eryksun #29899: zlib missing when --enable--optimizations option appended http://bugs.python.org/issue29899 opened by kyren 原子喵 #29902: copy breaks staticmethod http://bugs.python.org/issue29902 opened by dangyogi #29903: struct.Struct Addition http://bugs.python.org/issue29903 opened by palaviv #29905: TypeErrors not formatting values correctly http://bugs.python.org/issue29905 opened by Jim Fasarakis-Hilliard #29906: Add callback parameter to concurrent.futures.Executor.map http://bugs.python.org/issue29906 opened by aron.bordin #29909: types.coroutine monkey patches original function http://bugs.python.org/issue29909 opened by Omnifarious #29910: Ctrl-D eats a character on IDLE http://bugs.python.org/issue29910 opened by serhiy.storchaka #29911: Uninstall command line in Windows registry does not uninstall http://bugs.python.org/issue29911 opened by Christian.Ullrich #29914: Incorrect signatures of object.__reduce__() and object.__reduc http://bugs.python.org/issue29914 opened by serhiy.storchaka #29915: Drop Mac OS X Tiger support in Python 3.7? http://bugs.python.org/issue29915 opened by haypo #29916: No explicit documentation for PyGetSetDef and getter and sette http://bugs.python.org/issue29916 opened by MSeifert #29920: Document cgitb.text and cgitb.html http://bugs.python.org/issue29920 opened by xmorel #29922: error message when __aexit__ is not async http://bugs.python.org/issue29922 opened by Tadhg McDonald-Jensen #29925: test_uuid fails on OS X Tiger http://bugs.python.org/issue29925 opened by haypo #29926: time.sleep ignores _thread.interrupt_main() http://bugs.python.org/issue29926 opened by Mark #29929: Eliminate implicit __main__ relative imports http://bugs.python.org/issue29929 opened by ncoghlan #29930: Waiting for asyncio.StreamWriter.drain() twice in parallel rai http://bugs.python.org/issue29930 opened by metathink #29931: ipaddress.ip_interface __lt__ check seems to be broken http://bugs.python.org/issue29931 opened by Sanjay #29933: asyncio: set_write_buffer_limits() doc doesn't specify unit of http://bugs.python.org/issue29933 opened by haypo #29937: argparse mutex group should allow mandatory parameters http://bugs.python.org/issue29937 opened by Mark Nolan #29939: Compiler warning in _ctypes_test.c http://bugs.python.org/issue29939 opened by serhiy.storchaka #29940: Add follow_wrapped=True option to help() http://bugs.python.org/issue29940 opened by samwyse #29941: Confusion between asserts and Py_DEBUG http://bugs.python.org/issue29941 opened by Thomas Wouters #29943: PySlice_GetIndicesEx change broke ABI in 3.5 and 3.6 branches http://bugs.python.org/issue29943 opened by njs #29944: Argumentless super() calls do not work in classes constructed http://bugs.python.org/issue29944 opened by assume_away #29947: In SocketServer, why not passing a factory instance for the Re http://bugs.python.org/issue29947 opened by dominic108 #29948: DeprecationWarning when parse ElementTree with a doctype in 2. http://bugs.python.org/issue29948 opened by serhiy.storchaka #29949: sizeof set after set_merge() is doubled from 3.5 http://bugs.python.org/issue29949 opened by inada.naoki #29950: Rename SlotWrapperType to WrapperDescriptorType http://bugs.python.org/issue29950 opened by Jim Fasarakis-Hilliard #29951: PyArg_ParseTupleAndKeywords exception messages containing "fun http://bugs.python.org/issue29951 opened by MSeifert #29952: "keys and values" is preferred to "keys and elements" for name http://bugs.python.org/issue29952 opened by cocoatomo #29953: Memory leak in the replace() method of datetime and time objec http://bugs.python.org/issue29953 opened by serhiy.storchaka Most recent 15 issues with no replies (15) ========================================== #29953: Memory leak in the replace() method of datetime and time objec http://bugs.python.org/issue29953 #29950: Rename SlotWrapperType to WrapperDescriptorType http://bugs.python.org/issue29950 #29948: DeprecationWarning when parse ElementTree with a doctype in 2. http://bugs.python.org/issue29948 #29940: Add follow_wrapped=True option to help() http://bugs.python.org/issue29940 #29937: argparse mutex group should allow mandatory parameters http://bugs.python.org/issue29937 #29925: test_uuid fails on OS X Tiger http://bugs.python.org/issue29925 #29916: No explicit documentation for PyGetSetDef and getter and sette http://bugs.python.org/issue29916 #29914: Incorrect signatures of object.__reduce__() and object.__reduc http://bugs.python.org/issue29914 #29906: Add callback parameter to concurrent.futures.Executor.map http://bugs.python.org/issue29906 #29905: TypeErrors not formatting values correctly http://bugs.python.org/issue29905 #29895: Distutils blows up with an incorrect pypirc, should be caught http://bugs.python.org/issue29895 #29886: links between binascii.{un,}hexlify / bytes.{,to}hex http://bugs.python.org/issue29886 #29883: asyncio: Windows Proactor Event Loop UDP Support http://bugs.python.org/issue29883 #29877: compileall hangs when accessing urandom even if number of work http://bugs.python.org/issue29877 #29868: multiprocessing.dummy missing cpu_count http://bugs.python.org/issue29868 Most recent 15 issues waiting for review (15) ============================================= #29953: Memory leak in the replace() method of datetime and time objec http://bugs.python.org/issue29953 #29951: PyArg_ParseTupleAndKeywords exception messages containing "fun http://bugs.python.org/issue29951 #29930: Waiting for asyncio.StreamWriter.drain() twice in parallel rai http://bugs.python.org/issue29930 #29914: Incorrect signatures of object.__reduce__() and object.__reduc http://bugs.python.org/issue29914 #29897: itertools.chain behaves strangly when copied with copy.copy http://bugs.python.org/issue29897 #29869: Underscores in numeric literals not supported in lib2to3. http://bugs.python.org/issue29869 #29867: Add asserts in PyXXX_GET_SIZE macros http://bugs.python.org/issue29867 #29858: inspect.signature includes bound argument for wrappers around http://bugs.python.org/issue29858 #29854: Segfault when readline history is more then 2 * history size http://bugs.python.org/issue29854 #29843: errors raised by ctypes.Array for invalid _length_ attribute http://bugs.python.org/issue29843 #29840: Avoid raising OverflowError in bool() http://bugs.python.org/issue29840 #29839: Avoid raising OverflowError in len() when __len__() returns ne http://bugs.python.org/issue29839 #29838: Check that sq_length and mq_length return non-negative result http://bugs.python.org/issue29838 #29822: inspect.isabstract does not work on abstract base classes duri http://bugs.python.org/issue29822 #29803: Remove some redandunt ops in unicodeobject.c http://bugs.python.org/issue29803 Top 10 most discussed issues (10) ================================= #27593: Deprecate sys._mercurial and create sys._git http://bugs.python.org/issue27593 14 msgs #29926: time.sleep ignores _thread.interrupt_main() http://bugs.python.org/issue29926 10 msgs #29572: Upgrade installers to OpenSSL 1.0.2k http://bugs.python.org/issue29572 8 msgs #29573: NamedTemporaryFile with delete=True should not fail if file al http://bugs.python.org/issue29573 8 msgs #29887: test_normalization doesn't work http://bugs.python.org/issue29887 7 msgs #29899: zlib missing when --enable--optimizations option appended http://bugs.python.org/issue29899 7 msgs #29930: Waiting for asyncio.StreamWriter.drain() twice in parallel rai http://bugs.python.org/issue29930 7 msgs #29949: sizeof set after set_merge() is doubled from 3.5 http://bugs.python.org/issue29949 7 msgs #29951: PyArg_ParseTupleAndKeywords exception messages containing "fun http://bugs.python.org/issue29951 7 msgs #28556: typing.py upgrades http://bugs.python.org/issue28556 6 msgs Issues closed (67) ================== #6532: thread.get_ident() should return unsigned value http://bugs.python.org/issue6532 closed by serhiy.storchaka #10030: Patch for zip decryption speedup http://bugs.python.org/issue10030 closed by serhiy.storchaka #12518: In string.Template it's impossible to transform delimiter in t http://bugs.python.org/issue12518 closed by barry #16011: "in" should be consistent with return value of __contains__ http://bugs.python.org/issue16011 closed by Mariatta #19791: test_pathlib should use can_symlink or skip_unless_symlink fro http://bugs.python.org/issue19791 closed by brett.cannon #19824: string.Template: Rewrite docs to emphasize i18n use case http://bugs.python.org/issue19824 closed by serhiy.storchaka #20314: Potentially confusing formulation in 6.1.4. Template strings http://bugs.python.org/issue20314 closed by barry #20548: Use specific asserts in warnings and exceptions tests http://bugs.python.org/issue20548 closed by serhiy.storchaka #20552: Use specific asserts in bytes tests http://bugs.python.org/issue20552 closed by terry.reedy #22049: argparse: type=<callable> doesn't honor nargs > 1 http://bugs.python.org/issue22049 closed by paul.j3 #22392: Clarify documentation of __getinitargs__ http://bugs.python.org/issue22392 closed by Mariatta #22744: os.mkdir on Windows silently strips trailing blanks from direc http://bugs.python.org/issue22744 closed by serhiy.storchaka #22962: ipaddress: Add optional prefixlen argument to ip_interface and http://bugs.python.org/issue22962 closed by Gary.van.der.Merwe #23241: shutil should accept pathlib types http://bugs.python.org/issue23241 closed by serhiy.storchaka #23487: argparse: add_subparsers 'action' broken http://bugs.python.org/issue23487 closed by paul.j3 #23901: Force console stdout to use UTF8 on Windows http://bugs.python.org/issue23901 closed by martin.panter #24154: pathlib.Path.rename moves file to Path.cwd() when argument is http://bugs.python.org/issue24154 closed by serhiy.storchaka #24251: Different behavior for argparse between 2.7.8 and 2.7.9 when a http://bugs.python.org/issue24251 closed by paul.j3 #24821: The optimization of string search can cause pessimization http://bugs.python.org/issue24821 closed by serhiy.storchaka #25803: pathlib.Path('/').mkdir() raises wrong error type http://bugs.python.org/issue25803 closed by serhiy.storchaka #25996: Add support of file descriptor in os.scandir() http://bugs.python.org/issue25996 closed by serhiy.storchaka #27446: struct: allow per-item byte order http://bugs.python.org/issue27446 closed by rhettinger #28692: gettext: deprecate selecting plural form by fractional numbers http://bugs.python.org/issue28692 closed by serhiy.storchaka #28699: Imap from ThreadPool behaves unexpectedly http://bugs.python.org/issue28699 closed by xiang.zhang #28810: Document bytecode changes in 3.6 http://bugs.python.org/issue28810 closed by levkivskyi #29176: /tmp does not exist on Android and is used by curses.window.pu http://bugs.python.org/issue29176 closed by haypo #29204: Add code deprecations in ElementTree http://bugs.python.org/issue29204 closed by serhiy.storchaka #29557: binhex documentation claims unknown bug http://bugs.python.org/issue29557 closed by serhiy.storchaka #29619: st_ino (unsigned long long) is casted to long long in posixmod http://bugs.python.org/issue29619 closed by xiang.zhang #29632: argparse values for action in add_argument() should be flags i http://bugs.python.org/issue29632 closed by pgacv2 #29643: --enable-optimizations compiler flag has no effect http://bugs.python.org/issue29643 closed by inada.naoki #29677: clarify docs about 'round()' accepting a negative integer for http://bugs.python.org/issue29677 closed by Mariatta #29720: potential silent truncation in PyLong_AsVoidPtr http://bugs.python.org/issue29720 closed by haypo #29737: Optimize concatenating empty tuples http://bugs.python.org/issue29737 closed by serhiy.storchaka #29816: Get rid of C limitation for shift count in right shift http://bugs.python.org/issue29816 closed by serhiy.storchaka #29852: Argument Clinic: add common converter to Py_ssize_t that accep http://bugs.python.org/issue29852 closed by serhiy.storchaka #29862: Fix grammar typo in importlib.reload() exception http://bugs.python.org/issue29862 closed by Mariatta #29878: Add global instances of int 0 and 1 http://bugs.python.org/issue29878 closed by serhiy.storchaka #29884: faulthandler does not properly restore sigaltstack during tear http://bugs.python.org/issue29884 closed by Mariatta #29888: The link referring to "Python download page" is broken http://bugs.python.org/issue29888 closed by ned.deily #29892: change statement for open() is splited into two part in middle http://bugs.python.org/issue29892 closed by Mariatta #29894: Deprecate returning a subclass of complex from __complex__ http://bugs.python.org/issue29894 closed by serhiy.storchaka #29896: ElementTree.fromstring raises undocumented UnicodeError http://bugs.python.org/issue29896 closed by terry.reedy #29900: Remove unneeded wrappers in pathlib http://bugs.python.org/issue29900 closed by serhiy.storchaka #29901: Support path-like objects in zipapp http://bugs.python.org/issue29901 closed by serhiy.storchaka #29904: Fix a number of error message typos http://bugs.python.org/issue29904 closed by Jim Fasarakis-Hilliard #29907: Unicode encoding failure http://bugs.python.org/issue29907 closed by eryksun #29908: Inconsistent crashing with an access violation http://bugs.python.org/issue29908 closed by Cameron Mckain #29912: Overlapping tests between list_tests and seq_tests http://bugs.python.org/issue29912 closed by brett.cannon #29913: ipadress compare_networks does not work according to documenta http://bugs.python.org/issue29913 closed by xiang.zhang #29917: Wrong link target in PyMethodDef documentation http://bugs.python.org/issue29917 closed by orsenthil #29918: Missed "const" modifiers in C API documentation http://bugs.python.org/issue29918 closed by serhiy.storchaka #29919: Remove unused imports found by pyflakes http://bugs.python.org/issue29919 closed by haypo #29921: datetime validation is stricter in 3.6.1 than previous version http://bugs.python.org/issue29921 closed by haypo #29923: PEP487 __init_subclass__ incompatible with abc.ABCMeta http://bugs.python.org/issue29923 closed by xiang.zhang #29924: Useless argument in call to PyErr_Format http://bugs.python.org/issue29924 closed by haypo #29927: Unnecessary code in the c-api/exceptions.c http://bugs.python.org/issue29927 closed by xiang.zhang #29928: Add f-strings to Glossary http://bugs.python.org/issue29928 closed by Mariatta #29932: Missing word ("be") in error message ("first argument must a t http://bugs.python.org/issue29932 closed by brett.cannon #29934: % formatting fails to find formatting code in bytes type after http://bugs.python.org/issue29934 closed by xiang.zhang #29935: list and tuple index methods should accept None parameters http://bugs.python.org/issue29935 closed by serhiy.storchaka #29936: Typo in __GNU*C*_MINOR__ guard affecting gcc 3.x http://bugs.python.org/issue29936 closed by benjamin.peterson #29938: subprocess.run calling bash on windows10 cause 0x80070057 erro http://bugs.python.org/issue29938 closed by eryksun #29942: Stack overflow in itertools.chain.from_iterable. http://bugs.python.org/issue29942 closed by twouters #29945: decode string:u"\ufffd" UnicodeEncodeError http://bugs.python.org/issue29945 closed by eryksun #29946: compiler warning "sqrtpi defined but not used" http://bugs.python.org/issue29946 closed by xiang.zhang #1117601: os.path.exists returns false negatives in MAC environments. http://bugs.python.org/issue1117601 closed by serhiy.storchaka

1 0

What version is an extension module binary compatible with
by Miro Hrončok 30 Mar '17

30 Mar '17

Hi, as per [0], ABI of the C API is generally not stable and the binary compatibility may break between versions. It is hard from the text to know whether it talks about minor versions (such as 3.6 vs 3.5) or patch versions (such as 3.6.1 vs 3.6.0). In Fedora we currently only keep track about the minor version dependency. I.e. an RPM package with a Python module depends on Python 3.6, not specifically on Python 3.6.1. However, recently we found an issue with this approach [1]: an extension module built against Python 3.6.1 cannot be run on Python 3.6.0, because it uses a macro that, in 3.6.1, uses the new PySlice_AdjustIndices function. I'd like some clarification on what ABI compatibility we can expect. * Should the ABI be stable across patch releases (so calling PySlice_AdjustIndices from an existing macro would be a bug)? * Should the ABI be forward-compatible within a minor release (so modules built for 3.6.0 should be usable with 3.6.1, but not vice versa)? * Or should we expect the ABI to change even across patch releases? It would be nice to say this explicitly in the docs ([0] or another suitable place). [0] https://docs.python.org/3/c-api/stable.html [1] https://bugzilla.redhat.com/show_bug.cgi?id=1435135 Thanks for clarification, On behalf of the Fedora Python SIG, Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

9 12

Issue with _thread.interrupt_main (29926)
by Terry Reedy 29 Mar '17

29 Mar '17

https://bugs.python.org/issue29926 was opened as an IDLE issue, which means that most watching the new issues list would ignore it. But I think it is an issue with _thread.interrupt_main (which IDLE calls in respond to ^C) not interrupting time.sleep(n) in main thread*. I tested on Windows, don't know yet about OP. Since there is no Expert's Index listing for _thread (or threading), I am asking here for someone who knows anything to take a look. * >>> time.sleep(10) <hit ^C immediately> <debug print after interrupt_main() shows immediately> <... remainder of 10 seconds pass> KeyboardInterrupt >>> I don't know if this is a bug or inherent limitation. -- Terry Jan Reedy

3 4

Misc/NEWS entries for Python 3.7a1
by INADA Naoki 29 Mar '17

29 Mar '17

Hi. Currently, changelog of Python 3.7a1 [1] contains changes between 3.6b1 and 3.7a1. So lot's of bugfixes are listed twice or more in changelog. For example, "bpo-28258: Fixed build with Estonian locale..." are listed under 3.5.3rc1, 3.6.0b2 and 3.7.0a1. [1] https://docs.python.org/3.7/whatsnew/changelog.html#changelog This has two problems: * The changelog is longer than necessary. * If bpo-xxxx is fixed in 3.7a1, people may think the bug exists in 3.6.0, even if the bug is fixed in 3.6b2 too. Since we stopped merging 3.6 -> master, I suggest to remove such duplicates. There are two ways: # A: 3.7a1 -> 3.6.0 -> 3.6.0rc2 ... -> 3.6a1 -> 3.5.0 ... This may be what people expect. In this case, we will remove: * 3.6.1(rc*) from changelog * duplicated entries in 3.7.0 (which fixed before 3.6.0) # B: 3.7a1 -> 3.6b1 -> ... 3.6a1 -> 3.5b1 ... This reflects our branch model. In this case, we will remove: * All 3.6 versions after 3.6b1 How do you think? Regards,

4 4

Reminder: buildbots are alive :-)
by Victor Stinner 27 Mar '17

27 Mar '17

Hi, Don't forget our brave buildbots which compile Python to run the full test suite, every day, every night, even if it's raining or worse! Python 3.7: http://buildbot.python.org/all/waterfall?category=3.x.stable&category=3.x.u… Python 3.6: http://buildbot.python.org/all/waterfall?category=3.6.stable&category=3.6.u… Python 3.5: http://buildbot.python.org/all/waterfall?category=3.5.stable&category=3.5.u… Python 2.7: http://buildbot.python.org/all/waterfall?category=2.7.stable&category=2.7.u… It seems like most buildbots are back to normal (green). I backported ".gitattributes" to 3.5 today to fix the last major known buildbot issue on Windows. I proposed to drop OS X Tiger support since the OS is old, tests are failing, and I don't know how to get access to such old OS nowadays: http://bugs.python.org/issue29915 But Ned Deily wrote that right now, it's the last online macOS buildbot! Moreover, only one test fails and it's a minor regression of test_uuid: http://bugs.python.org/issue29925 For OpenIndiana, I just sent a new ping on the "OpenIndiana and Solaris support" thread on this list. I'm still in favor of removing completely the buildbot. Maybe we can add a new Illumos buildbot slave later? That's all Folks! Victor

1 0

OpenIndiana and Solaris support
by Victor Stinner 27 Mar '17

27 Mar '17

Hi, My question is simple: do we officially support Solaris and/or OpenIndiana? Jesus Cea runs an OpenIndiana buildbot slave: http://buildbot.python.org/all/buildslaves/cea-indiana-x86 "Open Indiana 32 bits" The platform module of Python says "Solaris-2.11", I don't know the exact OpenIndiana version. A lot of unit tests fail on this buildbot with MemoryError. I guess that it's related to Solaris which doesn't allow overcommit (allocating more memory than available memory on the system), or more simply because the slave has not enough memory. There is now an issue which seems specific to OpenIndiana: http://bugs.python.org/issue27847 It might impact Solaris as well, but the Solaris buildbot is offline since "684 builds". Five years ago, I reported a bug because the curses module of Python 3 doesn't build on Solaris nor OpenIndiana anymore. It seems like the bug was not fixed, and the issue is still open: http://bugs.python.org/issue13552 So my question is if we officially support Solaris and/or OpenIndiana. If yes, how can we fix issues when we only have buildbot slave which has memory errors, and no SSH access to this server? Solaris doesn't seem to be officially supported in Python, so I suggest to drop the OpenIndiana buildbot (which is failing since at least 2 years) and close all Solaris issues as "WONTFIX". Victor

6 12

Distutils frozen?
by Ryan Gonzalez 27 Mar '17

27 Mar '17

So, I had opened up a PR (#563) to add README.rst to the distutils readme list. Turns out, I didn't read the devguide correctly, and there needed to be an open issue first. Oops. Then I found bpo-11913 (https://bugs.python.org/issue11913), which said: This would be easy to fix, but as it would be considered a new feature, it can’t go into distutils, which is frozen. I interpreted this as being "frozen to new features"...but I can't find any info about that. Anywhere. The devguide doesn't even remotely mention this. A Google search only gives me information on how to freeze modules *using* distutils, which is hardly helpful. FWIW, no one on the PR seemed to mention that, either. If distutils is indeed frozen, shouldn't it be documented somewhere in the devguide? -- Ryan (ライアン) Yoko Shimomura > ryo (supercell/EGOIST) > Hiroyuki Sawano >> everyone else http://refi64.com/

3 2