Mailman 3 August 2017 - Python-checkins

bpo-30824: Add mimetype for .json (#3048)
by R. David Murray 14 Aug '17

14 Aug '17

https://github.com/python/cpython/commit/8204b903683f9e0f037ccfaa8762271601… commit: 8204b903683f9e0f037ccfaa87622716019914d7 branch: master author: Nate Tangsurat <e4r7hbug(a)gmail.com> committer: R. David Murray <rdmurray(a)bitdance.com> date: 2017-08-14T14:39:45-04:00 summary: bpo-30824: Add mimetype for .json (#3048) files: M Lib/mimetypes.py diff --git a/Lib/mimetypes.py b/Lib/mimetypes.py index 3d686948645..5919b45a9b4 100644 --- a/Lib/mimetypes.py +++ b/Lib/mimetypes.py @@ -439,6 +439,7 @@ def _default_mime_types(): '.jpeg' : 'image/jpeg', '.jpg' : 'image/jpeg', '.js' : 'application/javascript', + '.json' : 'application/json', '.ksh' : 'text/plain', '.latex' : 'application/x-latex', '.m1v' : 'video/mpeg',

1 0

bpo-31106: Fix handling of erros in posix_fallocate() and posix_fadvise() (#3000) (#3000)
by larryhastings 14 Aug '17

14 Aug '17

https://github.com/python/cpython/commit/d4b93e21c2664d6a78e0656e7a7be0807b… commit: d4b93e21c2664d6a78e0656e7a7be0807be1c352 branch: master author: Коренберг Марк <socketpair(a)gmail.com> committer: larryhastings <larry(a)hastings.org> date: 2017-08-14T06:55:16-07:00 summary: bpo-31106: Fix handling of erros in posix_fallocate() and posix_fadvise() (#3000) (#3000) files: M Lib/test/test_posix.py M Modules/posixmodule.c diff --git a/Lib/test/test_posix.py b/Lib/test/test_posix.py index 148c0641a99..dba50e02d94 100644 --- a/Lib/test/test_posix.py +++ b/Lib/test/test_posix.py @@ -298,6 +298,16 @@ def test_posix_fallocate(self): finally: os.close(fd) + # issue31106 - posix_fallocate() does not set error in errno. + @unittest.skipUnless(hasattr(posix, 'posix_fallocate'), + "test needs posix.posix_fallocate()") + def test_posix_fallocate_errno(self): + try: + posix.posix_fallocate(-42, 0, 10) + except OSError as inst: + if inst.errno != errno.EBADF: + raise + @unittest.skipUnless(hasattr(posix, 'posix_fadvise'), "test needs posix.posix_fadvise()") def test_posix_fadvise(self): @@ -307,6 +317,15 @@ def test_posix_fadvise(self): finally: os.close(fd) + @unittest.skipUnless(hasattr(posix, 'posix_fadvise'), + "test needs posix.posix_fadvise()") + def test_posix_fadvise_errno(self): + try: + posix.posix_fadvise(-42, 0, 0, posix.POSIX_FADV_WILLNEED) + except OSError as inst: + if inst.errno != errno.EBADF: + raise + @unittest.skipUnless(os.utime in os.supports_fd, "test needs fd support in os.utime") def test_utime_with_fd(self): now = time.time() diff --git a/Modules/posixmodule.c b/Modules/posixmodule.c index 2e5e79a8d36..f0577874334 100644 --- a/Modules/posixmodule.c +++ b/Modules/posixmodule.c @@ -8917,11 +8917,16 @@ os_posix_fallocate_impl(PyObject *module, int fd, Py_off_t offset, Py_BEGIN_ALLOW_THREADS result = posix_fallocate(fd, offset, length); Py_END_ALLOW_THREADS - } while (result != 0 && errno == EINTR && - !(async_err = PyErr_CheckSignals())); - if (result != 0) - return (!async_err) ? posix_error() : NULL; - Py_RETURN_NONE; + } while (result == EINTR && !(async_err = PyErr_CheckSignals())); + + if (result == 0) + Py_RETURN_NONE; + + if (async_err) + return NULL; + + errno = result; + return posix_error(); } #endif /* HAVE_POSIX_FALLOCATE) && !POSIX_FADVISE_AIX_BUG */ @@ -8959,11 +8964,16 @@ os_posix_fadvise_impl(PyObject *module, int fd, Py_off_t offset, Py_BEGIN_ALLOW_THREADS result = posix_fadvise(fd, offset, length, advice); Py_END_ALLOW_THREADS - } while (result != 0 && errno == EINTR && - !(async_err = PyErr_CheckSignals())); - if (result != 0) - return (!async_err) ? posix_error() : NULL; - Py_RETURN_NONE; + } while (result == EINTR && !(async_err = PyErr_CheckSignals())); + + if (result == 0) + Py_RETURN_NONE; + + if (async_err) + return NULL; + + errno = result; + return posix_error(); } #endif /* HAVE_POSIX_FADVISE && !POSIX_FADVISE_AIX_BUG */

1 0

Daily reference leaks (4243df51fe43): sum=1
by solipsis＠pitrou.net 14 Aug '17

14 Aug '17

results for 4243df51fe43 on branch "default" -------------------------------------------- test_collections leaked [-7, 1, 0] memory blocks, sum=-6 test_functools leaked [0, 3, 1] memory blocks, sum=4 test_multiprocessing_fork leaked [2, 0, 1] memory blocks, sum=3 test_multiprocessing_spawn leaked [-2, 2, 0] memory blocks, sum=0 Command line was: ['./python', '-m', 'test.regrtest', '-uall', '-R', '3:3:/home/psf-users/antoine/refleaks/reflogb7G7bZ', '--timeout', '7200']

1 0

bpo-31159: fix language switch regex on unknown yet built languages. … (#3051) (#3081)
by Victor Stinner 13 Aug '17

13 Aug '17

https://github.com/python/cpython/commit/fe8d9dc479a96ef490034107e7d4a6228b… commit: fe8d9dc479a96ef490034107e7d4a6228b4be140 branch: 2.7 author: Julien Palard <julien(a)palard.fr> committer: Victor Stinner <victor.stinner(a)gmail.com> date: 2017-08-13T23:44:51+02:00 summary: bpo-31159: fix language switch regex on unknown yet built languages. … (#3051) (#3081) * bpo-31159: fix language switch regex on unknown yet built languages. (#3039) This fix a regex issue (a missing non-matching group around an 'or' list) and the specific possible case where a translation is built but not yet in known by the picker, but not explicitly listing possible languages in the regex. (cherry picked from commit 122081deef86174beee965be1207fa46ea23533d) * bpo-31149: Doc: Add Japanese to the language switcher. (#3028) (cherry picked from commit c82b7f332aff606af6c9c163da75f1e86514125e) (cherry picked from commit e8e7fba0b24582959feca9c31f2a72fc0251f83d) files: M Doc/tools/static/switchers.js diff --git a/Doc/tools/static/switchers.js b/Doc/tools/static/switchers.js index 470ff6d33b7..ff23202a5e0 100644 --- a/Doc/tools/static/switchers.js +++ b/Doc/tools/static/switchers.js @@ -21,6 +21,7 @@ var all_languages = { 'en': 'English', 'fr': 'Français', + 'ja': 'Japanese', }; function build_version_select(current_version, current_release) { @@ -109,7 +110,7 @@ // Returns the path segment of the language as a string, like 'fr/' // or '' if not found. function language_segment_from_url(url) { - var language_regexp = '\.org/(' + Object.keys(all_languages).join('|') + '/)'; + var language_regexp = '\.org/([a-z]{2}(?:-[a-z]{2})?/)'; var match = url.match(language_regexp); if (match !== null) return match[1]; @@ -119,7 +120,7 @@ // Returns the path segment of the version as a string, like '3.6/' // or '' if not found. function version_segment_in_url(url) { - var language_segment = '(?:(?:' + Object.keys(all_languages).join('|') + ')/)'; + var language_segment = '(?:[a-z]{2}(?:-[a-z]{2})?/)'; var version_segment = '(?:(?:' + version_regexs.join('|') + ')/)'; var version_regexp = '\\.org/' + language_segment + '?(' + version_segment + ')'; var match = url.match(version_regexp);

1 0

Daily reference leaks (4243df51fe43): sum=4
by solipsis＠pitrou.net 13 Aug '17

13 Aug '17

results for 4243df51fe43 on branch "default" -------------------------------------------- test_collections leaked [-7, 1, 7] memory blocks, sum=1 test_functools leaked [0, 3, 1] memory blocks, sum=4 test_multiprocessing_forkserver leaked [1, 0, -2] memory blocks, sum=-1 Command line was: ['./python', '-m', 'test.regrtest', '-uall', '-R', '3:3:/home/psf-users/antoine/refleaks/reflogvX26G2', '--timeout', '7200']

1 0

bpo-5001, bpo-31169: Fix two uninformative asserts in multiprocessing/managers.py (#3078)
by Antoine Pitrou 12 Aug '17

12 Aug '17

https://github.com/python/cpython/commit/48d9823a0ebde4dfab8bc154bb6df462fb… commit: 48d9823a0ebde4dfab8bc154bb6df462fb2ee403 branch: master author: Allen W. Smith, Ph.D <drallensmith(a)users.noreply.github.com> committer: Antoine Pitrou <pitrou(a)free.fr> date: 2017-08-12T17:37:09+02:00 summary: bpo-5001, bpo-31169: Fix two uninformative asserts in multiprocessing/managers.py (#3078) * Make error message more informative Replace assertions in error-reporting code with more-informative version that doesn't cause confusion over where and what the error is. * Additional clarification + get travis to check * Change from SystemError to TypeError As suggested in PR comment by @pitrou, changing from SystemError; TypeError appears appropriate. * NEWS file installation; ACKS addition (will do my best to justify it by additional work) files: A Misc/NEWS.d/next/Library/2017-08-12-09-25-55.bpo-5001.huQi2Y.rst M Lib/multiprocessing/managers.py M Misc/ACKS diff --git a/Lib/multiprocessing/managers.py b/Lib/multiprocessing/managers.py index cae1c10734b..c6722771b05 100644 --- a/Lib/multiprocessing/managers.py +++ b/Lib/multiprocessing/managers.py @@ -84,14 +84,17 @@ def dispatch(c, id, methodname, args=(), kwds={}): def convert_to_error(kind, result): if kind == '#ERROR': return result - elif kind == '#TRACEBACK': - assert type(result) is str - return RemoteError(result) - elif kind == '#UNSERIALIZABLE': - assert type(result) is str - return RemoteError('Unserializable message: %s\n' % result) + elif kind in ('#TRACEBACK', '#UNSERIALIZABLE'): + if not isinstance(result, str): + raise TypeError( + "Result {0!r} (kind '{1}') type is {2}, not str".format( + result, kind, type(result))) + if kind == '#UNSERIALIZABLE': + return RemoteError('Unserializable message: %s\n' % result) + else: + return RemoteError(result) else: - return ValueError('Unrecognized message type') + return ValueError('Unrecognized message type {!r}'.format(kind)) class RemoteError(Exception): def __str__(self): diff --git a/Misc/ACKS b/Misc/ACKS index d6088b3f5d9..6fc41b36b59 100644 --- a/Misc/ACKS +++ b/Misc/ACKS @@ -1465,6 +1465,7 @@ Ville Skyttä Michael Sloan Nick Sloan Václav Šmilauer +Allen W. Smith Christopher Smith Eric V. Smith Gregory P. Smith diff --git a/Misc/NEWS.d/next/Library/2017-08-12-09-25-55.bpo-5001.huQi2Y.rst b/Misc/NEWS.d/next/Library/2017-08-12-09-25-55.bpo-5001.huQi2Y.rst new file mode 100644 index 00000000000..f157d49a816 --- /dev/null +++ b/Misc/NEWS.d/next/Library/2017-08-12-09-25-55.bpo-5001.huQi2Y.rst @@ -0,0 +1,9 @@ +There are a number of uninformative asserts in the `multiprocessing` module, +as noted in issue 5001. This change fixes two of the most potentially +problematic ones, since they are in error-reporting code, in the +`multiprocessing.managers.convert_to_error` function. (It also makes more +informative a ValueError message.) The only potentially problematic change +is that the AssertionError is now a TypeError; however, this should also +help distinguish it from an AssertionError being *reported* by the +function/its caller (such as in issue 31169). - Patch by Allen W. Smith +(drallensmith on github).

1 0

bpo-30747: Attempt to fix atomic load/store (#2383)
by Antoine Pitrou 12 Aug '17

12 Aug '17

https://github.com/python/cpython/commit/e664d7f89d2b9960d9049237136396e824… commit: e664d7f89d2b9960d9049237136396e824795cac branch: master author: Pär Björklund <per.bjorklund(a)gmail.com> committer: Antoine Pitrou <pitrou(a)free.fr> date: 2017-08-12T11:19:30+02:00 summary: bpo-30747: Attempt to fix atomic load/store (#2383) _Py_atomic_* are currently not implemented as atomic operations when building with MSVC. This patch attempts to implement parts of the functionality required. files: A Misc/NEWS.d/next/Core and Builtins/2017-08-08-12-00-29.bpo-30747.g2kZRT.rst M Include/pyatomic.h diff --git a/Include/pyatomic.h b/Include/pyatomic.h index 893d30d2eb0..832d951f843 100644 --- a/Include/pyatomic.h +++ b/Include/pyatomic.h @@ -10,6 +10,12 @@ #include <stdatomic.h> #endif + +#if defined(_MSC_VER) +#include <intrin.h> +#include <immintrin.h> +#endif + /* This is modeled after the atomics interface from C1x, according to * the draft at * http://www.open-std.org/JTC1/SC22/wg14/www/docs/n1425.pdf. @@ -87,8 +93,9 @@ typedef struct _Py_atomic_int { || (ORDER) == __ATOMIC_CONSUME), \ __atomic_load_n(&(ATOMIC_VAL)->_value, ORDER)) -#else - +/* Only support GCC (for expression statements) and x86 (for simple + * atomic semantics) and MSVC x86/x64/ARM */ +#elif defined(__GNUC__) && (defined(__i386__) || defined(__amd64)) typedef enum _Py_memory_order { _Py_memory_order_relaxed, _Py_memory_order_acquire, @@ -105,9 +112,6 @@ typedef struct _Py_atomic_int { int _value; } _Py_atomic_int; -/* Only support GCC (for expression statements) and x86 (for simple - * atomic semantics) for now */ -#if defined(__GNUC__) && (defined(__i386__) || defined(__amd64)) static __inline__ void _Py_atomic_signal_fence(_Py_memory_order order) @@ -127,7 +131,7 @@ _Py_atomic_thread_fence(_Py_memory_order order) static __inline__ void _Py_ANNOTATE_MEMORY_ORDER(const volatile void *address, _Py_memory_order order) { - (void)address; /* shut up -Wunused-parameter */ + (void)address; /* shut up -Wunused-parameter */ switch(order) { case _Py_memory_order_release: case _Py_memory_order_acq_rel: @@ -219,7 +223,291 @@ _Py_ANNOTATE_MEMORY_ORDER(const volatile void *address, _Py_memory_order order) result; \ }) -#else /* !gcc x86 */ +#elif defined(_MSC_VER) +/* _Interlocked* functions provide a full memory barrier and are therefore + enough for acq_rel and seq_cst. If the HLE variants aren't available + in hardware they will fall back to a full memory barrier as well. + + This might affect performance but likely only in some very specific and + hard to meassure scenario. +*/ +#if defined(_M_IX86) || defined(_M_X64) +typedef enum _Py_memory_order { + _Py_memory_order_relaxed, + _Py_memory_order_acquire, + _Py_memory_order_release, + _Py_memory_order_acq_rel, + _Py_memory_order_seq_cst +} _Py_memory_order; + +typedef struct _Py_atomic_address { + volatile uintptr_t _value; +} _Py_atomic_address; + +typedef struct _Py_atomic_int { + volatile int _value; +} _Py_atomic_int; + + +#if defined(_M_X64) +#define _Py_atomic_store_64bit(ATOMIC_VAL, NEW_VAL, ORDER) \ + switch (ORDER) { \ + case _Py_memory_order_acquire: \ + _InterlockedExchange64_HLEAcquire((__int64 volatile*)ATOMIC_VAL, (__int64)NEW_VAL); \ + break; \ + case _Py_memory_order_release: \ + _InterlockedExchange64_HLERelease((__int64 volatile*)ATOMIC_VAL, (__int64)NEW_VAL); \ + break; \ + default: \ + _InterlockedExchange64((__int64 volatile*)ATOMIC_VAL, (__int64)NEW_VAL); \ + break; \ + } +#else +#define _Py_atomic_store_64bit(ATOMIC_VAL, NEW_VAL, ORDER) ((void)0); +#endif + +#define _Py_atomic_store_32bit(ATOMIC_VAL, NEW_VAL, ORDER) \ + switch (ORDER) { \ + case _Py_memory_order_acquire: \ + _InterlockedExchange_HLEAcquire((volatile long*)ATOMIC_VAL, (int)NEW_VAL); \ + break; \ + case _Py_memory_order_release: \ + _InterlockedExchange_HLERelease((volatile long*)ATOMIC_VAL, (int)NEW_VAL); \ + break; \ + default: \ + _InterlockedExchange((volatile long*)ATOMIC_VAL, (int)NEW_VAL); \ + break; \ + } + +#if defined(_M_X64) +/* This has to be an intptr_t for now. + gil_created() uses -1 as a sentinel value, if this returns + a uintptr_t it will do an unsigned compare and crash +*/ +inline intptr_t _Py_atomic_load_64bit(volatile uintptr_t* value, int order) { + uintptr_t old; + switch (order) { + case _Py_memory_order_acquire: + { + do { + old = *value; + } while(_InterlockedCompareExchange64_HLEAcquire(value, old, old) != old); + break; + } + case _Py_memory_order_release: + { + do { + old = *value; + } while(_InterlockedCompareExchange64_HLERelease(value, old, old) != old); + break; + } + case _Py_memory_order_relaxed: + old = *value; + break; + default: + { + do { + old = *value; + } while(_InterlockedCompareExchange64(value, old, old) != old); + break; + } + } + return old; +} + +#else +#define _Py_atomic_load_64bit(ATOMIC_VAL, ORDER) *ATOMIC_VAL +#endif + +inline int _Py_atomic_load_32bit(volatile int* value, int order) { + int old; + switch (order) { + case _Py_memory_order_acquire: + { + do { + old = *value; + } while(_InterlockedCompareExchange_HLEAcquire(value, old, old) != old); + break; + } + case _Py_memory_order_release: + { + do { + old = *value; + } while(_InterlockedCompareExchange_HLERelease(value, old, old) != old); + break; + } + case _Py_memory_order_relaxed: + old = *value; + break; + default: + { + do { + old = *value; + } while(_InterlockedCompareExchange(value, old, old) != old); + break; + } + } + return old; +} + +#define _Py_atomic_store_explicit(ATOMIC_VAL, NEW_VAL, ORDER) \ + if (sizeof(*ATOMIC_VAL._value) == 8) { \ + _Py_atomic_store_64bit(ATOMIC_VAL._value, NEW_VAL, ORDER) } else { \ + _Py_atomic_store_32bit(ATOMIC_VAL._value, NEW_VAL, ORDER) } + +#define _Py_atomic_load_explicit(ATOMIC_VAL, ORDER) \ + ( \ + sizeof(*(ATOMIC_VAL._value)) == 8 ? \ + _Py_atomic_load_64bit(ATOMIC_VAL._value, ORDER) : \ + _Py_atomic_load_32bit(ATOMIC_VAL._value, ORDER) \ + ) +#elif defined(_M_ARM) || defined(_M_ARM64) +typedef enum _Py_memory_order { + _Py_memory_order_relaxed, + _Py_memory_order_acquire, + _Py_memory_order_release, + _Py_memory_order_acq_rel, + _Py_memory_order_seq_cst +} _Py_memory_order; + +typedef struct _Py_atomic_address { + volatile uintptr_t _value; +} _Py_atomic_address; + +typedef struct _Py_atomic_int { + volatile int _value; +} _Py_atomic_int; + + +#if defined(_M_ARM64) +#define _Py_atomic_store_64bit(ATOMIC_VAL, NEW_VAL, ORDER) \ + switch (ORDER) { \ + case _Py_memory_order_acquire: \ + _InterlockedExchange64_acq((__int64 volatile*)ATOMIC_VAL, (__int64)NEW_VAL); \ + break; \ + case _Py_memory_order_release: \ + _InterlockedExchange64_rel((__int64 volatile*)ATOMIC_VAL, (__int64)NEW_VAL); \ + break; \ + default: \ + _InterlockedExchange64((__int64 volatile*)ATOMIC_VAL, (__int64)NEW_VAL); \ + break; \ + } +#else +#define _Py_atomic_store_64bit(ATOMIC_VAL, NEW_VAL, ORDER) ((void)0); +#endif + +#define _Py_atomic_store_32bit(ATOMIC_VAL, NEW_VAL, ORDER) \ + switch (ORDER) { \ + case _Py_memory_order_acquire: \ + _InterlockedExchange_acq((volatile long*)ATOMIC_VAL, (int)NEW_VAL); \ + break; \ + case _Py_memory_order_release: \ + _InterlockedExchange_rel((volatile long*)ATOMIC_VAL, (int)NEW_VAL); \ + break; \ + default: \ + _InterlockedExchange((volatile long*)ATOMIC_VAL, (int)NEW_VAL); \ + break; \ + } + +#if defined(_M_ARM64) +/* This has to be an intptr_t for now. + gil_created() uses -1 as a sentinel value, if this returns + a uintptr_t it will do an unsigned compare and crash +*/ +inline intptr_t _Py_atomic_load_64bit(volatile uintptr_t* value, int order) { + uintptr_t old; + switch (order) { + case _Py_memory_order_acquire: + { + do { + old = *value; + } while(_InterlockedCompareExchange64_acq(value, old, old) != old); + break; + } + case _Py_memory_order_release: + { + do { + old = *value; + } while(_InterlockedCompareExchange64_rel(value, old, old) != old); + break; + } + case _Py_memory_order_relaxed: + old = *value; + break; + default: + { + do { + old = *value; + } while(_InterlockedCompareExchange64(value, old, old) != old); + break; + } + } + return old; +} + +#else +#define _Py_atomic_load_64bit(ATOMIC_VAL, ORDER) *ATOMIC_VAL +#endif + +inline int _Py_atomic_load_32bit(volatile int* value, int order) { + int old; + switch (order) { + case _Py_memory_order_acquire: + { + do { + old = *value; + } while(_InterlockedCompareExchange_acq(value, old, old) != old); + break; + } + case _Py_memory_order_release: + { + do { + old = *value; + } while(_InterlockedCompareExchange_rel(value, old, old) != old); + break; + } + case _Py_memory_order_relaxed: + old = *value; + break; + default: + { + do { + old = *value; + } while(_InterlockedCompareExchange(value, old, old) != old); + break; + } + } + return old; +} + +#define _Py_atomic_store_explicit(ATOMIC_VAL, NEW_VAL, ORDER) \ + if (sizeof(*ATOMIC_VAL._value) == 8) { \ + _Py_atomic_store_64bit(ATOMIC_VAL._value, NEW_VAL, ORDER) } else { \ + _Py_atomic_store_32bit(ATOMIC_VAL._value, NEW_VAL, ORDER) } + +#define _Py_atomic_load_explicit(ATOMIC_VAL, ORDER) \ + ( \ + sizeof(*(ATOMIC_VAL._value)) == 8 ? \ + _Py_atomic_load_64bit(ATOMIC_VAL._value, ORDER) : \ + _Py_atomic_load_32bit(ATOMIC_VAL._value, ORDER) \ + ) +#endif +#else /* !gcc x86 !_msc_ver */ +typedef enum _Py_memory_order { + _Py_memory_order_relaxed, + _Py_memory_order_acquire, + _Py_memory_order_release, + _Py_memory_order_acq_rel, + _Py_memory_order_seq_cst +} _Py_memory_order; + +typedef struct _Py_atomic_address { + uintptr_t _value; +} _Py_atomic_address; + +typedef struct _Py_atomic_int { + int _value; +} _Py_atomic_int; /* Fall back to other compilers and processors by assuming that simple volatile accesses are atomic. This is false, so people should port this. */ @@ -229,8 +517,6 @@ _Py_ANNOTATE_MEMORY_ORDER(const volatile void *address, _Py_memory_order order) ((ATOMIC_VAL)->_value = NEW_VAL) #define _Py_atomic_load_explicit(ATOMIC_VAL, ORDER) \ ((ATOMIC_VAL)->_value) - -#endif /* !gcc x86 */ #endif /* Standardized shortcuts. */ @@ -245,6 +531,5 @@ _Py_ANNOTATE_MEMORY_ORDER(const volatile void *address, _Py_memory_order order) _Py_atomic_store_explicit(ATOMIC_VAL, NEW_VAL, _Py_memory_order_relaxed) #define _Py_atomic_load_relaxed(ATOMIC_VAL) \ _Py_atomic_load_explicit(ATOMIC_VAL, _Py_memory_order_relaxed) - #endif /* Py_BUILD_CORE */ #endif /* Py_ATOMIC_H */ diff --git a/Misc/NEWS.d/next/Core and Builtins/2017-08-08-12-00-29.bpo-30747.g2kZRT.rst b/Misc/NEWS.d/next/Core and Builtins/2017-08-08-12-00-29.bpo-30747.g2kZRT.rst new file mode 100644 index 00000000000..04a726a7e69 --- /dev/null +++ b/Misc/NEWS.d/next/Core and Builtins/2017-08-08-12-00-29.bpo-30747.g2kZRT.rst @@ -0,0 +1,2 @@ +Add a non-dummy implementation of _Py_atomic_store and _Py_atomic_load on +MSVC.

1 0

Daily reference leaks (4243df51fe43): sum=13
by solipsis＠pitrou.net 12 Aug '17

12 Aug '17

results for 4243df51fe43 on branch "default" -------------------------------------------- test_collections leaked [7, -7, 8] memory blocks, sum=8 test_functools leaked [0, 3, 1] memory blocks, sum=4 test_multiprocessing_spawn leaked [-1, 0, 2] memory blocks, sum=1 Command line was: ['./python', '-m', 'test.regrtest', '-uall', '-R', '3:3:/home/psf-users/antoine/refleaks/reflogtF1GoI', '--timeout', '7200']

1 0

[65 flat] Results for Python (master branch) 2017-08-11
by lp_benchmark_robot＠intel.com 12 Aug '17

12 Aug '17

Results for project python/master, build date: 2017-08-11 03:03:46-07:00. - commit: dadca48 - previous commit: 3b0f620 - revision date: 2017-08-10 18:45:12-07:00 - environment: Broadwell-EP - cpu: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz 2x22 cores, stepping 1, LLC 55 MB - mem: 128 GB - os: Ubuntu 16.04.2 LTS - kernel: 4.4.0-62-generic x86_64 GNU/Linux Baseline results were generated using release v3.6.0, with hash 5c4568a from 2016-12-22 23:38:47+00:00. +-----+------------------------+--------+------------+------------+------------+ | | |relative|change since|change since|current rev | | | benchmark|std_dev*| last run | baseline |run with PGO| +-----+------------------------+--------+------------+------------+------------+ | :-| | 2to3| 1.138% | +0.143% | +4.358% | +7.602% | +-----+------------------------+--------+------------+------------+------------+ | :-| | call_method| 1.610% | -0.135% | +21.704% | +13.663% | +-----+------------------------+--------+------------+------------+------------+ | :-| | call_method_slots| 1.832% | +0.405% | +24.163% | +12.085% | +-----+------------------------+--------+------------+------------+------------+ | :-| | call_method_unknown| 0.689% | -0.102% | +21.045% | +12.410% | +-----+------------------------+--------+------------+------------+------------+ | :-| | call_simple| 2.423% | -0.315% | +2.101% | +15.818% | +-----+------------------------+--------+------------+------------+------------+ | :-| | chameleon| 2.159% | -0.019% | +11.222% | +11.089% | +-----+------------------------+--------+------------+------------+------------+ | :-| | chaos| 2.619% | -0.427% | +5.930% | +10.716% | +-----+------------------------+--------+------------+------------+------------+ | :-| | crypto_pyaes| 0.395% | +0.149% | +4.507% | +4.446% | +-----+------------------------+--------+------------+------------+------------+ | :-| | deltablue| 4.405% | +0.837% | +6.706% | +19.499% | +-----+------------------------+--------+------------+------------+------------+ | :-| | django_template| 3.815% | +0.352% | +9.917% | +13.139% | +-----+------------------------+--------+------------+------------+------------+ | :-| | dulwich_log| 1.159% | -0.041% | +4.574% | +6.896% | +-----+------------------------+--------+------------+------------+------------+ | :-| | fannkuch| 0.336% | +0.719% | +5.074% | +5.043% | +-----+------------------------+--------+------------+------------+------------+ | :-| | float| 0.774% | -0.139% | +3.029% | +7.158% | +-----+------------------------+--------+------------+------------+------------+ | :-| | genshi_text| 1.458% | +0.491% | +8.889% | +11.578% | +-----+------------------------+--------+------------+------------+------------+ | :-| | genshi_xml| 2.798% | +0.116% | +7.488% | +7.685% | +-----+------------------------+--------+------------+------------+------------+ | :-| | go| 0.761% | -0.207% | +5.949% | +11.932% | +-----+------------------------+--------+------------+------------+------------+ | :-| | hexiom| 0.380% | +0.201% | +9.195% | +10.953% | +-----+------------------------+--------+------------+------------+------------+ | :-| | html5lib| 3.656% | -0.287% | +7.996% | +10.424% | +-----+------------------------+--------+------------+------------+------------+ | :-| | json_dumps| 1.177% | +0.330% | +4.589% | +9.417% | +-----+------------------------+--------+------------+------------+------------+ | :-| | json_loads| 1.044% | +0.351% | +3.076% | +10.810% | +-----+------------------------+--------+------------+------------+------------+ | :-| | logging_format| 1.296% | +0.522% | +8.683% | +13.489% | +-----+------------------------+--------+------------+------------+------------+ | :-| | logging_silent| 2.927% | +0.097% | +47.096% | +12.835% | +-----+------------------------+--------+------------+------------+------------+ | :-| | logging_simple| 1.466% | +0.483% | +10.091% | +11.560% | +-----+------------------------+--------+------------+------------+------------+ | :-| | mako| 0.395% | +0.115% | +18.827% | +12.199% | +-----+------------------------+--------+------------+------------+------------+ | :-| | mdp| 5.940% | +1.914% | +6.458% | +13.070% | +-----+------------------------+--------+------------+------------+------------+ | :-| | meteor_contest| 2.267% | +0.128% | +3.724% | +5.783% | +-----+------------------------+--------+------------+------------+------------+ | :-| | nbody| 0.590% | +0.003% | -1.919% | +2.653% | +-----+------------------------+--------+------------+------------+------------+ | :-| | nqueens| 1.841% | +0.050% | +2.553% | +6.261% | +-----+------------------------+--------+------------+------------+------------+ | :-| | pathlib| 1.003% | -0.339% | +5.001% | +9.721% | +-----+------------------------+--------+------------+------------+------------+ | :-| | pickle| 1.322% | -0.586% | +0.816% | +22.430% | +-----+------------------------+--------+------------+------------+------------+ | :-| | pickle_dict| 0.189% | -0.028% | +2.461% | +19.004% | +-----+------------------------+--------+------------+------------+------------+ | :-| | pickle_list| 1.119% | +0.379% | +5.245% | +19.541% | +-----+------------------------+--------+------------+------------+------------+ | :-| | pickle_pure_python| 5.407% | -1.265% | +11.237% | +10.993% | +-----+------------------------+--------+------------+------------+------------+ | :-| | pidigits| 0.203% | -0.008% | +0.291% | +10.253% | +-----+------------------------+--------+------------+------------+------------+ | :-| | python_startup| 0.130% | +0.016% | +9.076% | +5.129% | +-----+------------------------+--------+------------+------------+------------+ | :-| | python_startup_no_site| 0.096% | +0.022% | +1.134% | +4.832% | +-----+------------------------+--------+------------+------------+------------+ | :-| | raytrace| 0.931% | -0.095% | +9.502% | +13.821% | +-----+------------------------+--------+------------+------------+------------+ | :-| | regex_compile| 4.873% | -0.252% | -10.349% | +9.820% | +-----+------------------------+--------+------------+------------+------------+ | :-| | regex_dna| 1.411% | -0.096% | +1.357% | +8.336% | +-----+------------------------+--------+------------+------------+------------+ | :-| | regex_effbot| 2.064% | -0.419% | +0.495% | +3.255% | +-----+------------------------+--------+------------+------------+------------+ | :-| | regex_v8| 0.703% | +0.156% | +11.438% | +3.316% | +-----+------------------------+--------+------------+------------+------------+ | :-| | richards| 1.593% | -0.007% | +7.526% | +15.049% | +-----+------------------------+--------+------------+------------+------------+ | :-| | scimark_fft| 2.631% | -0.590% | +0.282% | +2.911% | +-----+------------------------+--------+------------+------------+------------+ | :-| | scimark_lu| 1.647% | +0.249% | +26.874% | +8.910% | +-----+------------------------+--------+------------+------------+------------+ | :-| | scimark_monte_carlo| 3.034% | -0.470% | +2.897% | +7.970% | +-----+------------------------+--------+------------+------------+------------+ | :-| | scimark_sor| 1.206% | -0.120% | +13.158% | +9.655% | +-----+------------------------+--------+------------+------------+------------+ | :-| | scimark_sparse_mat_mult| 2.033% | -0.373% | -0.742% | +2.548% | +-----+------------------------+--------+------------+------------+------------+ | :-| | spectral_norm| 0.527% | -0.216% | +5.594% | +3.112% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sqlalchemy_declarative| 1.212% | +0.225% | +5.404% | +6.807% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sqlalchemy_imperative| 3.098% | -0.552% | +5.602% | +5.506% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sqlite_synth| 3.575% | +1.394% | +3.913% | +8.388% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sympy_expand| 2.126% | +0.175% | +12.849% | +7.623% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sympy_integrate| 1.514% | -0.331% | +10.492% | +6.657% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sympy_str| 3.722% | -0.045% | +12.627% | +8.473% | +-----+------------------------+--------+------------+------------+------------+ | :-| | sympy_sum| 4.615% | -0.223% | +13.876% | +8.825% | +-----+------------------------+--------+------------+------------+------------+ | :-| | telco| 3.705% | +1.170% | +23.558% | +7.781% | +-----+------------------------+--------+------------+------------+------------+ | :-| | tornado_http| 1.215% | -0.275% | +5.909% | +4.608% | +-----+------------------------+--------+------------+------------+------------+ | :-| | unpack_sequence| 1.604% | +0.038% | +0.635% | +0.922% | +-----+------------------------+--------+------------+------------+------------+ | :-| | unpickle|10.242% | -0.013% | +5.989% | +23.183% | +-----+------------------------+--------+------------+------------+------------+ | :-| | unpickle_list| 1.173% | -0.788% | -3.634% | +19.273% | +-----+------------------------+--------+------------+------------+------------+ | :-| | unpickle_pure_python| 0.840% | +1.032% | +7.325% | +7.214% | +-----+------------------------+--------+------------+------------+------------+ | :-| | xml_etree_generate| 1.578% | -0.178% | +5.658% | +8.459% | +-----+------------------------+--------+------------+------------+------------+ | :-| | xml_etree_iterparse| 2.208% | -0.110% | +1.800% | +6.270% | +-----+------------------------+--------+------------+------------+------------+ | :-| | xml_etree_parse| 3.400% | -1.360% | -6.336% | +10.024% | +-----+------------------------+--------+------------+------------+------------+ | :-| | xml_etree_process| 1.246% | +0.419% | +6.541% | +8.110% | +-----+------------------------+--------+------------+------------+------------+ * Relative Standard Deviation (Standard Deviation/Average) If this is not displayed properly please visit our results page here: http://languagesperformance.intel.com/65-flat-results-for-python-master-bra… Our lab does a nightly source pull and build of the Python project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly. Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration.

1 0

bpo-31067: test_subprocess calls reap_children() (#2931) (#3074)
by Victor Stinner 11 Aug '17

11 Aug '17

https://github.com/python/cpython/commit/f2d769d539279f01a6589dd3a0d5865dd0… commit: f2d769d539279f01a6589dd3a0d5865dd00e13b0 branch: 3.6 author: Victor Stinner <victor.stinner(a)gmail.com> committer: GitHub <noreply(a)github.com> date: 2017-08-11T17:14:37+02:00 summary: bpo-31067: test_subprocess calls reap_children() (#2931) (#3074) test_subprocess now also calls reap_children() in tearDown(), not only on setUp(). (cherry picked from commit cc42c121eb5346f673247f95dac575aadb77d66c) files: M Lib/test/test_subprocess.py diff --git a/Lib/test/test_subprocess.py b/Lib/test/test_subprocess.py index 4faf32e6361..004f1f01ab5 100644 --- a/Lib/test/test_subprocess.py +++ b/Lib/test/test_subprocess.py @@ -61,6 +61,8 @@ def tearDown(self): inst.wait() subprocess._cleanup() self.assertFalse(subprocess._active, "subprocess._active not empty") + self.doCleanups() + support.reap_children() def assertStderrEqual(self, stderr, expected, msg=None): # In a debug build, stuff like "[6580 refs]" is printed to stderr at

1 0