Mailman 3 April 2016 - Python-checkins

BAD Benchmark Results for Python Default 2016-04-28
by lp_benchmark_robot＠intel.com April 28, 2016

April 28, 2016

Results for project Python default, build date 2016-04-28 02:01:51 +0000 commit: 8ab8f5259f09 previous commit: f4c6dab59cd8 revision date: 2016-04-27 20:13:46 +0000 environment: Haswell-EP cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB mem: 128 GB os: CentOS 7.1 kernel: Linux 3.10.0-229.4.2.el7.x86_64 Baseline results were generated using release v3.4.3, with hash b4cbecbc0781 from 2015-02-25 12:15:33+00:00 ---------------------------------------------… [View More]------------------------------------- benchmark relative change since change since current rev run std_dev* last run baseline with PGO ---------------------------------------------------------------------------------- :-) django_v2 0.24% -0.55% 9.59% 17.09% :-| pybench 0.07% -0.14% 0.72% 6.18% :-( regex_v8 2.66% 0.16% -3.26% 4.71% :-( nbody 0.12% 0.01% -2.05% 6.57% :-| json_dump_v2 0.33% -1.00% -1.38% 14.30% :-| normal_startup 0.80% 0.01% 0.66% 5.42% ---------------------------------------------------------------------------------- * Relative Standard Deviation (Standard Deviation/Average) If this is not displayed properly please visit our results page here: http://languagesperformance.intel.com/bad-benchmark-results-for-python-defa… Note: Benchmark results are measured in seconds. Subject Label Legend: Attributes are determined based on the performance evolution of the workloads compared to the previous measurement iteration. NEUTRAL: performance did not change by more than 1% for any workload GOOD: performance improved by more than 1% for at least one workload and there is no regression greater than 1% BAD: performance dropped by more than 1% for at least one workload and there is no improvement greater than 1% UGLY: performance improved by more than 1% for at least one workload and also dropped by more than 1% for at least one workload Our lab does a nightly source pull and build of the Python project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly. Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. [View Less]

1 0

Daily reference leaks (8ab8f5259f09): sum=0
by solipsis＠pitrou.net April 28, 2016

April 28, 2016

results for 8ab8f5259f09 on branch "default" -------------------------------------------- test_collections leaked [-4, 0, 0] references, sum=-4 test_collections leaked [-6, 1, 4] memory blocks, sum=-1 test_functools leaked [0, 3, 1] memory blocks, sum=4 test_multiprocessing_forkserver leaked [-1, 2, 0] memory blocks, sum=1 Command line was: ['./python', '-m', 'test.regrtest', '-uall', '-R', '3:3:/home/psf-users/antoine/refleaks/reflogWE5R5S', '--timeout', '7200']

1 0

cpython: Issue #25788: fileinput.hook_encoded() now supports an "errors" argument
by serhiy.storchaka April 27, 2016

April 27, 2016

https://hg.python.org/cpython/rev/8ab8f5259f09 changeset: 101167:8ab8f5259f09 parent: 101165:cb5645b36713 user: Serhiy Storchaka <storchaka(a)gmail.com> date: Wed Apr 27 23:13:46 2016 +0300 summary: Issue #25788: fileinput.hook_encoded() now supports an "errors" argument for passing to open. Original patch by Joseph Hackman. files: Doc/library/fileinput.rst | 10 +++++++--- Doc/whatsnew/3.6.rst | 7 +++++++ Lib/fileinput.py | 4 ++-- Lib/… [View More]test/test_fileinput.py | 21 ++++++++++++++++++++- Misc/ACKS | 1 + Misc/NEWS | 3 +++ 6 files changed, 40 insertions(+), 6 deletions(-) diff --git a/Doc/library/fileinput.rst b/Doc/library/fileinput.rst --- a/Doc/library/fileinput.rst +++ b/Doc/library/fileinput.rst @@ -193,10 +193,14 @@ Usage example: ``fi = fileinput.FileInput(openhook=fileinput.hook_compressed)`` -.. function:: hook_encoded(encoding) +.. function:: hook_encoded(encoding, errors=None) Returns a hook which opens each file with :func:`open`, using the given - *encoding* to read the file. + *encoding* and *errors* to read the file. Usage example: ``fi = - fileinput.FileInput(openhook=fileinput.hook_encoded("iso-8859-1"))`` + fileinput.FileInput(openhook=fileinput.hook_encoded("utf-8", + "surrogateescape"))`` + + .. versionchanged:: 3.6 + Added the optional *errors* parameter. diff --git a/Doc/whatsnew/3.6.rst b/Doc/whatsnew/3.6.rst --- a/Doc/whatsnew/3.6.rst +++ b/Doc/whatsnew/3.6.rst @@ -358,6 +358,13 @@ (Contributed by Aviv Palivoda in :issue:`26243`.) +fileinput +--------- + +:func:`~fileinput.hook_encoded` now supports the *errors* argument. +(Contributed by Joseph Hackman in :issue:`25788`.) + + Optimizations ============= diff --git a/Lib/fileinput.py b/Lib/fileinput.py --- a/Lib/fileinput.py +++ b/Lib/fileinput.py @@ -400,9 +400,9 @@ return open(filename, mode) -def hook_encoded(encoding): +def hook_encoded(encoding, errors=None): def openhook(filename, mode): - return open(filename, mode, encoding=encoding) + return open(filename, mode, encoding=encoding, errors=errors) return openhook diff --git a/Lib/test/test_fileinput.py b/Lib/test/test_fileinput.py --- a/Lib/test/test_fileinput.py +++ b/Lib/test/test_fileinput.py @@ -945,7 +945,8 @@ def test(self): encoding = object() - result = fileinput.hook_encoded(encoding) + errors = object() + result = fileinput.hook_encoded(encoding, errors=errors) fake_open = InvocationRecorder() original_open = builtins.open @@ -963,8 +964,26 @@ self.assertIs(args[0], filename) self.assertIs(args[1], mode) self.assertIs(kwargs.pop('encoding'), encoding) + self.assertIs(kwargs.pop('errors'), errors) self.assertFalse(kwargs) + def test_errors(self): + with open(TESTFN, 'wb') as f: + f.write(b'\x80abc') + self.addCleanup(safe_unlink, TESTFN) + + def check(errors, expected_lines): + with FileInput(files=TESTFN, mode='r', + openhook=hook_encoded('utf-8', errors=errors)) as fi: + lines = list(fi) + self.assertEqual(lines, expected_lines) + + check('ignore', ['abc']) + with self.assertRaises(UnicodeDecodeError): + check('strict', ['abc']) + check('replace', ['\ufffdabc']) + check('backslashreplace', ['\\x80abc']) + def test_modes(self): with open(TESTFN, 'wb') as f: # UTF-7 is a convenient, seldom used encoding diff --git a/Misc/ACKS b/Misc/ACKS --- a/Misc/ACKS +++ b/Misc/ACKS @@ -538,6 +538,7 @@ Lars Gustäbel Thomas Güttler Jonas H. +Joseph Hackman Barry Haddow Philipp Hagemeister Paul ten Hagen diff --git a/Misc/NEWS b/Misc/NEWS --- a/Misc/NEWS +++ b/Misc/NEWS @@ -256,6 +256,9 @@ Library ------- +- Issue #25788: fileinput.hook_encoded() now supports an "errors" argument + for passing to open. Original patch by Joseph Hackman. + - Issue #26634: recursive_repr() now sets __qualname__ of wrapper. Patch by Xiang Zhang. -- Repository URL: https://hg.python.org/cpython [View Less]

1 0

cpython (2.7): fileinput.hook_encoded() uses io.open(), not codecs.open().
by serhiy.storchaka April 27, 2016

April 27, 2016

https://hg.python.org/cpython/rev/224d83c81edd changeset: 101166:224d83c81edd branch: 2.7 parent: 101163:2ef61a4747eb user: Serhiy Storchaka <storchaka(a)gmail.com> date: Wed Apr 27 23:07:25 2016 +0300 summary: fileinput.hook_encoded() uses io.open(), not codecs.open(). files: Doc/library/fileinput.rst | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/Doc/library/fileinput.rst b/Doc/library/fileinput.rst --- a/Doc/library/fileinput.… [View More]

1 0

cpython (merge 3.5 -> default): fileinput.hook_encoded() uses builtin open(), not codecs.open().
by serhiy.storchaka April 27, 2016

April 27, 2016

https://hg.python.org/cpython/rev/cb5645b36713 changeset: 101165:cb5645b36713 parent: 101162:f4c6dab59cd8 parent: 101164:f6818806ecc0 user: Serhiy Storchaka <storchaka(a)gmail.com> date: Wed Apr 27 23:06:41 2016 +0300 summary: fileinput.hook_encoded() uses builtin open(), not codecs.open(). files: Doc/library/fileinput.rst | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/Doc/library/fileinput.rst b/Doc/library/fileinput.rst --- a/Doc/… [View More]

1 0

cpython (3.5): fileinput.hook_encoded() uses builtin open(), not codecs.open().
by serhiy.storchaka April 27, 2016

April 27, 2016

https://hg.python.org/cpython/rev/f6818806ecc0 changeset: 101164:f6818806ecc0 branch: 3.5 parent: 101157:49561532504c user: Serhiy Storchaka <storchaka(a)gmail.com> date: Wed Apr 27 23:06:15 2016 +0300 summary: fileinput.hook_encoded() uses builtin open(), not codecs.open(). files: Doc/library/fileinput.rst | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/Doc/library/fileinput.rst b/Doc/library/fileinput.rst --- a/Doc/library/… [View More]

1 0

GOOD Benchmark Results for Python 2.7 2016-04-27
by lp_benchmark_robot＠intel.com April 27, 2016

April 27, 2016

Results for project Python 2.7, build date 2016-04-27 02:46:35 +0000 commit: 44f888e47ab0 previous commit: c502deb19cb0 revision date: 2016-04-26 11:33:46 +0000 environment: Haswell-EP cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB mem: 128 GB os: CentOS 7.1 kernel: Linux 3.10.0-229.4.2.el7.x86_64 Baseline results were generated using release v2.7.10, with hash 15c95b7d81dc from 2015-05-23 16:02:14+00:00 ------------------------------------------------… [View More]---------------------------------- benchmark relative change since change since current rev run std_dev* last run baseline with PGO ---------------------------------------------------------------------------------- :-) django_v2 0.14% 2.15% 6.75% 0.45% :-) pybench 0.10% -0.16% 5.75% 4.43% :-( regex_v8 0.73% 0.16% -2.14% 10.33% :-) nbody 0.15% -0.18% 6.41% 6.55% :-) json_dump_v2 0.56% 0.91% 2.53% 10.86% :-( normal_startup 1.62% 0.60% -4.79% 1.88% :-) ssbench 0.14% 0.28% 2.68% 1.51% ---------------------------------------------------------------------------------- * Relative Standard Deviation (Standard Deviation/Average) If this is not displayed properly please visit our results page here: http://languagesperformance.intel.com/good-benchmark-results-for-python-2-7… Note: Benchmark results for ssbench are measured in requests/second while all other are measured in seconds. Subject Label Legend: Attributes are determined based on the performance evolution of the workloads compared to the previous measurement iteration. NEUTRAL: performance did not change by more than 1% for any workload GOOD: performance improved by more than 1% for at least one workload and there is no regression greater than 1% BAD: performance dropped by more than 1% for at least one workload and there is no improvement greater than 1% UGLY: performance improved by more than 1% for at least one workload and also dropped by more than 1% for at least one workload Our lab does a nightly source pull and build of the Python project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly. Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. [View Less]

1 0

GOOD Benchmark Results for Python Default 2016-04-27
by lp_benchmark_robot＠intel.com April 27, 2016

April 27, 2016

Results for project Python default, build date 2016-04-27 02:02:32 +0000 commit: f4c6dab59cd8 previous commit: ad6be34ce8c9 revision date: 2016-04-26 15:04:18 +0000 environment: Haswell-EP cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB mem: 128 GB os: CentOS 7.1 kernel: Linux 3.10.0-229.4.2.el7.x86_64 Baseline results were generated using release v3.4.3, with hash b4cbecbc0781 from 2015-02-25 12:15:33+00:00 ---------------------------------------------… [View More]------------------------------------- benchmark relative change since change since current rev run std_dev* last run baseline with PGO ---------------------------------------------------------------------------------- :-) django_v2 0.19% -0.55% 10.08% 15.82% :-| pybench 0.07% 0.25% 0.85% 5.40% :-( regex_v8 2.65% 1.64% -3.43% 3.37% :-( nbody 0.11% 0.58% -2.06% 6.72% :-| json_dump_v2 0.33% 0.61% -0.37% 13.40% :-| normal_startup 0.73% 0.10% 0.81% 5.53% ---------------------------------------------------------------------------------- * Relative Standard Deviation (Standard Deviation/Average) If this is not displayed properly please visit our results page here: http://languagesperformance.intel.com/good-benchmark-results-for-python-def… Note: Benchmark results are measured in seconds. Subject Label Legend: Attributes are determined based on the performance evolution of the workloads compared to the previous measurement iteration. NEUTRAL: performance did not change by more than 1% for any workload GOOD: performance improved by more than 1% for at least one workload and there is no regression greater than 1% BAD: performance dropped by more than 1% for at least one workload and there is no improvement greater than 1% UGLY: performance improved by more than 1% for at least one workload and also dropped by more than 1% for at least one workload Our lab does a nightly source pull and build of the Python project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly. Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. [View Less]

1 0

Daily reference leaks (f4c6dab59cd8): sum=-2
by solipsis＠pitrou.net April 27, 2016

April 27, 2016

results for f4c6dab59cd8 on branch "default" -------------------------------------------- test_asyncio leaked [3, 0, 0] memory blocks, sum=3 test_collections leaked [-2, -4, 0] references, sum=-6 test_collections leaked [-1, 2, -4] memory blocks, sum=-3 test_functools leaked [0, 3, 1] memory blocks, sum=4 Command line was: ['./python', '-m', 'test.regrtest', '-uall', '-R', '3:3:/home/psf-users/antoine/refleaks/reflogUYYoyQ', '--timeout', '7200']

1 0

cpython (2.7): Issue #26672: Fix regrtest example in test.rst
by berker.peksag April 27, 2016

April 27, 2016

https://hg.python.org/cpython/rev/2ef61a4747eb changeset: 101163:2ef61a4747eb branch: 2.7 parent: 101156:44f888e47ab0 user: Berker Peksag <berker.peksag(a)gmail.com> date: Wed Apr 27 08:58:32 2016 +0300 summary: Issue #26672: Fix regrtest example in test.rst Reported by Axel Luttgens. files: Doc/library/test.rst | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/Doc/library/test.rst b/Doc/library/test.rst --- a/Doc/library/test.rst +++… [View More]

1 0