Mailman 3 March 2012 - Python-Dev

PEP 393 decode() oddity
by Serhiy Storchaka March 26, 2012

March 26, 2012

PEP 393 (Flexible String Representation) is, without doubt, one of the pearls of the Python 3.3. In addition to reducing memory consumption, it also often leads to a corresponding increase in speed. In particular, the string encoding now in 1.5-3 times faster. But decoding is not so good. Here are the results of measuring the performance of the decoding of the 1000-character string consisting of characters from different ranges of the Unicode, for three versions of Python -- 2.7.3rc2, 3.… [View More]2.3rc2+ and 3.3.0a1+. Little-endian 32-bit i686 builds, gcc 4.4. encoding string 2.7 3.2 3.3 ascii " " * 1000 5.4 5.3 1.2 latin1 " " * 1000 1.8 1.7 1.3 latin1 "\u0080" * 1000 1.7 1.6 1.0 utf-8 " " * 1000 6.7 2.4 2.1 utf-8 "\u0080" * 1000 12.2 11.0 13.0 utf-8 "\u0100" * 1000 12.2 11.1 13.6 utf-8 "\u0800" * 1000 14.7 14.4 17.2 utf-8 "\u8000" * 1000 13.9 13.3 17.1 utf-8 "\U00010000" * 1000 17.3 17.5 21.5 utf-16le " " * 1000 5.5 2.9 6.5 utf-16le "\u0080" * 1000 5.5 2.9 7.4 utf-16le "\u0100" * 1000 5.5 2.9 8.9 utf-16le "\u0800" * 1000 5.5 2.9 8.9 utf-16le "\u8000" * 1000 5.5 7.5 21.3 utf-16le "\U00010000" * 1000 9.6 12.9 30.1 utf-16be " " * 1000 5.5 3.0 9.0 utf-16be "\u0080" * 1000 5.5 3.1 9.8 utf-16be "\u0100" * 1000 5.5 3.1 10.4 utf-16be "\u0800" * 1000 5.5 3.1 10.4 utf-16be "\u8000" * 1000 5.5 6.6 21.2 utf-16be "\U00010000" * 1000 9.6 11.2 28.9 utf-32le " " * 1000 10.2 10.4 15.1 utf-32le "\u0080" * 1000 10.0 10.4 16.5 utf-32le "\u0100" * 1000 10.0 10.4 19.8 utf-32le "\u0800" * 1000 10.0 10.4 19.8 utf-32le "\u8000" * 1000 10.1 10.4 19.8 utf-32le "\U00010000" * 1000 11.7 11.3 20.2 utf-32be " " * 1000 10.0 11.2 15.0 utf-32be "\u0080" * 1000 10.1 11.2 16.4 utf-32be "\u0100" * 1000 10.0 11.2 19.7 utf-32be "\u0800" * 1000 10.1 11.2 19.7 utf-32be "\u8000" * 1000 10.1 11.2 19.7 utf-32be "\U00010000" * 1000 11.7 11.2 20.2 The first oddity in that the characters from the second half of the Latin1 table decoded faster than the characters from the first half. I think that the characters from the first half of the table must be decoded as quickly. The second sad oddity in that UTF-16 decoding in 3.3 is much slower than even in 2.7. Compared with 3.2 decoding is slower in 2-3 times. This is a considerable regress. UTF-32 decoding is also slowed down by 1.5-2 times. The fact that in some cases UTF-8 decoding also slowed, is not surprising. I believe, that on a platform with a 64-bit long, there may be other oddities. How serious a problem this is for the Python 3.3 release? I could do the optimization, if someone is not working on this already. [View Less]

6 9

Re: [Python-Dev] cpython: Adding unittest.mock documentation
by Georg Brandl March 26, 2012

March 26, 2012

On 26.03.2012 00:13, michael.foord wrote: > http://hg.python.org/cpython/rev/adc1fc2dc872 > changeset: 75938:adc1fc2dc872 > user: Michael Foord <michael(a)voidspace.org.uk> > date: Sun Mar 25 23:12:55 2012 +0100 > summary: > Adding unittest.mock documentation > > files: > Doc/library/development.rst | 6 + > Doc/library/unittest.mock-examples.rst | 887 +++++++++ > Doc/library/unittest.mock-getting-… [View More]

2 1

Python install layout and the PATH on win32
by VanL March 26, 2012

March 26, 2012

Following up on conversations at PyCon, I want to bring up one of my personal hobby horses for change in 3.3: Fix install layout on Windows, with a side order of making the PATH work better. Short version: 1) The layout for the python root directory for all platforms should be as follows: stdlib = {base/userbase}/lib/python{py_version_short} platstdlib = {base/userbase}/lib/python{py_version_short} purelib = {base/userbase}/lib/python{py_version_short}/site-packages platlib = {base/… [View More]userbase}/lib/python{py_version_short}/site-packages include = {base/userbase}/include/python{py_version_short} scripts = {base/userbase}/bin data = {base/userbase} 2) On Windows, the python executable (python.exe) will be in the "bin" directory. That way the installer can optionally add just that directory to the PATH to pick up all python-related executables (like pip, easy_install, etc). I have talked with a number of people at PyCon, including Tarek and MvL. Nobody objected, and several thought it was a good idea. Long version: As a bit of background,the layout for the Python root directory is different between platforms, varying in capitalization ("Include" vs. "include") and sometimes in the names of directories used ("Scripts" on Windows vs. "bin" most everywhere else). Further, the python version may or may not be included in the path to the standard library or not. In times past, this layout was driven by an INSTALL_SCHEMES dict deep in the guts of distutils, but with distutils2 it has been lifted out and placed within a config file (sysconfig.cfg). [1] Proposal #1 above deals with this inconsistency [1]. More concretely, it also makes it so that I can check in an entire environment into source control and work on it cross platform. As an additional wrinkle on Windows, the main python binary (python.exe) is placed in the python root directory, but all associated runnable files are placed in the "Scripts" directory, so that someone who wants to run both Python and a Python script needs to add both $PYTHON_ROOT and $PYTHON_ROOT/Scripts to the PATH. To add just a little more complication, the python binary is placed within the binaries directory when a virtualenv is created, leading to an inconsistency between regular python installs and virtualenvs. Proposal #2 again provides consistency between virtualenvs and regular Python installs, and on windows it allows a single directory to be placed on the PATH to get all python-related binaries to run. [1] https://bitbucket.org/tarek/distutils2/src/6c3d67ed3adb/distutils2/_backpor… [2] It may be a foolish consistency, but I have a little mind. Thanks, Van [View Less]

24 118

AUTO: Jon K Peck is out of the office (returning 03/30/2012)
by Jon K Peck March 25, 2012

March 25, 2012

I am out of the office until 03/30/2012. I will be out of the office through Friday, March 30. I expect to have some email access but may be delayed in responding. Note: This is an automated response to your message "Python-Dev Digest, Vol 104, Issue 91" sent on 03/25/2012 1:19:50. This is the only notification you will receive while this person is away.

2 1

PEP czar for PEP 3144?
by Nick Coghlan March 25, 2012

March 25, 2012

Does anyone object to me naming myself PEP czar for PEP 3144? I've collated the objections to the original proposal on a few different occasions throughout the (long!) PEP review process, and as noted in the Background section, the latest version of the PEP [1] has addressed the key concerns that were raised: - the "strict" flag for Network objects is gone (instead, the validation differences between IP Network and IP Interface definitions are handled as different classes with otherwise … [View More]

16 38

Rename time.steady(strict=True) to time.monotonic()?
by Victor Stinner March 25, 2012

March 25, 2012

Hi, time.steady(strict=True) looks to be confusing for most people, some of them don't understand the purpose of the flag and others don't like a flag changing the behaviour of the function. I propose to replace time.steady(strict=True) by time.monotonic(). That would avoid the need of an ugly NotImplementedError: if the OS has no monotonic clock, time.monotonic() will just not exist. So we will have: - time.time(): realtime, can be adjusted by the system administrator (manually) or … [View More]

11 23

Re: [Python-Dev] Issue 13524: subprocess on Windows
by Brad Allen March 23, 2012

March 23, 2012

I tripped over this one trying to make one of our Python at work Windows compatible. We had no idea that a magic 'SystemRoot' environment variable would be required, and it was causing issues for pyzmq. It might be nice to reflect the findings of this email thread on the subprocess documentation page: http://docs.python.org/library/subprocess.html Currently the docs mention this: "Note If specified, env must provide any variables required for the program to execute. On Windows, in order to … [View More]

3 4

Re: [Python-Dev] cpython: Issue #10278: Add an optional strict argument to time.steady(), False by default
by Georg Brandl March 23, 2012

March 23, 2012

On 03/15/2012 01:17 AM, victor.stinner wrote: > http://hg.python.org/cpython/rev/27441e0d6a75 > changeset: 75672:27441e0d6a75 > user: Victor Stinner <victor.stinner(a)gmail.com> > date: Thu Mar 15 01:17:09 2012 +0100 > summary: > Issue #10278: Add an optional strict argument to time.steady(), False by default > > files: > Doc/library/time.rst | 7 +++- > Lib/test/test_time.py | 10 +++++ > Modules/timemodule.c | 58 +++++++++++++… [View More]

10 14

Re: [Python-Dev] [Python-checkins] cpython (3.2): attempt to fix asyncore buildbot failure
by Jim Jewett March 23, 2012

March 23, 2012

What does this verify? My assumption from the name (test_quick_connect) and the context (an asynchronous server) is that it is verifying the server can handle a certain level of load. Refusing the sockets should then be a failure, or at least a skipped test. Would the below fail even if asyncore.loop were taken out of the threading.Thread target altogether? On Fri, Mar 23, 2012 at 10:10 AM, giampaolo.rodola <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/… [View More]

1 0

Summary of Python tracker Issues
by Python tracker March 23, 2012

March 23, 2012

ACTIVITY SUMMARY (2012-03-16 - 2012-03-23) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3346 ( +9) closed 22829 (+50) total 26175 (+59) Open issues with patches: 1434 Issues opened (42) ================== #5301: add mimetype for image/vnd.microsoft.icon (patch) http://bugs.python.org/issue5301 reopened by eric.araujo #10340: asyncore doesn't … [View More]

1 0