Mailman 3 July 2015 - Python-Dev

Datetime SIG created
by Brett Cannon 28 Jul '15

28 Jul '15

https://mail.python.org/mailman/listinfo/datetime-sig In the future feel free to redirect date- and time-related discussions to the SIG since datetime stuff requires such a specific domain knowledge that most of us have. I am also looking for people to be admins of the list. If you're willing to admin the list please let me know and I will add you.

2 1

Building python 2.7.10 for Windows from source
by Mark Kelley 28 Jul '15

28 Jul '15

I have been using Python for some time but it's been a decade since I've tried to build it from source, back in the 2.4 days. Things seem to have gotten a little more complicated now. I've read through the PCBuild/README file and got most stuff compiling. I find it a little odd that there are special instructions for the building the release version of tcl/tk. Is that what the developers actually do when they cut a release, or is there some other, top-level script that does this automatically? It just seems odd. Anyhow, my specific question is around the distutils wininst stubs, provided as binaries in the release tarball. Where can I find the source files that those binaries are built from? Many thanks, Mark.

4 5

Please create the datetime-sig mailing list
by Brett Cannon 27 Jul '15

27 Jul '15

[bcc'ed python-dev] Initial admin can be me and I will be in charge of finding more suitable admins to manage the list.

1 0

PyCapsule_Import semantics, relative imports, module names etc.
by John Dennis 26 Jul '15

26 Jul '15

While porting several existing CPython extension modules that form a package to be 2.7 and 3.x compatible the existing PyObject_* API was replaced with PyCapsule_*. This introduced some issues the existing CPython docs are silent on. I'd like clarification on a few issues and wish to raise some questions. 1. Should an extension module name as provided in PyModule_Create (Py3) or Py_InitModule3 (Py2) be fully package qualified or just the module name? I believe it's just the module name (see item 5 below) Yes/No? 2. PyCapsule_Import does not adhere to the general import semantics. The module name must be fully qualified, relative imports are not supported. 3. PyCapsule_Import requires the package (e.g. __init__.py) to import *all* of it's submodules which utilize the PyCapsule mechanism preventing lazy on demand loading. This is because PyCapsule_Import only imports the top level module (e.g. the package). From there it iterates over each of the module names in the module path. However the parent module (e.g. globals) will not contain an attribute for the submodule unless it's already been loaded. If the submodule has not been loaded into the parent PyCapsule_Import throws an error instead of trying to load the submodule. The only apparent solution is for the package to load every possible submodule whether required or not just to avoid a loading error. The inability to load modules on demand seems like a design flaw and change in semantics from the prior use of PyImport_ImportModule in combination with PyObject. [One of the nice features with normal import loading is setting the submodule name in the parent, the fact this step is omitted is what causes PyCapsule_Import to fail unless all submodules are unconditionally loaded). Shouldn't PyCapsule_Import utilize PyImport_ImportModule? 4. Relative imports seem much more useful for cooperating submodules in a package as opposed to fully qualified package names. Being able to import a C_API from the current package (the package I'm a member of) seems much more elegant and robust for cooperating modules but this semantic isn't supported (in fact the leading dot syntax completely confuses PyCapsule_Import, doc should clarify this). 5. The requirement that a module specifies it's name as unqualified when it is initializing but then also has to use a fully qualified package name for PyCapsule_New, both of which occur inside the same initialization function seems like an odd inconsistency (documentation clarification would help here). Also, depending on your point of view package names could be considered a deployment/packaging decision, a module obtains it's fully qualified name by virtue of it's position in the filesystem, something at compile time the module will not be aware of, another reason why relative imports make sense. Note the identical comment regarding _Py_PackageContext in modsupport.c (Py2) and moduleobject.c (Py3) regarding how a module obtains it's fully qualified package name (see item 1). Thanks! -- John

3 2

[RELEASED] Python 3.5.0b4 is now available
by Larry Hastings 26 Jul '15

26 Jul '15

On behalf of the Python development community and the Python 3.5 release team, I'm delighted to announce the availability of Python 3.5.0b4. Python 3.5.0b4 is scheduled to be the last beta release; the next release will be Python 3.5.0rc1, or Release Candidate 1. Python 3.5 has now entered "feature freeze". By default new features may no longer be added to Python 3.5. This is a preview release, and its use is not recommended for production settings. An important reminder for Windows users about Python 3.5.0b4: if installing Python 3.5.0b4 as a non-privileged user, you may need to escalate to administrator privileges to install an update to your C runtime libraries. You can find Python 3.5.0b4 here: https://www.python.org/downloads/release/python-350b4/ Happy hacking, */arry*

2 1

Summary of Python tracker Issues
by Python tracker 24 Jul '15

24 Jul '15

ACTIVITY SUMMARY (2015-07-17 - 2015-07-24) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4957 (+10) closed 31511 (+43) total 36468 (+53) Open issues with patches: 2254 Issues opened (34) ================== #23591: Add IntFlags http://bugs.python.org/issue23591 reopened by r.david.murray #24619: async/await parser issues http://bugs.python.org/issue24619 reopened by yselivanov #24653: Mock.assert_has_calls([]) is surprising for users http://bugs.python.org/issue24653 reopened by rbcollins #24657: CGIHTTPServer module discard continuous '/' letters from param http://bugs.python.org/issue24657 opened by takayuki #24658: open().write() fails on 2 GB+ data (OS X) http://bugs.python.org/issue24658 opened by lebigot #24659: dict() built-in fails on iterators with a "keys" attribute http://bugs.python.org/issue24659 opened by christian.barcenas #24661: CGIHTTPServer: premature unescaping of query string http://bugs.python.org/issue24661 opened by johnseman #24665: CJK support for textwrap http://bugs.python.org/issue24665 opened by fgallaire #24666: Buffered I/O does not take file position into account when rea http://bugs.python.org/issue24666 opened by ericpruitt #24667: OrderedDict.popitem()/__str__() raises KeyError http://bugs.python.org/issue24667 opened by xZise #24668: Deprecate 00000 as a synonym for 0 http://bugs.python.org/issue24668 opened by steven.daprano #24670: os.chdir breaks result of os.path.abspath(__file__) and os.pat http://bugs.python.org/issue24670 opened by LordBlick #24671: idlelib 2.7: finish converting print statements http://bugs.python.org/issue24671 opened by terry.reedy #24672: shutil.rmtree failes on non ascii filenames http://bugs.python.org/issue24672 opened by Steffen Kampmann #24673: distutils/_msvccompiler does not remove /DLL during link(CComp http://bugs.python.org/issue24673 opened by James Salter #24674: pyclbr not recursively showing classes in packages http://bugs.python.org/issue24674 opened by worenklein #24681: Put most likely test first in set_add_entry() http://bugs.python.org/issue24681 opened by rhettinger #24682: Add Quick Start: Communications section to devguide http://bugs.python.org/issue24682 opened by willingc #24683: Type confusion in json encoding http://bugs.python.org/issue24683 opened by pkt #24684: socket.getaddrinfo(host) doesn't ensure that host.encode() ret http://bugs.python.org/issue24684 opened by pkt #24685: collections.OrderedDict collaborative subclassing http://bugs.python.org/issue24685 opened by eric.frederich #24686: zipfile is intolerant of extra bytes http://bugs.python.org/issue24686 opened by Devin Fisher #24689: Add tips for effective online communication to devguide http://bugs.python.org/issue24689 opened by willingc #24691: out of memory in distutils.upload with large files http://bugs.python.org/issue24691 opened by Jan.Stürtz #24692: types.coroutines() idempotence documentation http://bugs.python.org/issue24692 opened by seirl #24693: zipfile: change RuntimeError to more appropriate exception typ http://bugs.python.org/issue24693 opened by serhiy.storchaka #24696: Don't use None as sentinel for traceback http://bugs.python.org/issue24696 opened by Drekin #24697: Add CoroutineReturn and CoroutineExit builtin exceptions for c http://bugs.python.org/issue24697 opened by yselivanov #24698: get_externals.bat script fails http://bugs.python.org/issue24698 opened by Alex Budovski #24699: TemporaryDirectory is cleaned up twice http://bugs.python.org/issue24699 opened by Ilya.Kulakov #24700: array compare is hideously slow http://bugs.python.org/issue24700 opened by swanson #24705: sysconfig._parse_makefile doesn't expand ${} vars appearing be http://bugs.python.org/issue24705 opened by doko #24706: poplib: Line too long error causes knock-on failure to retriev http://bugs.python.org/issue24706 opened by Chris Smowton #24707: Assertion failed in pymonotonic_new http://bugs.python.org/issue24707 opened by berker.peksag Most recent 15 issues with no replies (15) ========================================== #24707: Assertion failed in pymonotonic_new http://bugs.python.org/issue24707 #24706: poplib: Line too long error causes knock-on failure to retriev http://bugs.python.org/issue24706 #24696: Don't use None as sentinel for traceback http://bugs.python.org/issue24696 #24693: zipfile: change RuntimeError to more appropriate exception typ http://bugs.python.org/issue24693 #24691: out of memory in distutils.upload with large files http://bugs.python.org/issue24691 #24673: distutils/_msvccompiler does not remove /DLL during link(CComp http://bugs.python.org/issue24673 #24666: Buffered I/O does not take file position into account when rea http://bugs.python.org/issue24666 #24657: CGIHTTPServer module discard continuous '/' letters from param http://bugs.python.org/issue24657 #24652: C-API Pure Embedding enhancement http://bugs.python.org/issue24652 #24647: Document argparse.REMAINDER as being equal to "..." http://bugs.python.org/issue24647 #24637: locals dictionary in PyRun_String http://bugs.python.org/issue24637 #24626: please sync cgi.parse document http://bugs.python.org/issue24626 #24623: Parser: broken line numbers for triple-quoted strings http://bugs.python.org/issue24623 #24618: Invalid read in PyCode_New http://bugs.python.org/issue24618 #24591: offer option to suppress "clean --all" output relating to none http://bugs.python.org/issue24591 Most recent 15 issues waiting for review (15) ============================================= #24698: get_externals.bat script fails http://bugs.python.org/issue24698 #24693: zipfile: change RuntimeError to more appropriate exception typ http://bugs.python.org/issue24693 #24682: Add Quick Start: Communications section to devguide http://bugs.python.org/issue24682 #24681: Put most likely test first in set_add_entry() http://bugs.python.org/issue24681 #24674: pyclbr not recursively showing classes in packages http://bugs.python.org/issue24674 #24673: distutils/_msvccompiler does not remove /DLL during link(CComp http://bugs.python.org/issue24673 #24665: CJK support for textwrap http://bugs.python.org/issue24665 #24658: open().write() fails on 2 GB+ data (OS X) http://bugs.python.org/issue24658 #24645: logging.handlers.QueueHandler should not lock when handling a http://bugs.python.org/issue24645 #24637: locals dictionary in PyRun_String http://bugs.python.org/issue24637 #24634: Importing uuid should not try to load libc on Windows http://bugs.python.org/issue24634 #24633: README file installed into site-packages conflicts with packag http://bugs.python.org/issue24633 #24622: tokenize.py: missing EXACT_TOKEN_TYPES http://bugs.python.org/issue24622 #24619: async/await parser issues http://bugs.python.org/issue24619 #24613: array.fromstring Use After Free http://bugs.python.org/issue24613 Top 10 most discussed issues (10) ================================= #24681: Put most likely test first in set_add_entry() http://bugs.python.org/issue24681 16 msgs #21750: mock_open data is visible only once for the life of the class http://bugs.python.org/issue21750 14 msgs #24667: OrderedDict.popitem()/__str__() raises KeyError http://bugs.python.org/issue24667 13 msgs #24619: async/await parser issues http://bugs.python.org/issue24619 12 msgs #24658: open().write() fails on 2 GB+ data (OS X) http://bugs.python.org/issue24658 10 msgs #24646: Python accepts SSL certificate that should be rejected on OSX http://bugs.python.org/issue24646 9 msgs #24665: CJK support for textwrap http://bugs.python.org/issue24665 8 msgs #23883: __all__ lists are incomplete http://bugs.python.org/issue23883 6 msgs #24651: Mock.assert* API is in user namespace http://bugs.python.org/issue24651 6 msgs #24682: Add Quick Start: Communications section to devguide http://bugs.python.org/issue24682 6 msgs Issues closed (41) ================== #1615: PyObject_GenericGetAttr suppresses AttributeErrors in descript http://bugs.python.org/issue1615 closed by ethan.furman #6549: ttk.Style -- minor issues with element_names and configure http://bugs.python.org/issue6549 closed by python-dev #8585: zipimporter.find_module is untested http://bugs.python.org/issue8585 closed by rbcollins #13124: Add "Running a Build Slave" page to the devguide http://bugs.python.org/issue13124 closed by willingc #13938: 2to3 fails to convert types.StringTypes appropriately http://bugs.python.org/issue13938 closed by rbcollins #19624: Switch constants in the errno module to IntEnum http://bugs.python.org/issue19624 closed by ethan.furman #19663: Not so correct error message when initializing defaultdict http://bugs.python.org/issue19663 closed by rhettinger #21406: Some socket constants are not enums http://bugs.python.org/issue21406 closed by ethan.furman #22153: Documentation of TestCase.runTest is incorrect and confusing http://bugs.python.org/issue22153 closed by rbcollins #23054: ConnectionError: ('Connection aborted.', BadStatusLine(""''''" http://bugs.python.org/issue23054 closed by vadmium #23440: Extend http.server.SimpleHTTPRequestHandler testing http://bugs.python.org/issue23440 closed by berker.peksag #24206: Issues with equality of inspect objects http://bugs.python.org/issue24206 closed by serhiy.storchaka #24300: Code Refactoring in function nis_mapname() http://bugs.python.org/issue24300 closed by rhettinger #24470: ctypes incorrect handling of long int on 64bits Linux http://bugs.python.org/issue24470 closed by Marco Clemencic #24485: Function source inspection fails on closures http://bugs.python.org/issue24485 closed by meador.inge #24503: csv.writer fails when within csv.reader http://bugs.python.org/issue24503 closed by ezzieyguywuf #24620: Segfault with nonsensical random state http://bugs.python.org/issue24620 closed by serhiy.storchaka #24642: Will there be an MSI installer? http://bugs.python.org/issue24642 closed by tritium #24654: PEP 492 - example benchmark doesn't work (TypeError) http://bugs.python.org/issue24654 closed by yselivanov #24655: _ssl.c: Missing "do" for do {} while(0) idiom http://bugs.python.org/issue24655 closed by benjamin.peterson #24656: remove "assret" from mock error checking http://bugs.python.org/issue24656 closed by ncoghlan #24660: Heapq + functools.partial : TypeError: unorderable types http://bugs.python.org/issue24660 closed by vadmium #24662: While condition not satisfied embarrassingly http://bugs.python.org/issue24662 closed by ezio.melotti #24663: ast.literal_eval does not handle empty set literals http://bugs.python.org/issue24663 closed by ezio.melotti #24664: build failure with _Py_BEGIN_SUPPRESS_IPH undefined http://bugs.python.org/issue24664 closed by zbysz #24669: inspect.getsource() returns the wrong lines for coroutine func http://bugs.python.org/issue24669 closed by yselivanov #24675: Avoid DeprecationWarning in test_os http://bugs.python.org/issue24675 closed by haypo #24676: Error in pickle using cProfile http://bugs.python.org/issue24676 closed by serhiy.storchaka #24677: "def f(*args, ): pass" does not compile http://bugs.python.org/issue24677 closed by vadmium #24678: raiseExceptions typo fix in logging tests http://bugs.python.org/issue24678 closed by serhiy.storchaka #24679: Windows embeddable Python zip file crashes (cannot find a dll) http://bugs.python.org/issue24679 closed by steve.dower #24680: typo in documentation, section extending python http://bugs.python.org/issue24680 closed by python-dev #24687: refleak on SyntaxError in function parameter annotation http://bugs.python.org/issue24687 closed by yselivanov #24688: Fix ast.get_docstring to support 'async def' functions http://bugs.python.org/issue24688 closed by yselivanov #24690: find_executable should expand ~ http://bugs.python.org/issue24690 closed by r.david.murray #24694: callables registered in TestCase.addCleanup should be run befo http://bugs.python.org/issue24694 closed by yselivanov #24695: Don't print traceback header if traceback is None in Traceback http://bugs.python.org/issue24695 closed by berker.peksag #24701: list.pop() removes items from multiple lists http://bugs.python.org/issue24701 closed by r.david.murray #24702: Uninitialised Pointer buf.outobj http://bugs.python.org/issue24702 closed by serhiy.storchaka #24703: Resource Leak http://bugs.python.org/issue24703 closed by serhiy.storchaka #24704: Dereferencing a Null Pointer http://bugs.python.org/issue24704 closed by serhiy.storchaka

1 0

[python_default-nightly] Benchmark Results for 3bbd0cbfe836511dd3e05fcc30ffb5bdbfe686ea
by lp_benchmark_robot 24 Jul '15

24 Jul '15

Hi Internals, This is the first message from Intel's language optimization team. We would like to provide the Python internals developer community with a daily service which will monitor latest committed patches performance regressions against well known workloads. Our aim is to run a multitude of workloads as well as real-life scenarios which the community considers relevant. The service will send daily bulletins containing latest measurements for daily variations and variations against latest stable release run on our Intel-enabled servers. The community's feedback is very important for us. For any questions, comments or suggestions you can also contact us on our mailing list lp(a)lists.01.org. You can also check our website: https://www.01.org/lp Results for project python_default-nightly, build date 2015-07-24 09:02:02 commit: 3bbd0cbfe836511dd3e05fcc30ffb5bdbfe686ea revision date: 2015-07-24 07:43:44 environment: Haswell-EP cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB mem: 128 GB os: CentOS 7.1 kernel: Linux 3.10.0-229.4.2.el7.x86_64 Note: Baseline results were generated using release v3.4.3, with hash b4cbecbc0781e89a309d03b60a1f75f8499250e6 from 2015-02-25 12:15:33+00:00 -------------------------------------------------------------------------------- benchmark unit change since change since last run v3.4.3 -------------------------------------------------------------------------------- :-) django_v2 sec 1.12735% 7.47953% :-( pybench sec -0.53822% -2.40216% :-( regex_v8 sec 0.61774% -2.32010% :-| nbody sec 1.75860% -0.76206% :-) json_dump_v2 sec 2.13422% -0.56930% Our lab does a nightly source pull and build of the Python project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly. Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document. Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade. This document may contain information on products, services and/or processes in development. Contact your Intel representative to obtain the latest forecast, schedule, specifications and roadmaps. The products and services described may contain defects or errors known as errata which may cause deviations from published specifications. Current characterized errata are available on request. (C) 2015 Intel Corporation.

1 0

Python automatic optimization
by Andrew Steinberg 23 Jul '15

23 Jul '15

Hello everybody, I am using Python 2.7 as a backbone for some mathematical simulations. I recently discovered a tool called AutoFDO and I tried compiling my own Python version, but I did not manage to get it working. My question is, will sometime in the future Python include this tool? Thank you,Andrew

3 2

Reminder: Python 3.5 beta 4 is tagged in one week
by Larry Hastings 23 Jul '15

23 Jul '15

Approximately a week from when I post this, I'll be tagging Python 3.5 beta 4, which is the last beta before we go to release candidates. Please wind up all your bug fixes soon, I'd really like checkins to 3.5 to stop soon. And a minor reminder: when we hit Release Candidate 1, I'll be switching the canonical repo for 3.5 to a public Bitbucket repo. Any bug fixes that go in between RC 1 and final will only be merged using Bitbucket "pull requests". The new workflow experiment continues, //arry/

2 4

Devguide - Add Communications Quick Start Section
by Carol Willing 22 Jul '15

22 Jul '15

I would like to add a "Communications Quick Start" section to the beginning of the Python Developer's Guide. Productive communication between each other will always be critical to future development of CPython and maintaining releases, infrastructure, documentation, and more. Unproductive communication saps energy of contributors, reduces engagement in the project, and limits creativity and fulfillment in contributing. As a contributor who finds great value in the power and zen of Python, I want to foster more effective and productive communication. I've been thinking about ways to do this since the PyCon sprints. New developers would benefit from understanding how to interact with the community and its norms. Existing contributors would hopefully benefit from less time reexplaining community communication norms. The Communications Quick Start section would be brief and practical much like the Quick Start section for downloading and testing the source code. Placing the Communications Quick Start section before the existing Quick Start section would emphasize the importance that productive communications has on CPython development. Thanks, Carol P.S. Thank you to all that devote time and energy to the development of CPython. I have posted this to the python-dev mailing list for feedback due to the recent discussions. Nick and Brett, please feel free to move this to python-ideas if you feel that would be a better place to discuss this addition to the devguide.

6 6