Mailman 3 January 2013 - Python-Dev

Summary of Python tracker Issues
by Python tracker Jan. 11, 2013

Jan. 11, 2013

ACTIVITY SUMMARY (2013-01-04 - 2013-01-11) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3825 ( +8) closed 24888 (+65) total 28713 (+73) Open issues with patches: 1668 Issues opened (41) ================== #12944: Accept arbitrary files for packaging's upload command http://bugs.python.org/issue12944 reopened by eric.araujo #13198: Remove duplicate definition of write_record_file http://bugs.python.org/issue13198 reopened by eric.araujo #15539: Fixing Tools/scripts/pindent.py http://bugs.python.org/issue15539 reopened by serhiy.storchaka #16076: xml.etree.ElementTree.Element is no longer pickleable http://bugs.python.org/issue16076 reopened by ezio.melotti #16823: Python crashes on running tkinter code with threads http://bugs.python.org/issue16823 reopened by terry.reedy #16864: sqlite3.Cursor.lastrowid isn't populated when executing a SQL http://bugs.python.org/issue16864 opened by jim_minter #16865: ctypes arrays >=2GB in length causes exception http://bugs.python.org/issue16865 opened by coderforlife #16866: libainstall doesn't create $(BINDIR) directory http://bugs.python.org/issue16866 opened by bennoleslie #16869: makesetup should support .S source files http://bugs.python.org/issue16869 opened by bennoleslie #16878: argparse: positional args with nargs='*' defaults to [] http://bugs.python.org/issue16878 opened by chris.jerdonek #16879: distutils.command.config uses fragile constant temporary file http://bugs.python.org/issue16879 opened by mgorny #16880: Importing "imp" will fail if dynamic loading not supported http://bugs.python.org/issue16880 opened by Jeffrey.Armstrong #16885: SQLite3 iterdump ordering http://bugs.python.org/issue16885 opened by Jamie.Spence #16886: Doctests in test_dictcomp depend on dict order http://bugs.python.org/issue16886 opened by fwierzbicki #16887: IDLE - tabify/untabify applied when clicking Cancel http://bugs.python.org/issue16887 opened by serwy #16889: facilitate log output starting at beginning of line http://bugs.python.org/issue16889 opened by chris.jerdonek #16891: Fix docs about module search order http://bugs.python.org/issue16891 opened by dmugtasimov #16892: Windows bug picking up stdin from a pipe http://bugs.python.org/issue16892 opened by oeffner #16893: Create IDLE help.txt from Doc/library/idle.rst http://bugs.python.org/issue16893 opened by zach.ware #16894: Function attribute access doesn't invoke methods in dict subcl http://bugs.python.org/issue16894 opened by dabeaz #16895: Batch file to mimic 'make' on Windows http://bugs.python.org/issue16895 opened by zach.ware #16899: Add support for C99 complex type (_Complex) as ctypes.c_comple http://bugs.python.org/issue16899 opened by rutsky #16901: In http.cookiejar.FileCookieJar() the .load() and .revert() me http://bugs.python.org/issue16901 opened by py.user #16902: Add OSS module support for Solaris http://bugs.python.org/issue16902 opened by brian-cameron-oracle #16903: subprocess.Popen.communicate with universal_newlines=True does http://bugs.python.org/issue16903 opened by serhiy.storchaka #16904: Avoid unnecessary and possibly unsafe code from http.client.HT http://bugs.python.org/issue16904 opened by sanyi #16907: Distutils fails to build extension in path with spaces http://bugs.python.org/issue16907 opened by klo.uo #16909: urlparse: add userinfo attribute http://bugs.python.org/issue16909 opened by olof #16914: timestamping in smtplib.py to help troubleshoot server timeout http://bugs.python.org/issue16914 opened by gac #16915: mode of socket.makefile is more limited than documentation sug http://bugs.python.org/issue16915 opened by Antoon.Pardon #16916: The Extended Iterable Unpacking (PEP-3132) for byte strings do http://bugs.python.org/issue16916 opened by marco.buttu #16921: Docs of subprocess.CREATE_NEW_CONSOLE are wrong http://bugs.python.org/issue16921 opened by torsten #16923: test_ssl kicks up a lot of ResourceWarnings http://bugs.python.org/issue16923 opened by benjamin.peterson #16926: setup.py register does not always respect --repository http://bugs.python.org/issue16926 opened by chris.jerdonek #16927: Separate built-in types from functions and group similar funct http://bugs.python.org/issue16927 opened by ezio.melotti #16930: mention limitations and/or alternatives to hg graft http://bugs.python.org/issue16930 opened by chris.jerdonek #16931: mention work-around to create diffs in default/non-git mode http://bugs.python.org/issue16931 opened by chris.jerdonek #16933: argparse: remove magic from examples http://bugs.python.org/issue16933 opened by guettli #16935: unittest should understand SkipTest at import time during test http://bugs.python.org/issue16935 opened by brett.cannon #16936: Documentation for stat.S_IFMT inconsistent http://bugs.python.org/issue16936 opened by lechten #16922: ElementTree.findtext() returns empty bytes object instead of e http://bugs.python.org/issue16922 opened by serhiy.storchaka Most recent 15 issues with no replies (15) ========================================== #16936: Documentation for stat.S_IFMT inconsistent http://bugs.python.org/issue16936 #16931: mention work-around to create diffs in default/non-git mode http://bugs.python.org/issue16931 #16930: mention limitations and/or alternatives to hg graft http://bugs.python.org/issue16930 #16927: Separate built-in types from functions and group similar funct http://bugs.python.org/issue16927 #16923: test_ssl kicks up a lot of ResourceWarnings http://bugs.python.org/issue16923 #16916: The Extended Iterable Unpacking (PEP-3132) for byte strings do http://bugs.python.org/issue16916 #16904: Avoid unnecessary and possibly unsafe code from http.client.HT http://bugs.python.org/issue16904 #16901: In http.cookiejar.FileCookieJar() the .load() and .revert() me http://bugs.python.org/issue16901 #16895: Batch file to mimic 'make' on Windows http://bugs.python.org/issue16895 #16892: Windows bug picking up stdin from a pipe http://bugs.python.org/issue16892 #16887: IDLE - tabify/untabify applied when clicking Cancel http://bugs.python.org/issue16887 #16885: SQLite3 iterdump ordering http://bugs.python.org/issue16885 #16879: distutils.command.config uses fragile constant temporary file http://bugs.python.org/issue16879 #16859: tarfile.TarInfo.fromtarfile does not check read() return value http://bugs.python.org/issue16859 #16845: warnings.simplefilter should validate input http://bugs.python.org/issue16845 Most recent 15 issues waiting for review (15) ============================================= #16936: Documentation for stat.S_IFMT inconsistent http://bugs.python.org/issue16936 #16922: ElementTree.findtext() returns empty bytes object instead of e http://bugs.python.org/issue16922 #16921: Docs of subprocess.CREATE_NEW_CONSOLE are wrong http://bugs.python.org/issue16921 #16915: mode of socket.makefile is more limited than documentation sug http://bugs.python.org/issue16915 #16914: timestamping in smtplib.py to help troubleshoot server timeout http://bugs.python.org/issue16914 #16909: urlparse: add userinfo attribute http://bugs.python.org/issue16909 #16902: Add OSS module support for Solaris http://bugs.python.org/issue16902 #16887: IDLE - tabify/untabify applied when clicking Cancel http://bugs.python.org/issue16887 #16886: Doctests in test_dictcomp depend on dict order http://bugs.python.org/issue16886 #16880: Importing "imp" will fail if dynamic loading not supported http://bugs.python.org/issue16880 #16878: argparse: positional args with nargs='*' defaults to [] http://bugs.python.org/issue16878 #16869: makesetup should support .S source files http://bugs.python.org/issue16869 #16866: libainstall doesn't create $(BINDIR) directory http://bugs.python.org/issue16866 #16860: Use O_CLOEXEC in the tempfile module http://bugs.python.org/issue16860 #16853: add a Selector to the select module http://bugs.python.org/issue16853 Top 10 most discussed issues (10) ================================= #16853: add a Selector to the select module http://bugs.python.org/issue16853 42 msgs #16748: Make CPython test package discoverable http://bugs.python.org/issue16748 19 msgs #16076: xml.etree.ElementTree.Element is no longer pickleable http://bugs.python.org/issue16076 16 msgs #5066: IDLE documentation for Unix obsolete/incorrect http://bugs.python.org/issue5066 14 msgs #16795: Patch: some changes to AST to make it more useful for static l http://bugs.python.org/issue16795 13 msgs #16902: Add OSS module support for Solaris http://bugs.python.org/issue16902 11 msgs #12107: TCP listening sockets created without FD_CLOEXEC flag http://bugs.python.org/issue12107 8 msgs #14468: Update cloning guidelines in devguide http://bugs.python.org/issue14468 8 msgs #16865: ctypes arrays >=2GB in length causes exception http://bugs.python.org/issue16865 8 msgs #16889: facilitate log output starting at beginning of line http://bugs.python.org/issue16889 8 msgs Issues closed (65) ================== #3073: Cookie.Morsel breaks in parsing cookie values with whitespace http://bugs.python.org/issue3073 closed by christian.heimes #3583: test_urllibnet.test_bad_address() fails when using OpenDNS http://bugs.python.org/issue3583 closed by brett.cannon #7378: unexpected truncation of traceback http://bugs.python.org/issue7378 closed by serhiy.storchaka #9242: unicodeobject.c: use of uninitialized values http://bugs.python.org/issue9242 closed by serhiy.storchaka #9685: tuples should remember their hash value http://bugs.python.org/issue9685 closed by benjamin.peterson #10895: Private stdlib API: getopt, getpass, glob, gzip, genericpath, http://bugs.python.org/issue10895 closed by brett.cannon #11461: UTF-16 incremental decoder doesn't support partial surrogate p http://bugs.python.org/issue11461 closed by serhiy.storchaka #13094: Need Programming FAQ entry for the behavior of closures http://bugs.python.org/issue13094 closed by ezio.melotti #13899: re pattern r"[\A]" should work like "A" but matches nothing. D http://bugs.python.org/issue13899 closed by ezio.melotti #13934: sqlite3 test typo http://bugs.python.org/issue13934 closed by r.david.murray #15109: sqlite3.Connection.iterdump() dies with encoding exception http://bugs.python.org/issue15109 closed by r.david.murray #15278: UnicodeDecodeError when readline in codecs.py http://bugs.python.org/issue15278 closed by serhiy.storchaka #15545: sqlite3.Connection.iterdump() does not work with row_factory = http://bugs.python.org/issue15545 closed by r.david.murray #15782: Compile error for a number of Mac modules with recent Xcode http://bugs.python.org/issue15782 closed by ned.deily #15845: Fixing some byte-to-string conversion warnings http://bugs.python.org/issue15845 closed by serhiy.storchaka #15972: wrong error message for os.path.getsize http://bugs.python.org/issue15972 closed by serhiy.storchaka #16143: Building with configure option "--without-doc-strings" crashes http://bugs.python.org/issue16143 closed by skrah #16154: Some minor doc fixes in Doc/library http://bugs.python.org/issue16154 closed by ezio.melotti #16320: Establish order in bytes/string dependencies http://bugs.python.org/issue16320 closed by serhiy.storchaka #16835: Update PEP 399 to allow for test discovery http://bugs.python.org/issue16835 closed by ezio.melotti #16836: configure script disables support for IPv6 on a system where I http://bugs.python.org/issue16836 closed by neologix #16843: sporadic test_sched failure http://bugs.python.org/issue16843 closed by serhiy.storchaka #16849: Element.{get,iter} doesn't handle keyword arguments when using http://bugs.python.org/issue16849 closed by eli.bendersky #16852: Fix test discovery for test_genericpath.py http://bugs.python.org/issue16852 closed by ezio.melotti #16854: usage() is not defined in Lib/test/regrtest.py http://bugs.python.org/issue16854 closed by chris.jerdonek #16861: Portion of code example not highlighted in collections doc http://bugs.python.org/issue16861 closed by ezio.melotti #16862: FAQ has outdated information about Stackless http://bugs.python.org/issue16862 closed by ezio.melotti #16867: setup.py fails if there are no extensions http://bugs.python.org/issue16867 closed by ned.deily #16868: Python Developer Guide: Include a reminder to "ping" bug repor http://bugs.python.org/issue16868 closed by ezio.melotti #16870: re fails to match ^ when start index is specified ? http://bugs.python.org/issue16870 closed by ned.deily #16871: Cleanup a few minor things http://bugs.python.org/issue16871 closed by ezio.melotti #16872: Metaclass conflict proposition http://bugs.python.org/issue16872 closed by benjamin.peterson #16873: increase epoll.poll() maxevents default value, and improve doc http://bugs.python.org/issue16873 closed by neologix #16874: setup.py upload option repeated in docs http://bugs.python.org/issue16874 closed by chris.jerdonek #16875: in 3.3.0 windows 64 idle editor http://bugs.python.org/issue16875 closed by ezio.melotti #16876: epoll: reuse epoll_event buffer instead of allocating a new on http://bugs.python.org/issue16876 closed by neologix #16877: Odd behavior of ~ in os.path.abspath and os.path.realpath http://bugs.python.org/issue16877 closed by r.david.murray #16881: Py_ARRAY_LENGTH macro incorrect with GCC < 3.1 http://bugs.python.org/issue16881 closed by christian.heimes #16882: Python 2.7 has 73 files with hard references to /usr/local whe http://bugs.python.org/issue16882 closed by ned.deily #16883: "--enable-shared" during configure forces "2.7.3" to build as http://bugs.python.org/issue16883 closed by ned.deily #16884: logging handler automatically added starting in 3.2+ http://bugs.python.org/issue16884 closed by python-dev #16888: Fix test discovery for test_array.py http://bugs.python.org/issue16888 closed by ezio.melotti #16890: minidom error http://bugs.python.org/issue16890 closed by ezio.melotti #16896: Fix test discovery for test_asyncore.py http://bugs.python.org/issue16896 closed by ezio.melotti #16897: Fix test discovery for test_bisect.py http://bugs.python.org/issue16897 closed by ezio.melotti #16898: Fix test discovery for test_bufio.py http://bugs.python.org/issue16898 closed by ezio.melotti #16900: SSL sockets don't give resource warnings http://bugs.python.org/issue16900 closed by python-dev #16905: Fix test discovery for test_warnings http://bugs.python.org/issue16905 closed by ezio.melotti #16906: Bug in _PyUnicode_ClearStaticStrings() method of unicodeobject http://bugs.python.org/issue16906 closed by python-dev #16908: Enhancing performance and memory usage http://bugs.python.org/issue16908 closed by georg.brandl #16910: Fix test discovery for bytes/string tests http://bugs.python.org/issue16910 closed by ezio.melotti #16911: Socket Documentation Error http://bugs.python.org/issue16911 closed by sghose #16912: Wrong float sum w/ 10.14+10.1 and 10.24+10.2 http://bugs.python.org/issue16912 closed by ezio.melotti #16913: ElementTree tostring error when method='text' http://bugs.python.org/issue16913 closed by eli.bendersky #16917: Misleading missing parenthesis syntax error http://bugs.python.org/issue16917 closed by ezio.melotti #16918: Fix test discovery for test_codecs.py http://bugs.python.org/issue16918 closed by ezio.melotti #16919: Fix test discovery for test_crypt.py http://bugs.python.org/issue16919 closed by ezio.melotti #16920: multiprocessing.connection listener gets MemoryError on recv http://bugs.python.org/issue16920 closed by sbt #16924: try: except: ordering error http://bugs.python.org/issue16924 closed by r.david.murray #16925: Fix test discovery for test_configparser.py http://bugs.python.org/issue16925 closed by ezio.melotti #16928: spurious Cron Daemon e-mails to docs(a)dinsdale.python.org http://bugs.python.org/issue16928 closed by georg.brandl #16929: poll()/epoll() are not thread-safe http://bugs.python.org/issue16929 closed by neologix #16932: urlparse fails at parsing "www.python.org:80/" http://bugs.python.org/issue16932 closed by georg.brandl #16934: qsort doesn't work for double arrays http://bugs.python.org/issue16934 closed by mark.dickinson #1694663: Overloading int.__pow__ does not work http://bugs.python.org/issue1694663 closed by serhiy.storchaka

1 0

Re: [Python-Dev] cpython (3.3): #16919: test_crypt now works with unittest test discovery. Patch by Zachary
by Antoine Pitrou Jan. 11, 2013

Jan. 11, 2013

On Fri, 11 Jan 2013 04:20:21 +0100 (CET) ezio.melotti <python-checkins(a)python.org> wrote: > > diff --git a/Lib/test/test_crypt.py b/Lib/test/test_crypt.py > --- a/Lib/test/test_crypt.py > +++ b/Lib/test/test_crypt.py > @@ -1,7 +1,11 @@ > from test import support > import unittest > > -crypt = support.import_module('crypt') > +def setUpModule(): > + # this import will raise unittest.SkipTest if _crypt doesn't exist, > + # so it has to be done in setUpModule for test discovery to work > + global crypt > + crypt = support.import_module('crypt') Yikes. Couldn't unittest support SkipTest being raised at import instead? setUpModule is an ugly way to do this. Regards Antoine.

3 2

Re: [Python-Dev] [Python-checkins] Cron <docs@dinsdale> /home/docs/build-devguide
by Chris Jerdonek Jan. 11, 2013

Jan. 11, 2013

On Thu, Jan 10, 2013 at 11:35 PM, Cron Daemon <root(a)python.org> wrote: > /home/docs/devguide/documenting.rst:766: WARNING: term not in glossary: bytecode FYI, this warning is spurious (second time at least). I made an issue about it here: http://bugs.python.org/issue16928 --Chris

1 0

Re: [Python-Dev] FYI - wiki.python.org compromised
by Robert Whitney Jan. 10, 2013

Jan. 10, 2013

To Whoever this may concern, I believe the exploit in use on the Python Wiki could have been the following remote arbitrary code execution exploit that myself and some fellow researchers have been working with over the past few days. I'm not sure if this has quite been reported to the Moin development team, however this exploit would be triggered via a URL much like the following: http://wiki.python.org/WikiSandBox?action=moinexec&c=uname%20-a This URL of course would cause for the page to output the contents of the command "uname -a". I think this is definitely worth your researchers looking into, and please be sure to credit myself (Robert 'xnite' Whitney; http://xnite.org) for finding & reporting this vulnerability. Best of luck, Robert 'xnite' Whitney PS - If you have any further questions on this matter for me, please feel free to us the contact information in my signature below or reply to this email. -- xnite (xnite(a)xnite.org) Google Voice: 828-45-XNITE (96483) Web: http://xnite.org PGP Key: http://xnite.org/pgpkey

2 1

Re: [Python-Dev] FYI - wiki.python.org compromised
by Paul Boddie Jan. 10, 2013

Jan. 10, 2013

Robert Whitney wrote: > To Whoever this may concern, > > I believe the exploit in use on the Python Wiki could have been the > following remote arbitrary code execution exploit that myself and some > fellow researchers have been working with over the past few days. I'm > not sure if this has quite been reported to the Moin development team, > however this exploit would be triggered via a URL much like the following: > http://wiki.python.org/WikiSandBox?action=moinexec&c=uname%20-a Did you check the MoinMoin security fixes page? http://moinmo.in/SecurityFixes What you describe is mentioned as "remote code execution vulnerability in twikidraw/anywikidraw action CVE-2012-6081". > This URL of course would cause for the page to output the contents of > the command "uname -a". I think this is definitely worth your > researchers looking into, and please be sure to credit myself (Robert > 'xnite' Whitney; http://xnite.org) for finding & reporting this > vulnerability. Have you discovered anything beyond the findings of the referenced, reported vulnerability, or any of those mentioned in the Debian advisory? http://www.debian.org/security/2012/dsa-2593 If so, I'm sure that the MoinMoin developers would be interested in working with you to responsibly mitigate the impact of any deployed, vulnerable code. Paul P.S. Although I don't speak for the MoinMoin developers in any way, please be advised that any replies to me may be shared with those developers and indeed any other parties I choose.

1 0

Arena terminology (PyArena vs obmalloc.c:"arena")
by Trent Nelson Jan. 9, 2013

Jan. 9, 2013

There's no correlation between PyArenas and the extensive use of the term "arena" in obmalloc.c, right? I initially assumed there was, based solely on the common use of the term arena. However, after more investigation, it *appears* as though there's absolutely no correlation. Just wanted to make 100% sure. Trent.

2 1

PEP 431 Time zone support improvements - Update
by Lennart Regebro Jan. 9, 2013

Jan. 9, 2013

Happy Holidays! Here is the update of PEP 431 with the changes that emerged after the earlier discussion. A raw download is here: https://raw.github.com/regebro/tz-pep/master/pep-04tz.txt PEP: 431 Title: Time zone support improvements Version: $Revision$ Last-Modified: $Date$ Author: Lennart Regebro <regebro(a)gmail.com> BDFL-Delegate: Barry Warsaw Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 11-Dec-2012 Post-History: 11-Dec-2012, 28-Dec-2012 Abstract ======== This PEP proposes the implementation of concrete time zone support in the Python standard library, and also improvements to the time zone API to deal with ambiguous time specifications during DST changes. Proposal ======== Concrete time zone support -------------------------- The time zone support in Python has no concrete implementation in the standard library outside of a tzinfo baseclass that supports fixed offsets. To properly support time zones you need to include a database over all time zones, both current and historical, including daylight saving changes. But such information changes frequently, so even if we include the last information in a Python release, that information would be outdated just a few months later. Time zone support has therefore only been available through two third-party modules, ``pytz`` and ``dateutil``, both who include and wrap the "zoneinfo" database. This database, also called "tz" or "The Olsen database", is the de-facto standard time zone database over time zones, and it is included in most Unix and Unix-like operating systems, including OS X. This gives us the opportunity to include the code that supports the zoneinfo data in the standard library, but by default use the operating system's copy of the data, which typically will be kept updated by the updating mechanism of the operating system or distribution. For those who have an operating system that does not include the zoneinfo database, for example Windows, the Python source distribution will include a copy of the zoneinfo database, and a distribution containing the latest zoneinfo database will also be available at the Python Package Index, so it can be easily installed with the Python packaging tools such as ``easy_install`` or ``pip``. This could also be done on Unices that are no longer recieving updates and therefore has an outdated database. With such a mechanism Python would have full time zone support in the standard library on any platform, and a simple package installation would provide an updated time zone database on those platforms where the zoneinfo database isn't included, such as Windows, or on platforms where OS updates are no longer provided. The time zone support will be implemented by making the ``datetime`` module into a package, and creating a new submodule called `timezone``, based on Stuart Bishop's ``pytz`` module. Getting the local time zone --------------------------- On Unix there is no standard way of finding the name of the time zone that is being used. All the information that is available is the time zone abbreviations, such as ``EST`` and ``PDT``, but many of those abbreviations are ambigious and therefore you can't rely on them to figure out which time zone you are located in. There is however a standard for finding the compiled time zone information since it's located in ``/etc/localtime``. Therefore it is possible to create a local time zone object with the correct time zone information even though you don't know the name of the time zone. A function in ``datetime`` should be provided to return the local time zone. The support for this will be made by integrating Lennart Regebro's ``tzlocal`` module into the new ``timezone`` module. For Windows it will look up the local Windows time zone name, and use a mapping between Windows time zone names and zoneinfo time zone names provided by the Unicode consortium to convert that to a zoneinfo timezone. The mapping should be updated before each major or bugfix release, scripts for doing so will be provided in the ``Tools/`` directory. Ambiguous times --------------- When changing over from daylight savings time the clock is turned back one hour. This means that the times during that hour happens twice, once without DST and then once with DST. Similarily, when changing to daylight savings time, one hour goes missing. The current time zone API can not differentiating between the two ambiguous times during a change from DST. For example, in Stockholm the time of 2012-11-28 02:00:00 happens twice, both at UTC 2012-11-28 00:00:00 and also at 2012-11-28 01:00:00. The current time zone API can not disambiguate this and therefore it's unclear which time should be returned:: # This could be either 00:00 or 01:00 UTC: >>> dt = datetime(2012, 10, 28, 2, 0, tzinfo=timezone('Europe/Stockholm')) # But we can not specify which: >>> dt.astimezone(timezone('UTC')) datetime.datetime(2012, 10, 28, 1, 0, tzinfo=<UTC>) ``pytz`` solved this problem by adding ``is_dst`` parameters to several methods of the tzinfo objects to make it possible to disambiguate times when this is desired. This PEP proposes to add these ``is_dst`` parameters to the relevant methods of the ``datetime`` API, and therefore add this functionality directly to ``datetime``. This is likely the hardest part of this PEP as this involves updating the C version of the ``datetime`` library with this functionality, as this involved writing new code, and not just reorganizing existing external libraries. Implementation API ================== The zoneinfo database --------------------- The latest version of the zoneinfo database should exist in the ``Lib/tzdata`` directory of the Python source control system. This copy of the database should be updated before every Python feature and bug-fix release, but not for releases of Python versions that are in security-fix-only-mode. Scripts to update the database will be provided in ``Tools/``, and the release instructions will be updated to include this update. The new ``datetime.timezone``-module ------------------------------------ The public API of the new ``timezone``-module contains one new class, one new function and one new exception. * New class: ``DstTzInfo`` This class provides a concrete implementation of the ``zoneinfo`` base class that implements DST support. * New function :``timezone(name=None, db_path=None)`` This function takes a name string that must be a string specifying a valid zoneinfo timezone, ie "US/Eastern", "Europe/Warsaw" or "Etc/GMT+11". If not given, the local timezone will be looked up. If an invalid zone name are given, or the local timezone can not be retrieved, the function raises `UnknownTimeZoneError`. The function also takes an optional path to the location of the zoneinfo database which should be used. If not specified, the function will look for databases in the following order: 1. Use the database in ``/usr/share/zoneinfo``, if it exists. 2. Check if the `tzdata-update` module is installed, and then use that database. 3. Check the Python-provided database in ``Lib/tzdata``. If no database is found an ``UnknownTimeZoneError`` or subclass thereof will be raised with a message explaining that no zoneinfo database can be found, but that you can install one with the ``tzdata-update`` package. * New Exception: ``UnknownTimeZoneError`` This exception is a subclass of KeyError and raised when giving a time zone specification that can't be found:: >>> datetime.Timezone('Europe/New_York') Traceback (most recent call last): ... UnknownTimeZoneError: There is no time zone called 'Europe/New_York' Changes in the ``datetime``-module ---------------------------------- A new ``is_dst`` parameter is added to several of the `tzinfo` methods to handle time ambiguity during DST changeovers. * ``tzinfo.utcoffset(self, dt, is_dst=False)`` * ``tzinfo.dst(self, dt, is_dst=False)`` * ``tzinfo.tzname(self, dt, is_dst=False)`` The ``is_dst`` parameter can be ``False`` (default), ``True``, or ``None``. ``False`` will specify that the given datetime should be interpreted as not happening during daylight savings time, ie that the time specified is after the change from DST. ``True`` will specify that the given datetime should be interpreted as happening during daylight savings time, ie that the time specified is before the change from DST. ``None`` will raise an ``AmbiguousTimeError`` exception if the time specified was during a DST change over. It will also raise a ``NonExistentTimeError`` if a time is specified during the "missing time" in a change to DST. There are also three new exceptions: * ``InvalidTimeError`` This exception serves as a base for ``AmbiguousTimeError`` and ``NonExistentTimeError``, to enable you to trap these two separately. It will subclass from ValueError, so that you can catch these errors together with inputs like the 29th of February 2011. * ``AmbiguousTimeError`` This exception is raised when giving a datetime specification that are ambigious while setting ``is_dst`` to None:: >>> datetime(2012, 11, 28, 2, 0, tzinfo=timezone('Europe/Stockholm'), is_dst=None) >>> Traceback (most recent call last): ... AmbiguousTimeError: 2012-10-28 02:00:00 is ambiguous in time zone Europe/Stockholm * ``NonExistentTimeError`` This exception is raised when giving a datetime specification that are ambigious while setting ``is_dst`` to None:: >>> datetime(2012, 3, 25, 2, 0, tzinfo=timezone('Europe/Stockholm'), is_dst=None) >>> Traceback (most recent call last): ... NonExistentTimeError: 2012-03-25 02:00:00 does not exist in time zone Europe/Stockholm The ``tzdata-update``-package ----------------------------- The zoneinfo database will be packaged for easy installation with ``easy_install``/``pip``/``buildout``. This package will not install any Python code, and will not contain any Python code except that which is needed for installation. Differences from the ``pytz`` API ================================= * ``pytz`` has the functions ``localize()`` and ``normalize()`` to work around that ``tzinfo`` doesn't have is_dst. When ``is_dst`` is implemented directly in ``datetime.tzinfo`` they are no longer needed. * ``timezone()`` will return the local time zone if called without parameters. * The class ``pytz.StaticTzInfo`` is there to provide the ``is_dst`` support for static timezones. When ``is_dst`` support is included in ``datetime.tzinfo`` it is no longer needed. * ``InvalidTimeError`` subclasses from ``ValueError``. Discussion ========== Should the windows installer include the data package? ------------------------------------------------------ It has been suggested that the Windows installer should include the data package. This would mean that an explicit installation no longer would be needed on Windows. On the other hand, that would mean that many using Windows would not be aware that the database quickly becomes outdated and would not keep it updated. Resources ========= * http://pytz.sourceforge.net/ * http://pypi.python.org/pypi/tzlocal * http://pypi.python.org/pypi/python-dateutil * http://unicode.org/cldr/data/common/supplemental/windowsZones.xml Copyright ========= This document has been placed in the public domain.

13 29

is this the fault of import_fresh_module or pickle?
by Eli Bendersky Jan. 9, 2013

Jan. 9, 2013

Hello, I'm still having some struggles with the interaction between pickle and import overriding with import_fresh_module. _elementtree.TreeBuilder can't be pickled at this point. When I do this: from test.support import import_fresh_module import pickle P = import_fresh_module('xml.etree.ElementTree', blocked=['_elementtree']) tb = P.TreeBuilder() print(pickle.dumps(tb)) Everything works fine. However, if I add import_fresh_module for the C module: from test.support import import_fresh_module import pickle C = import_fresh_module('xml.etree.ElementTree', fresh=['_elementtree']) P = import_fresh_module('xml.etree.ElementTree', blocked=['_elementtree']) tb = P.TreeBuilder() print(pickle.dumps(tb)) I get an error from pickle.dumps: Traceback (most recent call last): File "mix_c_py_etree.py", line 10, in <module> print(pickle.dumps(tb)) _pickle.PicklingError: Can't pickle <class 'xml.etree.ElementTree.TreeBuilder'>: it's not the same object as xml.etree.ElementTree.TreeBuilder Note that I didn't change the executed code sequence. All I did was import the C version of ET before the Python version. I was under the impression this had to keep working since P = import_fresh_module uses blocked=['_elementtree'] properly. This interaction only seems to happen with pickle. What's going on here? Can we somehow improve import_fresh_module to avoid this? Perhaps actually deleting previously imported modules with some special keyword flag? Thanks in advance, Eli

4 6

Add "e" (close and exec) mode to open()
by Victor Stinner Jan. 8, 2013

Jan. 8, 2013

Hi, I would like add a new flag to open() mode to close the file on exec: "e". This feature exists using different APIs depending on the OS and OS version: O_CLOEXEC, FD_CLOEXEC and O_NOINHERIT. Do you consider that such flag would be interesting? On Linux (glibc), the feature is available as the "e" flag for fopen() (O_CLOEXEC or FD_CLOEXEC depending on the kernel version). With Visual Studio, it's the "N" flag (O_NOINHERIT). I would like to modify open() to be able to benefit of O_CLOEXEC atomicity. The FD_CLOEXEC method has a race condition if another thread does fork() between open() and fcntl() (two calls to fcntl() are required). I created a patch available on the following issue: http://bugs.python.org/issue16850 Drawbacks of my idea/patch: - my patch raises NotImplementedError if the platform doesn't support close-and-exec flag. I tested Linux, OpenBSD, FreeBSD, OpenIndiana (Solaris) and Mac OS X: my patch works on all these platforms (except OpenBSD 4.9 because of an OS bug fixed in OpenBSD 5.2). I don't know platform without this flag. - my patch raises an error if opener argument of open() is used: opener and the "e" mode are exclusive (see the issue for details) --- I first proposed to only expose the atomic close-and-exec option, but only a few platforms (Linux 2.6.23+, FreeBSD 8.3+, Windows, QNX) support it. It's more convinient to have the best-effort method (only atomic if available). This article of Ulrich Drepper explain which kind of problem are solved by O_CLOEXEC: http://udrepper.livejournal.com/20407.html Victor

4 12

make test
by Xu Wanglin Jan. 8, 2013

Jan. 8, 2013

When I run the test, i got these: ... ... testShareLocal (test.test_socket.TestSocketSharing) ... skipped 'Windows specific' testTypes (test.test_socket.TestSocketSharing) ... skipped 'Windows specific' ====================================================================== ERROR: test_idna (test.test_socket.GeneralModuleTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/data/users/xwl/Python-3.3.0/Lib/test/test_socket.py", line 1183, in test_idna socket.gethostbyname('испытание.python.org') socket.gaierror: [Errno -3] Temporary failure in name resolution ---------------------------------------------------------------------- Ran 483 tests in 24.816s FAILED (errors=1, skipped=29) test test_socket failed make: *** [test] Error 1 Then I run the failing test manually, as the README guided: [xwl@ordosz8003 ~/Python-3.3.0]$ ./python -m test -v test_idna == CPython 3.3.0 (default, Jan 8 2013, 11:07:49) [GCC 4.1.2 20080704 (Red Hat 4.1.2-46)] == Linux-2.6.18-164.el5-x86_64-with-redhat-5.4-Tikanga little-endian == /data/users/xwl/Python-3.3.0/build/test_python_17651 Testing with flags: sys.flags(debug=0, inspect=0, interactive=0, optimize=0, dont_write_bytecode=0, no_user_site=0, no_site=0, ignore_environment=0, verbose=0, bytes_warning=0, quiet=0, hash_randomization=1) [1/1] test_idna test test_idna crashed -- Traceback (most recent call last): File "/data/users/xwl/Python-3.3.0/Lib/test/regrtest.py", line 1213, in runtest_inner the_package = __import__(abstest, globals(), locals(), []) ImportError: No module named 'test.test_idna' 1 test failed: test_idna [xwl@ordosz8003 ~/Python-3.3.0]$ pwd /data/users/xwl/Python-3.3.0 [xwl@ordosz8003 ~/Python-3.3.0]$ Please help me to install this great software on my machine. Think you! David.Xu

3 2