Mailman 3 May 2013 - Python-Dev

Summary of Python tracker Issues
by Python tracker 10 May '13

10 May '13

ACTIVITY SUMMARY (2013-05-03 - 2013-05-10) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3963 (+10) closed 25758 (+44) total 29721 (+54) Open issues with patches: 1774 Issues opened (48) ================== #5845: rlcompleter should be enabled automatically http://bugs.python.org/issue5845 reopened by mark.dickinson #15902: imp.load_module won't accept None for the file argument for a http://bugs.python.org/issue15902 reopened by brett.cannon #17656: Python 2.7.4 breaks ZipFile extraction of zip files with unico http://bugs.python.org/issue17656 reopened by pitrou #17883: Fix buildbot testing of Tkinter http://bugs.python.org/issue17883 reopened by ezio.melotti #17895: TemporaryFile name returns an integer in python3 http://bugs.python.org/issue17895 opened by jtaylor #17896: Move Windows external libs from <src>\..\ to <src>\externals http://bugs.python.org/issue17896 opened by zach.ware #17897: Optimize unpickle prefetching http://bugs.python.org/issue17897 opened by serhiy.storchaka #17898: gettext bug while parsing plural-forms metadata http://bugs.python.org/issue17898 opened by straz #17899: os.listdir() leaks FDs if invoked on FD pointing to a non-dire http://bugs.python.org/issue17899 opened by abacabadabacaba #17900: Recursive OrderedDict pickling http://bugs.python.org/issue17900 opened by serhiy.storchaka #17901: _elementtree.TreeBuilder raises IndexError on end if construct http://bugs.python.org/issue17901 opened by Aaron.Oakley #17902: Document that _elementtree C API cannot use custom TreeBuilder http://bugs.python.org/issue17902 opened by Aaron.Oakley #17903: Python launcher for windows should search path for #!/usr/bin/ http://bugs.python.org/issue17903 opened by pmoore #17904: bytes should be listed as built-in function for 2.7 http://bugs.python.org/issue17904 opened by flox #17905: Add check for locale.h http://bugs.python.org/issue17905 opened by cavallo71 #17906: JSON should accept lone surrogates http://bugs.python.org/issue17906 opened by serhiy.storchaka #17907: Deprecate imp.new_module() in favour of types.ModuleType http://bugs.python.org/issue17907 opened by brett.cannon #17908: Unittest runner needs an option to call gc.collect() after eac http://bugs.python.org/issue17908 opened by gvanrossum #17909: Autodetecting JSON encoding http://bugs.python.org/issue17909 opened by serhiy.storchaka #17911: Extracting tracebacks does too much work http://bugs.python.org/issue17911 opened by gvanrossum #17913: stat.filemode returns "-" for sockets and unknown types http://bugs.python.org/issue17913 opened by christian.heimes #17914: add os.cpu_count() http://bugs.python.org/issue17914 opened by neologix #17915: Encoding error with sax and codecs http://bugs.python.org/issue17915 opened by sconseil #17916: Provide dis.Bytecode based equivalent of dis.distb http://bugs.python.org/issue17916 opened by ncoghlan #17917: use PyModule_AddIntMacro() instead of PyModule_AddIntConstant( http://bugs.python.org/issue17917 opened by neologix #17919: AIX POLLNVAL definition causes problems http://bugs.python.org/issue17919 opened by delhallt #17920: Documentation: "complete ordering" should be "total ordering" http://bugs.python.org/issue17920 opened by abcdef #17922: Crash in clear_weakref http://bugs.python.org/issue17922 opened by jsafrane #17923: test glob with trailing slash fail http://bugs.python.org/issue17923 opened by delhallt #17924: Deprecate stat.S_IF* integer constants http://bugs.python.org/issue17924 opened by christian.heimes #17925: asynchat.async_chat.initiate_send : del deque[0] is not safe http://bugs.python.org/issue17925 opened by Pierrick.Koch #17927: Argument copied into cell still referenced by frame http://bugs.python.org/issue17927 opened by gvanrossum #17930: Search not needed in combinations_with_replacement http://bugs.python.org/issue17930 opened by tim_one #17931: PyLong_FromPid() is not correctly defined on Windows 64-bit http://bugs.python.org/issue17931 opened by haypo #17932: Win64: possible integer overflow in iterobject.c http://bugs.python.org/issue17932 opened by haypo #17933: test_ftp failure / ftplib error formatting issue http://bugs.python.org/issue17933 opened by pitrou #17934: Add a frame method to clear expensive details http://bugs.python.org/issue17934 opened by pitrou #17936: O(n**2) behaviour when adding/removing classes http://bugs.python.org/issue17936 opened by kristjan.jonsson #17937: Collect garbage harder at shutdown http://bugs.python.org/issue17937 opened by pitrou #17939: Misleading information about slice assignment in docs http://bugs.python.org/issue17939 opened by stefanchrobot #17940: extra code in argparse.py http://bugs.python.org/issue17940 opened by aho #17941: namedtuple should support fully qualified name for more portab http://bugs.python.org/issue17941 opened by eli.bendersky #17942: IDLE Debugger: names, values misaligned http://bugs.python.org/issue17942 opened by terry.reedy #17943: AttributeError: 'long' object has no attribute 'release' in Qu http://bugs.python.org/issue17943 opened by georg.brandl #17944: Refactor test_zipfile http://bugs.python.org/issue17944 opened by serhiy.storchaka #17945: tkinter/Python 3.3.0: peer_create doesn't instantiate Text http://bugs.python.org/issue17945 opened by ghoul #17947: Code, test, and doc review for PEP-0435 Enum http://bugs.python.org/issue17947 opened by ethan.furman #17948: HTTPS and sending a big file size hangs. http://bugs.python.org/issue17948 opened by jesusvpct Most recent 15 issues with no replies (15) ========================================== #17944: Refactor test_zipfile http://bugs.python.org/issue17944 #17942: IDLE Debugger: names, values misaligned http://bugs.python.org/issue17942 #17940: extra code in argparse.py http://bugs.python.org/issue17940 #17939: Misleading information about slice assignment in docs http://bugs.python.org/issue17939 #17937: Collect garbage harder at shutdown http://bugs.python.org/issue17937 #17934: Add a frame method to clear expensive details http://bugs.python.org/issue17934 #17933: test_ftp failure / ftplib error formatting issue http://bugs.python.org/issue17933 #17931: PyLong_FromPid() is not correctly defined on Windows 64-bit http://bugs.python.org/issue17931 #17924: Deprecate stat.S_IF* integer constants http://bugs.python.org/issue17924 #17923: test glob with trailing slash fail http://bugs.python.org/issue17923 #17916: Provide dis.Bytecode based equivalent of dis.distb http://bugs.python.org/issue17916 #17909: Autodetecting JSON encoding http://bugs.python.org/issue17909 #17905: Add check for locale.h http://bugs.python.org/issue17905 #17904: bytes should be listed as built-in function for 2.7 http://bugs.python.org/issue17904 #17902: Document that _elementtree C API cannot use custom TreeBuilder http://bugs.python.org/issue17902 Most recent 15 issues waiting for review (15) ============================================= #17947: Code, test, and doc review for PEP-0435 Enum http://bugs.python.org/issue17947 #17944: Refactor test_zipfile http://bugs.python.org/issue17944 #17937: Collect garbage harder at shutdown http://bugs.python.org/issue17937 #17936: O(n**2) behaviour when adding/removing classes http://bugs.python.org/issue17936 #17932: Win64: possible integer overflow in iterobject.c http://bugs.python.org/issue17932 #17931: PyLong_FromPid() is not correctly defined on Windows 64-bit http://bugs.python.org/issue17931 #17927: Argument copied into cell still referenced by frame http://bugs.python.org/issue17927 #17925: asynchat.async_chat.initiate_send : del deque[0] is not safe http://bugs.python.org/issue17925 #17923: test glob with trailing slash fail http://bugs.python.org/issue17923 #17919: AIX POLLNVAL definition causes problems http://bugs.python.org/issue17919 #17917: use PyModule_AddIntMacro() instead of PyModule_AddIntConstant( http://bugs.python.org/issue17917 #17915: Encoding error with sax and codecs http://bugs.python.org/issue17915 #17913: stat.filemode returns "-" for sockets and unknown types http://bugs.python.org/issue17913 #17909: Autodetecting JSON encoding http://bugs.python.org/issue17909 #17906: JSON should accept lone surrogates http://bugs.python.org/issue17906 Top 10 most discussed issues (10) ================================= #5845: rlcompleter should be enabled automatically http://bugs.python.org/issue5845 24 msgs #17922: Crash in clear_weakref http://bugs.python.org/issue17922 16 msgs #17927: Argument copied into cell still referenced by frame http://bugs.python.org/issue17927 15 msgs #11406: There is no os.listdir() equivalent returning generator instea http://bugs.python.org/issue11406 14 msgs #17883: Fix buildbot testing of Tkinter http://bugs.python.org/issue17883 14 msgs #17914: add os.cpu_count() http://bugs.python.org/issue17914 13 msgs #1545463: New-style classes fail to cleanup attributes http://bugs.python.org/issue1545463 12 msgs #11016: stat module in C http://bugs.python.org/issue11016 10 msgs #17810: Implement PEP 3154 (pickle protocol 4) http://bugs.python.org/issue17810 9 msgs #17868: pprint long non-printable bytes as hexdump http://bugs.python.org/issue17868 8 msgs Issues closed (44) ================== #2262: Helping the compiler avoid memory references in PyEval_EvalFra http://bugs.python.org/issue2262 closed by pitrou #6178: Core error in Py_EvalFrameEx 2.6.2 http://bugs.python.org/issue6178 closed by pitrou #7330: PyUnicode_FromFormat: implement width and precision for %s, %S http://bugs.python.org/issue7330 closed by haypo #7855: Add test cases for ctypes/winreg for issues found in IronPytho http://bugs.python.org/issue7855 closed by ezio.melotti #9687: dbmmodule.c:dbm_contains fails on 64bit big-endian (test_dbm.p http://bugs.python.org/issue9687 closed by pitrou #10363: Embedded python, handle (memory) leak http://bugs.python.org/issue10363 closed by pitrou #11816: Refactor the dis module to provide better building blocks for http://bugs.python.org/issue11816 closed by ncoghlan #12181: SIGBUS error on OpenBSD (sparc64) http://bugs.python.org/issue12181 closed by neologix #13495: IDLE: Regressions - Two ColorDelegator instances loaded http://bugs.python.org/issue13495 closed by roger.serwy #13831: get method of multiprocessing.pool.Async should return full t http://bugs.python.org/issue13831 closed by sbt #14173: PyOS_FiniInterupts leaves signal.getsignal segfaulty http://bugs.python.org/issue14173 closed by pitrou #14187: add "function annotation" entry to Glossary http://bugs.python.org/issue14187 closed by r.david.murray #14878: Improve documentation for generator.send method http://bugs.python.org/issue14878 closed by akuchling #15528: Better support for finalization with weakrefs http://bugs.python.org/issue15528 closed by sbt #15834: 2to3 benchmark not working under Python 3 http://bugs.python.org/issue15834 closed by brett.cannon #16445: SEGFAULT when deleting Exception.message http://bugs.python.org/issue16445 closed by pitrou #16523: attrgetter and itemgetter signatures in docs need cleanup http://bugs.python.org/issue16523 closed by ezio.melotti #16584: unhandled IOError filecmp.cmpfiles() if file not readable http://bugs.python.org/issue16584 closed by terry.reedy #16601: Restarting iteration over tarfile continues from where it left http://bugs.python.org/issue16601 closed by serhiy.storchaka #16631: tarfile.extractall() doesn't extract everything if .next() was http://bugs.python.org/issue16631 closed by serhiy.storchaka #17094: sys._current_frames() reports too many/wrong stack frames http://bugs.python.org/issue17094 closed by pitrou #17115: __loader__ = None should be fine http://bugs.python.org/issue17115 closed by brett.cannon #17116: xml.parsers.expat.(errors|model) don't set the __loader__ attr http://bugs.python.org/issue17116 closed by brett.cannon #17289: readline.set_completer_delims() doesn't play well with others http://bugs.python.org/issue17289 closed by pitrou #17408: second python execution fails when embedding http://bugs.python.org/issue17408 closed by pitrou #17714: str.encode('base64') add trailing new line character. It is no http://bugs.python.org/issue17714 closed by ezio.melotti #17798: IDLE: can not edit new file names when using -e http://bugs.python.org/issue17798 closed by roger.serwy #17805: No such class: multiprocessing.pool.AsyncResult http://bugs.python.org/issue17805 closed by sbt #17807: Generator cleanup without tp_del http://bugs.python.org/issue17807 closed by pitrou #17809: FAIL: test_expanduser when $HOME ends with / http://bugs.python.org/issue17809 closed by ezio.melotti #17833: test_gdb broken PPC64 Linux http://bugs.python.org/issue17833 closed by dmalcolm #17841: Remove missing aliases from codecs documentation http://bugs.python.org/issue17841 closed by ezio.melotti #17871: Wrong signature of TextTestRunner's init function http://bugs.python.org/issue17871 closed by ezio.melotti #17877: Skip test_variable_tzname when the zoneinfo database is missin http://bugs.python.org/issue17877 closed by ezio.melotti #17910: Usage error in multiprocessing documentation http://bugs.python.org/issue17910 closed by amysyk #17912: thread states should use a doubly-linked list http://bugs.python.org/issue17912 closed by neologix #17918: failed incoming SSL connection stays open forever http://bugs.python.org/issue17918 closed by pitrou #17921: explicit empty check instead of implicit booleaness http://bugs.python.org/issue17921 closed by r.david.murray #17926: PowerLinux dbm failure in 2.7 http://bugs.python.org/issue17926 closed by pitrou #17928: PowerLinux getargs.c FETCH_SIZE endianness bug http://bugs.python.org/issue17928 closed by pitrou #17929: TypeError using tarfile.addfile() with io.StringIO replacing S http://bugs.python.org/issue17929 closed by r.david.murray #17935: Failed compile on XP buildbot http://bugs.python.org/issue17935 closed by pitrou #17938: Duplicate text in docs/reference/import statement http://bugs.python.org/issue17938 closed by ezio.melotti #17946: base64 encoding result should be str, not bytes http://bugs.python.org/issue17946 closed by r.david.murray

1 0

PEP 4XX: pyzaa "Improving Python ZIP Application Support"
by Daniel Holth 10 May '13

10 May '13

https://docs.google.com/document/d/1MKXgPzhWD5wIUpoSQX7dxmqgTZVO6l9iZZis8dn… PEP: 4XX Title: Improving Python ZIP Application Support Author: Daniel Holth <dholth(a)gmail.com> Status: Draft Type: Standards Track Python-Version: 3.4 Created: 30 March 2013 Post-History: 30 March 2013, 1 April 2013 Improving Python ZIP Application Support Python has had the ability to execute directories or ZIP-format archives as scripts since version 2.6. When invoked with a zip file or directory as its first argument the interpreter adds that directory to sys.path and executes the __main__ module. These archives provide a great way to publish software that needs to be distributed as a single file script but is complex enough to need to be written as a collection of modules. This feature is not as popular as it should be, mainly because no one’s heard of it because it wasn’t promoted as part of Python 2.6, but also because Windows users don’t have a file extension (other than .py) to associate with the launcher. This PEP proposes to fix these problems by re-publicising the feature, defining the .pyz and .pyzw extensions as “Python ZIP Applications” and “Windowed Python ZIP Applications”, and providing some simple tooling to manage the format. A New Python ZIP Application Extension The Python 3.4 installer will associate .pyz and .pyzw “Python ZIP Applications” with the platform launcher so they can be executed. A .pyz archive is a console application and a .pyzw archive is a windowed application, indicating whether the console should appear when running the app. Why not use .zip or .py? Users expect a .zip file would be opened with an archive tool, and users expect .py to be opened with a text editor. Both would be confusing for this use case. For UNIX users, .pyz applications should be prefixed with a #! line pointing to the correct Python interpreter and an optional explanation. #!/usr/bin/env python3 # This is a Python application stored in a ZIP archive. (binary contents of archive) As background, ZIP archives are defined with a footer containing relative offsets from the end of the file. They remain valid when concatenated to the end of any other file. This feature is completely standard and is how self-extracting ZIP archives and the bdist_wininst installer format work. Minimal Tooling: The pyzaa Module This PEP also proposes including a simple application for working with these archives: The Python Zip Application Archiver “pyzaa” (rhymes with “huzzah” or “pizza”). “pyzaa” can archive or extract these files, compile bytecode, and can write the __main__ module if it is not present. Usage python -m pyzaa (pack | compile) python -m pyzaa pack [-o path/name] [-m module.submodule:callable] [-c] [-w] [-p interpreter] directory: ZIP the contents of directory as directory.pyz or [-w] directory.pyzw. Adds the executable flag to the archive. -c compile .pyc files and add them to the archive -p interpreter include #!interpreter as the first line of the archive -o path/name archive is written to path/name.pyz[w] instead of dirname. The extension is added if not specified. -m module.submodule:callable __main__.py is written as “import module.submodule; module.submodule.callable()” pyzaa pack will warn if the directory contains C extensions or if it doesn’t contain __main__.py. python -m pyzaa compile arcname.pyz[w] The Python files in arcname.pyz[w] are compiled and appended to the ZIP file. A standard ZIP utility or Python’s zipfile module can unpack the archives. FAQ Q. Isn’t pyzaa just a very thin wrapper over zipfile and compileall? A. Yes. Q. How does this compete with existing sdist/bdist formats? A. There is some overlap, but .pyz files are especially interesting as a way to distribute an installer. They may also prove useful as a way to deliver applications when users shouldn’t be asked to perform virtualenv + “pip install”. References [1] http://bugs.python.org/issue1739468 “Allow interpreter to execute a zip file” [2] http://bugs.python.org/issue17359 “Feature is not documented” Copyright This document has been placed into the public domain.

11 20

PEP 435 (Enums) is Accepted
by Guido van Rossum 10 May '13

10 May '13

I have reviewed the latest version of PEP 435 and I see that it is very good. I hereby declare PEP 435 as Accepted. Congratulations go to Barry, Eli and Ethan for pulling it through one of the most thorough reviewing and bikeshedding processes any PEP has seen. Thanks to everyone else for the many review comments. It is a better PEP because of the reviews. Barry or Eli, you can update the PEP's status. (I also expect there will be some copy-editing still.) Ethan: the stdlib implementation should probably be assigned a bug tracker issue (if there isn't one already) and start code review now. -- --Guido van Rossum (python.org/~guido)

4 3

Help requested for issue 9285 (profile.py)
by Giampaolo Rodola' 10 May '13

10 May '13

http://bugs.python.org/issue9285#msg182986 I'm stuck as I really have no clue what that error means. Any help from someone experienced with profile.py code is welcome. --- Giampaolo https://code.google.com/p/pyftpdlib/ https://code.google.com/p/psutil/ https://code.google.com/p/pysendfile/

1 0

I want contribute to the project
by Diego Tolentino 09 May '13

09 May '13

Hi guys, I have 3 computer and want to contribute to the project, Windows 7, Interl I5 64bits Ubuntu 13.04, Interl I5 32bits Ubuntu 13.04, Interl I5 64bits How i can proceed? I'm nice in this world of free software and python best regards Diego Tolentino SENIOR DEVELOPER Skype: diegotolentino “Do not go where the path may lead, go instead where there is no path and leave a trail.” - Ralph Waldo Emerson

2 1

PEP 435: pickling enums created with the functional API
by Eli Bendersky 09 May '13

09 May '13

One of the contended issues with PEP 435 on which Guido pronounced was the functional API, that allows created enumerations dynamically in a manner similar to namedtuple: Color = Enum('Color', 'red blue green') The biggest complaint reported against this API is interaction with pickle. As promised, I want to discuss here how we're going to address this concern. At this point, the pickle docs say that module-top-level classes can be pickled. This obviously works for the normal Enum classes, but is a problem with the functional API because the class is created dynamically and has no __module__. To solve this, the reference implementation is used the same approach as namedtuple (*). In the metaclass's __new__ (this is an excerpt, the real code has some safeguards): module_name = sys._getframe(1).f_globals['__name__'] enum_class.__module__ = module_name According to an earlier discussion, this is works on CPython, PyPy and Jython, but not on IronPython. The alternative that works everywhere is to define the Enum like this: Color = Enum('the_module.Color', 'red blue green') The reference implementation supports this as well. Some points for discussion: 1) We can say that using the functional API when pickling can happen is not recommended, but maybe a better way would be to just explain the way things are and let users decide? 2) namedtuple should also support the fully qualified name syntax. If this is agreed upon, I can create an issue. 3) Antoine mentioned that work is being done in 3.4 to enable pickling of nested classes (http://www.python.org/dev/peps/pep-3154/). If that gets implemented, I don't see a reason why Enum and namedtuple can't be adjusted to find the __qualname__ of the class they're internal to. Am I missing something? 4) Using _getframe(N) here seems like an overkill to me. What we really need is just the module in which the current execution currently is (i.e. the metaclass's __new__ in our case). Would it make sense to add a new function somewhere in the stdlib of 3.4 (in sys or inspect or ...) that just provides the current module name? It seems that all Pythons should be able to easily provide it, it's certainly a very small subset of the functionality provided by walking the callframe stack. This function can then be used for build fully qualified names for pickling of Enum and namedtuple. Moreover, it can be general even more widely - dynamic class building is quite common in Python code, and as Nick mentioned somewhere earlier, the extra power of metaclasses in the recent 3.x's will probably make it even more common. Eli (*) namedtuple uses an explicit function to build the resulting class, not a metaclass (ther's no class syntax for namedtuple).

11 24

Any script to create the installation pacakge of Python 3.3.1 on Windows and *NIX?
by Jianfeng Mao 09 May '13

09 May '13

To Python-Dev committers: I am working on a project to embed a slightly customized Python interpreter in our own software. For easy installation and setup, we want to be able to do the standard Python installation as part of the installation of our product. So far I have successfully customized and built Python 3.3.1 (including the subprojects) on Windows but I can't find anything in the source distribution to allow me package the binaries/modules etc into a MSI just like the one on the download page on python.org. So I am asking for information regarding how to package Python build for installation on both Windows and *NIX platforms. Your help will be greatly appreciated. Thanks, Jianfeng

2 1

Call for testing: generator finalization
by Antoine Pitrou 08 May '13

08 May '13

Hello, In http://bugs.python.org/issue17807 I've committed a patch to allow generator finalization (execution of "finally" blocks) even when a generator is part of a reference cycle. If you have some workload which is known for problems with generator finalization (or otherwise makes a heavy use of generators), it would nice to have some feedback on this change. (the commit is only on the default branch) Regards Antoine.

1 0

Re: [Python-Dev] this python string literals documentation couldn't explain me: single quote presence inside double quoted string and viceversa. Can Anyone explain me?
by Alok Nayak 08 May '13

08 May '13

I asked this question here, http://stackoverflow.com/questions/16435233/this-python-string-literals-doc…, . I was advised to ask here On Wed, May 8, 2013 at 4:56 PM, Alok Nayak <aloknayak29(a)gmail.com> wrote: > > This python string literals documentation<http://docs.python.org/2/reference/lexical_analysis.html#string-literals>couldn't explain: single quote presence inside double quoted string and > viceversa. > > I think both double quoted string and single quoted string need to be > defined differently for representing the 'stringliteral' lexical definition. > > shortstringchar ::= <any source character except "\" or newline or the quote> > > here in this definition 'the quote' isn't specific whether single (') or > double ("). > > > -- > Alok Nayak > Gwalior, India > -- Alok Nayak Gwalior, India

2 2

this python string literals documentation couldn't explain me: single quote presence inside double quoted string and viceversa. Can Anyone explain me?
by Alok Nayak 08 May '13

08 May '13

This python string literals documentation<http://docs.python.org/2/reference/lexical_analysis.html#string-literals>couldn't explain: single quote presence inside double quoted string and viceversa. I think both double quoted string and single quoted string need to be defined differently for representing the 'stringliteral' lexical definition. shortstringchar ::= <any source character except "\" or newline or the quote> here in this definition 'the quote' isn't specific whether single (') or double ("). I asked this question here, http://stackoverflow.com/questions/16435233/this-python-string-literals-doc…, . I was advised to ask here -- Alok Nayak Gwalior, India -- Alok Nayak Gwalior, India

1 0