Mailman 3 November 2011 - Python-Dev

Chose a name for a "get unicode as wide character, borrowed reference" function
by Victor Stinner 21 Nov '11

21 Nov '11

Hi, With the PEP 393, the Py_UNICODE is now deprecated and scheduled for removal in Python 4. PyUnicode_AsUnicode() and PyUnicode_AsUnicodeAndSize() functions are still commonly used on Windows to get the string as wchar_t* without having to care of freeing the memory: it's a borrowed reference (pointer). I would like to add a new PyUnicode_AsWideChar() function which would return the borrowed reference, exactly as PyUnicode_AsUnicode(). The problem is that "PyUnicode_AsWideChar" already exists in Python 3.2, as PyUnicode_AsWideCharString. Do you have an suggestion for a name of such function? PyUnicode_AsWideCharBorrowed? PyUnicode_AsFastWideChar? PyUnicode_ToWideChar? PyUnicode_AsWchar_t? Victor

2 5

patch metadata - to use or not to use?
by Stefan Behnel 21 Nov '11

21 Nov '11

Hi, I recently got some patches accepted for inclusion in 3.3, and each time, the patch metadata (such as my name and my commit comment) were stripped by applying the patch manually, instead of hg importing it. This makes it clear in the history who eventually reviewed and applied the patch, but less visible who wrote it (except for the entry in Misc/NEWS). I didn't see this mentioned in the dev-guide. Is it being considered the Right Way To Do It? Stefan

8 8

Summary of Python tracker Issues
by Python tracker 18 Nov '11

18 Nov '11

ACTIVITY SUMMARY (2011-11-11 - 2011-11-18) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3115 ( +5) closed 22097 (+41) total 25212 (+46) Open issues with patches: 1330 Issues opened (32) ================== #12246: Support installation when running from an uninstalled Python http://bugs.python.org/issue12246 reopened by eric.araujo #13193: test_packaging and test_distutils failures http://bugs.python.org/issue13193 reopened by eric.araujo #13384: Unnecessary __future__ import in random module http://bugs.python.org/issue13384 reopened by rhettinger #13386: Document documentation conventions for optional args http://bugs.python.org/issue13386 opened by ezio.melotti #13390: Hunt memory allocations in addition to reference leaks http://bugs.python.org/issue13390 opened by pitrou #13393: Improve BufferedReader.read1() http://bugs.python.org/issue13393 opened by pitrou #13394: Patch to increase aifc lib test coverage with couple of minor http://bugs.python.org/issue13394 opened by Oleg.Plakhotnyuk #13396: new method random.getrandbytes() http://bugs.python.org/issue13396 opened by amaury.forgeotdarc #13397: Option for XMLRPC clients to automatically transform Fault exc http://bugs.python.org/issue13397 opened by rhettinger #13398: _cursesmodule does not build, doesn't find Python.h on Solaris http://bugs.python.org/issue13398 opened by automatthias #13399: Don't print traceback for unrecognized actions, commands and o http://bugs.python.org/issue13399 opened by Arfrever #13400: packaging: build command should accept --compile, --no-compile http://bugs.python.org/issue13400 opened by Arfrever #13401: test_argparse fails with root permissions http://bugs.python.org/issue13401 opened by Arfrever #13402: Document absoluteness of sys.executable http://bugs.python.org/issue13402 opened by eric.araujo #13403: Option for XMLPRC Server to support HTTPS http://bugs.python.org/issue13403 opened by rhettinger #13404: Add support for system.methodSignature() to XMLRPC Server http://bugs.python.org/issue13404 opened by rhettinger #13405: Add DTrace probes http://bugs.python.org/issue13405 opened by jcea #13407: tarfile.getnames misses members again http://bugs.python.org/issue13407 opened by sengels #13408: Rename packaging.resources back to datafiles http://bugs.python.org/issue13408 opened by eric.araujo #13410: String formatting bug in interactive mode http://bugs.python.org/issue13410 opened by jayanth #13411: Hashable memoryviews http://bugs.python.org/issue13411 opened by pitrou #13412: Symbolic links omitted by os.listdir on some systems http://bugs.python.org/issue13412 opened by alexreg #13413: time.daylight incorrect behavior in linux glibc http://bugs.python.org/issue13413 opened by dimonb #13414: test_strftime failed on OpenBSD http://bugs.python.org/issue13414 opened by rpointel #13415: del os.environ[key] ignores errors http://bugs.python.org/issue13415 opened by haypo #13417: faster utf-8 decoding http://bugs.python.org/issue13417 opened by pitrou #13418: Embedded Python memory leak http://bugs.python.org/issue13418 opened by Asesh #13420: newer() function in dep_util.py discard changes in the same se http://bugs.python.org/issue13420 opened by d.amian #13421: PyCFunction_* are not documented anywhere http://bugs.python.org/issue13421 opened by jcea #13424: Add examples for open’s new opener argument http://bugs.python.org/issue13424 opened by eric.araujo #13425: http.client.HTTPMessage.getallmatchingheaders() always returns http://bugs.python.org/issue13425 opened by stachjankowski #13429: provide __file__ to extension init function http://bugs.python.org/issue13429 opened by scoder Most recent 15 issues with no replies (15) ========================================== #13421: PyCFunction_* are not documented anywhere http://bugs.python.org/issue13421 #13417: faster utf-8 decoding http://bugs.python.org/issue13417 #13413: time.daylight incorrect behavior in linux glibc http://bugs.python.org/issue13413 #13408: Rename packaging.resources back to datafiles http://bugs.python.org/issue13408 #13403: Option for XMLPRC Server to support HTTPS http://bugs.python.org/issue13403 #13402: Document absoluteness of sys.executable http://bugs.python.org/issue13402 #13401: test_argparse fails with root permissions http://bugs.python.org/issue13401 #13400: packaging: build command should accept --compile, --no-compile http://bugs.python.org/issue13400 #13397: Option for XMLRPC clients to automatically transform Fault exc http://bugs.python.org/issue13397 #13372: handle_close called twice in poll2 http://bugs.python.org/issue13372 #13369: timeout with exit code 0 while re-running failed tests http://bugs.python.org/issue13369 #13354: tcpserver should document non-threaded long-living connections http://bugs.python.org/issue13354 #13330: Attempt full test coverage of LocaleTextCalendar.formatweekday http://bugs.python.org/issue13330 #13325: no address in the representation of asyncore dispatcher after http://bugs.python.org/issue13325 #13277: tzinfo subclasses information http://bugs.python.org/issue13277 Most recent 15 issues waiting for review (15) ============================================= #13429: provide __file__ to extension init function http://bugs.python.org/issue13429 #13420: newer() function in dep_util.py discard changes in the same se http://bugs.python.org/issue13420 #13417: faster utf-8 decoding http://bugs.python.org/issue13417 #13415: del os.environ[key] ignores errors http://bugs.python.org/issue13415 #13411: Hashable memoryviews http://bugs.python.org/issue13411 #13410: String formatting bug in interactive mode http://bugs.python.org/issue13410 #13405: Add DTrace probes http://bugs.python.org/issue13405 #13401: test_argparse fails with root permissions http://bugs.python.org/issue13401 #13396: new method random.getrandbytes() http://bugs.python.org/issue13396 #13394: Patch to increase aifc lib test coverage with couple of minor http://bugs.python.org/issue13394 #13393: Improve BufferedReader.read1() http://bugs.python.org/issue13393 #13390: Hunt memory allocations in addition to reference leaks http://bugs.python.org/issue13390 #13380: ctypes: add an internal function for reseting the ctypes cache http://bugs.python.org/issue13380 #13378: Change the variable "nsmap" from global to instance (xml.etree http://bugs.python.org/issue13378 #13372: handle_close called twice in poll2 http://bugs.python.org/issue13372 Top 10 most discussed issues (10) ================================= #13386: Document documentation conventions for optional args http://bugs.python.org/issue13386 23 msgs #13412: Symbolic links omitted by os.listdir on some systems http://bugs.python.org/issue13412 13 msgs #13410: String formatting bug in interactive mode http://bugs.python.org/issue13410 10 msgs #13349: Uninformal error message in index() and remove() functions http://bugs.python.org/issue13349 8 msgs #6727: ImportError when package is symlinked on Windows http://bugs.python.org/issue6727 7 msgs #11836: multiprocessing.queues.SimpleQueue is undocumented http://bugs.python.org/issue11836 7 msgs #13294: http.server: HEAD request should not return a body http://bugs.python.org/issue13294 7 msgs #13396: new method random.getrandbytes() http://bugs.python.org/issue13396 7 msgs #13398: _cursesmodule does not build, doesn't find Python.h on Solaris http://bugs.python.org/issue13398 7 msgs #13405: Add DTrace probes http://bugs.python.org/issue13405 7 msgs Issues closed (41) ================== #4111: Add Systemtap/DTrace probes http://bugs.python.org/issue4111 closed by jcea #6397: Implementing Solaris "/dev/poll" in the "select" module http://bugs.python.org/issue6397 closed by jcea #7732: imp.find_module crashes Python if there exists a directory nam http://bugs.python.org/issue7732 closed by haypo #7750: IOError when launching script under pdb with backslash in scri http://bugs.python.org/issue7750 closed by jason.coombs #8793: IDLE crashes on opening invalid file http://bugs.python.org/issue8793 closed by ned.deily #11112: UDPTimeoutTest derives from SocketTCPTest http://bugs.python.org/issue11112 closed by ezio.melotti #12629: HTMLParser silently stops parsing with malformed attributes http://bugs.python.org/issue12629 closed by ezio.melotti #12729: Python lib re cannot handle Unicode properly due to narrow/wid http://bugs.python.org/issue12729 closed by pitrou #12767: document threading.Condition.notify http://bugs.python.org/issue12767 closed by python-dev #12875: backport re.compile flags default value documentation http://bugs.python.org/issue12875 closed by eli.bendersky #13064: Port codecs and error handlers to the new Unicode API http://bugs.python.org/issue13064 closed by haypo #13170: distutils2 test failures http://bugs.python.org/issue13170 closed by eric.araujo #13217: Missing header dependencies in Makefile http://bugs.python.org/issue13217 closed by pitrou #13239: Remove <> operator from Grammar/Grammar http://bugs.python.org/issue13239 closed by python-dev #13264: Monkeypatching using metaclass http://bugs.python.org/issue13264 closed by eric.araujo #13297: xmlrpc.client could accept bytes for input and output http://bugs.python.org/issue13297 closed by python-dev #13309: test_time fails: time data 'LMT' does not match format '%Z' http://bugs.python.org/issue13309 closed by flox #13333: utf-7 inconsistent with surrogates http://bugs.python.org/issue13333 closed by pitrou #13346: re.split() should behave like string.split() for maxsplit=0 an http://bugs.python.org/issue13346 closed by terry.reedy #13357: HTMLParser parses attributes incorrectly. http://bugs.python.org/issue13357 closed by ezio.melotti #13358: HTMLParser incorrectly handles cdata elements. http://bugs.python.org/issue13358 closed by ezio.melotti #13374: Deprecate usage of the Windows ANSI API in the nt module http://bugs.python.org/issue13374 closed by haypo #13385: Add an explicit re.NOFLAGS flag value to the re module http://bugs.python.org/issue13385 closed by eli.bendersky #13387: suggest assertIs(type(obj), cls) for exact type checking http://bugs.python.org/issue13387 closed by ezio.melotti #13388: document hg commit hooks in the devguide http://bugs.python.org/issue13388 closed by python-dev #13389: Clear lists and dicts freelist in gc.collect() http://bugs.python.org/issue13389 closed by pitrou #13391: string.strip Does Not Remove Zero-Width-Space (ZWSP) http://bugs.python.org/issue13391 closed by ezio.melotti #13395: Python ISO-8859-1 encoding problem http://bugs.python.org/issue13395 closed by ezio.melotti #13406: Deprecation warnings when running the test suite http://bugs.python.org/issue13406 closed by ezio.melotti #13409: Invalid expression error if a regex ends with a backslash http://bugs.python.org/issue13409 closed by ezio.melotti #13416: Python Tutorial, Section 3, Minor PEP 8 adjustment http://bugs.python.org/issue13416 closed by benjamin.peterson #13419: import does not recognise SYMLINKDs on Windows 7 http://bugs.python.org/issue13419 closed by brian.curtin #13422: Subprocess: children hang due to open pipes http://bugs.python.org/issue13422 closed by gregory.p.smith #13423: Ranges cannot be meaningfully compared for equality or hashed http://bugs.python.org/issue13423 closed by flox #13426: Typos in pickle docs http://bugs.python.org/issue13426 closed by ezio.melotti #13427: string comparison with == http://bugs.python.org/issue13427 closed by flox #13428: PyUnicode_FromFormatV: support width and precision for string http://bugs.python.org/issue13428 closed by haypo #13430: Add a curry function to the functools module http://bugs.python.org/issue13430 closed by alex #1745761: Bad attributes/data handling in SGMLib http://bugs.python.org/issue1745761 closed by ezio.melotti #13392: Writing a pyc file is not atomic under Windows http://bugs.python.org/issue13392 closed by pitrou #755670: improve HTMLParser attribute processing regexps http://bugs.python.org/issue755670 closed by ezio.melotti

1 0

_PyImport_FindExtensionObject() does not set _Py_PackageContext
by Stefan Behnel 18 Nov '11

18 Nov '11

Hi, I noticed that _PyImport_FindExtensionObject() in Python/import.c does not set _Py_PackageContext when it calls the module init function for module reinitialisation. However, PyModule_Create2() still uses that variable to figure out the fully qualified module name. Was this intentionally left out or is it just an oversight? Stefan

1 1

how to find the file path to an extension module at init time?
by Stefan Behnel 18 Nov '11

18 Nov '11

Hi, in Python modules, the "__file__" attribute is provided by the runtime before executing the module body. For extension modules, it is set only after executing the init function. I wonder if there's any way to figure out where an extension module is currently being loaded from. The _PyImport_LoadDynamicModule() function obviously knows it, but it does not pass that information on into the module init function. I'm asking specifically because I'd like to properly implement __file__ in Cython modules at module init time. There are cases where it could be faked (when compiling modules on the fly during import), but in general, it's not known at compile time where a module will get installed and run from, so I currently don't see how to do it without dedicated runtime support. That's rather unfortunate, because it's not so uncommon for packages to look up bundled data files relative to their own position using __file__, and that is pretty much always done in module level code. Another problem is that package local imports from __init__.py no longer work when it's compiled, likely because __path__ is missing on the new born module object in sys.modules. Here, it would also help if the path to the module (and to its package) was known early enough. Any ideas how this could currently be achieved? Or could this become a new feature in the future? Stefan

4 8

blog.python.org - help wanted - topics, authors, etc.
by Brian Curtin 17 Nov '11

17 Nov '11

As Jesus mentioned earlier today, it has been a while since http://blog.python.org/ was been updated, and even before that it wasn't updated all that often. I'd like to try and get others involved so we can get a more steady flow going and highlight more of the work everyone is doing. The blog aims to keep people up-to-date on what's going on in the development of Python without having to follow every word of this mailing list, the bug tracker, IRC, etc. There are a number of topics that I think would be great for the blog, including but not limited to: * Surveys - Raymond likes to poll people on twitter and has done a bunch of surveys over IRC, usually relating to ideas on APIs. I'd love to put some of these up on the blog and cast a wider net. * New features - Introducing a new module, such as Victor's faulthandler, makes for a great post. As we get closer to 3.3, everyone will be stuffing the commit stream with new features and introducing interesting ones on here would be great. * PEPs - As we all know, PEP discussions can sometimes result in weeks long debates with hundreds of 500 word responses. Summarizing a discussion down to a blog post would probably be helpful for a lot of people. I know I can't follow all of these PEPs all the time, but I'd like to know what's going on. * Problems you're solving - Antoine did a nice post about his changes to remove polling from a number of areas in the code and why he did them. More explanations like this would be great. We run the blog out of a Mercurial repository on BitBucket and do the writing in reStructuredText, then publish via Blogger. There's also a great team of volunteer translators that can get your post out there in 10 languages (see the blog sidebar for the full list). We can also accept guest posts with zero process: you just write and we'll handle the back-end stuff and get your work published. I don't want to make people go through all kinds of hoops if they just want to make a one-time post about something they want to share. If you have any topics - specific or general - that you'd like to see covered, respond here and we'll add them on the tracker. If you're interested in writing, contact me and I'll get you up and running.

4 4

Is Python insider blog dead?
by Jesús Cea 16 Nov '11

16 Nov '11

Python insider blog was a great idea, trying to open and expose python-dev to the world. A great and necessary idea. But the last post was in August. I wonder if the project is dead... Would be sad :-( http://blog.python.org/ Enviado desde mi iPhone

6 5

Re: [Python-Dev] [Python-checkins] cpython: Issue #6397: Support '/dev/poll' polling objects in select module, under
by Éric Araujo 15 Nov '11

15 Nov '11

Hi, > http://hg.python.org/cpython/rev/8f7ab4bf7ad9 > user: Jesus Cea <jcea(a)jcea.es> > date: Mon Nov 14 19:07:41 2011 +0100 > summary: > Issue #6397: Support '/dev/poll' polling objects in select module, under Solaris & derivatives. > +.. _devpoll-objects: > + > +``/dev/poll`` Polling Objects > +---------------------------------------------- > + > + http://developers.sun.com/solaris/articles/using_devpoll.html > + http://developers.sun.com/solaris/articles/polling_efficient.html > + This markup creates a blockquote with the two links displayed in a line. You probably meant to use a comment (start the block with “.. ”) or, if the links are generally useful, move them to a seealso block later in the file. Regards

1 0

PEP 376 - contents of RECORD file
by Paul Moore 15 Nov '11

15 Nov '11

Looking at a RECORD file installed by pysetup (on 3.3 trunk, on Windows) all of the filenames seem to be absolute, even though the package is pure-Python and so everything is under site-packages. Looking at PEP 376, it looks like the paths should be relative to site-packages. Two questions: 1. Am I reading this right? Is it a bug in pysetup? 2. Does it matter? Are relative paths needed, or is it just nice to have? Oh, and a third question - where is the best place to ask these questions? Now that packaging is in core, is python-dev OK? Or should I be asking on the distutils SIG or the packaging developers list? Thanks, Paul.

2 1

PEP 405 (proposed): Python 2.8 Release Schedule
by Barry Warsaw 15 Nov '11

15 Nov '11

I think we should have an official pronouncement about Python 2.8, and PEPs are as official as it gets 'round here. Thus I propose the following. If there are no objections <wink>, I'll commit this taking the next available number. Cheers, -Barry PEP: 405 Title: Python 2.8 Release Schedule Version: $Revision$ Last-Modified: $Date$ Author: Barry Warsaw <barry(a)python.org> Status: Final Type: Informational Content-Type: text/x-rst Created: 2011-11-09 Python-Version: 2.8 Abstract ======== This document describes the development and release schedule for Python 2.8. Release Schedule ================ The current schedule is: - 2.8 final Never Official pronouncement ====================== There will never be an official Python 2.8 release. Upgrade path ============ The official upgrade path from Python 2.7 is to Python 3. Copyright ========= This document has been placed in the public domain. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8 End:

16 19