Mailman 3 September 2011 - Python-Dev

What it takes to change a single keyword.
by Yaşar Arabacı 06 Oct '11

06 Oct '11

Hi, First of all, I am sincerely sorry if this is wrong mailing list to ask this question. I checked out definitions of couple other mailing list, and this one seemed most suitable. Here is my question: Let's say I want to change a single keyword, let's say import keyword, to be spelled as something else, like it's translation to my language. I guess it would be more complicated than modifiying Grammar/Grammar, but I can't be sure which files should get edited. I'am asking this, because, I am trying to figure out if I could translate keyword's into another language, without affecting behaviour of language. -- http://yasar.serveblog.net/

5 6

Heads up: Apple llvm gcc 4.2 miscompiles PEP 393
by martin＠v.loewis.de 05 Oct '11

05 Oct '11

The gcc that Apple ships with the Lion SDK (not sure what Xcode version that is) miscompiles Python now. I've reported this to Apple as bug 10143715; not sure whether there is a public link to this bug report. In essence, the code typedef struct { long length; long hash; int state; int *wstr; } PyASCIIObject; typedef struct { PyASCIIObject _base; long utf8_length; char *utf8; long wstr_length; } PyCompactUnicodeObject; void *_PyUnicode_compact_data(void *unicode) { return ((((PyASCIIObject*)unicode)->state & 0x20) ? ((void*)((PyASCIIObject*)(unicode) + 1)) : ((void*)((PyCompactUnicodeObject*)(unicode) + 1))); } miscompiles (with -O2 -fomit-frame-pointer) to __PyUnicode_compact_data: Leh_func_begin1: leaq 32(%rdi), %rax ret The compiler version is gcc version 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2335.15.00) This unconditionally assumes that sizeof(PyASCIIObject) needs to be added to unicode, independent of whether the state bit is set or not. I'm not aware of a work-around in the code. My work-around is to use gcc-4.0, which is still available on my system from an earlier Xcode installation (in /Developer-3.2.6) Regards, Martin

5 7

Hg tips (was Re: [Python-checkins] cpython (merge default -> default): Merge heads.)
by Ezio Melotti 02 Oct '11

02 Oct '11

Tip 1 -- merging heads: A while ago Éric suggested a nice tip to make merges easier and since I haven't seen many people using it and now I got a chance to use it again, I think it might be worth showing it once more: # so assume you just committed some changes: $ hg ci Doc/whatsnew/3.3.rst -m 'Update and reorganize the whatsnew entry for PEP 393.' # you push them, but someone else pushed something in the meanwhile, so the push fails $ hg push pushing to ssh://hg@hg.python.org/cpython searching for changes abort: push creates new remote heads on branch 'default'! (you should pull and merge or use push -f to force) # so you pull the other changes $ hg pull -u pulling from ssh://hg@hg.python.org/cpython searching for changes adding changesets adding manifests adding file changes added 4 changesets with 5 changes to 5 files (+1 heads) not updating, since new heads added (run 'hg heads' to see heads, 'hg merge' to merge) # and use "hg heads ." to see the two heads (yours and the one you pulled) in the current branch $ hg heads . changeset: 72521:e6a2b54c1d16 tag: tip user: Victor Stinner <victor.stinner(a)haypocalc.com> date: Thu Sep 29 04:02:13 2011 +0200 summary: Fix hex_digit_to_int() prototype: expect Py_UCS4, not Py_UNICODE changeset: 72517:ba6ee5cc9ed6 user: Ezio Melotti <ezio.melotti(a)gmail.com> date: Thu Sep 29 08:34:36 2011 +0300 summary: Update and reorganize the whatsnew entry for PEP 393. # here comes the tip: before merging you switch to the other head (i.e. the one pushed by Victor), # if you don't switch, you'll be merging Victor changeset and in case of conflicts you will have to review # and modify his code (e.g. put a Misc/NEWS entry in the right section or something more complicated) $ hg up e6a2b54c1d16 6 files updated, 0 files merged, 0 files removed, 0 files unresolved # after the switch you will merge the changeset you just committed, so in case of conflicts # reviewing and merging is much easier because you know the changes already $ hg merge 1 files updated, 0 files merged, 0 files removed, 0 files unresolved (branch merge, don't forget to commit) # here everything went fine and there were no conflicts, and in the diff I can see my last changeset $ hg di diff --git a/Doc/whatsnew/3.3.rst b/Doc/whatsnew/3.3.rst [...] # everything looks fine, so I can commit the merge and push $ hg ci -m 'Merge heads.' $ hg push pushing to ssh://hg@hg.python.org/cpython searching for changes remote: adding changesets remote: adding manifests remote: adding file changes remote: added 2 changesets with 1 changes to 1 files remote: buildbot: 2 changes sent successfully remote: notified python-checkins(a)python.org of incoming changeset ba6ee5cc9ed6 remote: notified python-checkins(a)python.org of incoming changeset e7672fe3cd35 This tip is not only useful while merging, but it's also useful for python-checkins reviews, because the "merge" mail has the same diff of the previous mail rather than having 15 unrelated changesets from the last week because the committer didn't pull in a while. Tip 2 -- extended diffs: If you haven't already, enable git diffs, adding to your ~/.hgrc the following two lines: > [diff] > git = True > (this is already in the devguide, even if 'git = on' is used there. The mercurial website uses git = True too.) More info: http://hgtip.com/tips/beginner/2009-10-22-always-use-git-diffs/ Tip 3 -- extensions: I personally like the 'color' extension, it makes the output of commands like 'hg diff' and 'hg stat' more readable (e.g. it shows removed lines in red and added ones in green). If you want to give it a try, add to your ~/.hgrc the following two lines: > [extensions] > color = > If you find operations like pulling, updating or cloning too slow, you might also want to look at the 'progress' extension, which displays a progress bar during these operations: > [extensions] > progress = > Tip 4 -- porting from 2.7 to 3.2: The devguide suggests: > > hg export a7df1a869e4a | hg import --no-commit - > but it's not always necessary to copy the changeset number manually. If you are porting your last commit you can just use 'hg export 2.7' (or any other branch name): * using the one-dir-per-branch setup: wolf@hp:~/dev/py/2.7$ hg ci -m 'Fix some bug.' wolf@hp:~/dev/py/2.7$ cd ../3.2 wolf@hp:~/dev/py/3.2$ hg pull -u ../2.7 wolf@hp:~/dev/py/3.2$ hg export 2.7 | hg import --no-commit - * using the single-dir setup: wolf@hp:~/dev/python$ hg branch 2.7 wolf@hp:~/dev/python$ hg ci -m 'Fix some bug.' wolf@hp:~/dev/python$ hg up 3.2 # here you might enjoy the progress extension wolf@hp:~/dev/python$ hg export 2.7 | hg import --no-commit - And then you can check that everything is fine, and commit on 3.2 too. Of course it works the other way around (from 3.2 to 2.7) too. I hope you'll find these tips useful. Best Regards, Ezio Melotti On Thu, Sep 29, 2011 at 8:36 AM, ezio.melotti <python-checkins(a)python.org>wrote: > http://hg.python.org/cpython/rev/e7672fe3cd35 > changeset: 72522:e7672fe3cd35 > parent: 72520:e6a2b54c1d16 > parent: 72521:ba6ee5cc9ed6 > user: Ezio Melotti <ezio.melotti(a)gmail.com> > date: Thu Sep 29 08:36:23 2011 +0300 > summary: > Merge heads. > > files: > Doc/whatsnew/3.3.rst | 63 +++++++++++++++++++++---------- > 1 files changed, 42 insertions(+), 21 deletions(-) > >

7 9

PEP 393 merged
by "Martin v. Löwis" 02 Oct '11

02 Oct '11

I have now merged the PEP 393 implementation into default. The main missing piece is the documentation; contributions are welcome. Regards, Martin

3 2

Re: [Python-Dev] [Python-checkins] cpython: Implement PEP 393.
by Eric V. Smith 02 Oct '11

02 Oct '11

3 3

Re: [Python-Dev] [Python-checkins] cpython: Enhance Py_ARRAY_LENGTH(): fail at build time if the argument is not an array
by Benjamin Peterson 01 Oct '11

01 Oct '11

2011/9/28 victor.stinner <python-checkins(a)python.org>: > http://hg.python.org/cpython/rev/36fc514de7f0 > changeset: 72512:36fc514de7f0 > user: Victor Stinner <victor.stinner(a)haypocalc.com> > date: Thu Sep 29 01:12:24 2011 +0200 > summary: > Enhance Py_ARRAY_LENGTH(): fail at build time if the argument is not an array > > Move other various macros to pymcacro.h > > Thanks Rusty Russell for having written these amazing C macros! > > files: > Include/Python.h | 19 +-------- > Include/pymacro.h | 57 +++++++++++++++++++++++++++ Do we really need a new file? Why not pyport.h where other compiler stuff goes? -- Regards, Benjamin

5 5

Summary of Python tracker Issues
by Python tracker 30 Sep '11

30 Sep '11

ACTIVITY SUMMARY (2011-09-23 - 2011-09-30) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 3046 (+16) closed 21813 (+25) total 24859 (+41) Open issues with patches: 1301 Issues opened (31) ================== #13038: distutils windows installer STATUS_INVALID_CRUNTIME_PARAMETER http://bugs.python.org/issue13038 opened by mitchfrazier #13039: IDLE editor: shell-like behaviour on line starting with ">>>" http://bugs.python.org/issue13039 opened by etuardu #13040: call to tkinter.messagebox.showinfo hangs the script on timer http://bugs.python.org/issue13040 opened by Richard86 #13041: argparse: terminal width is not detected properly http://bugs.python.org/issue13041 opened by zbysz #13044: pdb throws AttributeError at end of debugging session http://bugs.python.org/issue13044 opened by akl #13045: socket.getsockopt may require custom buffer contents http://bugs.python.org/issue13045 opened by Artyom.Gavrichenkov #13047: imp.find_module("") and imp.find_module(".") http://bugs.python.org/issue13047 opened by Arfrever #13048: Handling of paths in first argument of imp.find_module() http://bugs.python.org/issue13048 opened by Arfrever #13049: distutils2 should not allow a distribution to install under an http://bugs.python.org/issue13049 opened by carljm #13050: RLock support the context manager protocol but this is not doc http://bugs.python.org/issue13050 opened by r.david.murray #13051: Infinite recursion in curses.textpad.Textbox http://bugs.python.org/issue13051 opened by tycho #13052: IDLE: replace ending with '\' causes crash http://bugs.python.org/issue13052 opened by terry.reedy #13053: Add Capsule migration documentation to "cporting" http://bugs.python.org/issue13053 opened by larry #13054: sys.maxunicode value after PEP-393 http://bugs.python.org/issue13054 opened by ezio.melotti #13055: Distutils tries to handle null versions but fails http://bugs.python.org/issue13055 opened by bgamari #13056: test_multibytecodec.py:TestStreamWriter is skipped after PEP39 http://bugs.python.org/issue13056 opened by ezio.melotti #13057: Thread not working for python 2.7.1 built with HP Compiler on http://bugs.python.org/issue13057 opened by wah meng #13059: Sporadic test_multiprocessing failure: IOError("bad message le http://bugs.python.org/issue13059 opened by haypo #13060: allow other rounding modes in round() http://bugs.python.org/issue13060 opened by ArneBab #13061: Decimal module yields incorrect results when Python compiled w http://bugs.python.org/issue13061 opened by josharian #13062: Introspection generator and function closure state http://bugs.python.org/issue13062 opened by ncoghlan #13063: test_concurrent_futures failures on Windows: IOError('[Errno 2 http://bugs.python.org/issue13063 opened by haypo #13064: Port codecs and error handlers to the new Unicode API http://bugs.python.org/issue13064 opened by haypo #13070: segmentation fault in pure-python multi-threaded server http://bugs.python.org/issue13070 opened by vsemionov #13071: IDLE refuses to open on windows 7 http://bugs.python.org/issue13071 opened by jfalskfjdsl;akfdjsa;l.laksfj;aslkfdj;sal #13072: Getting a buffer from a Unicode array uses invalid format http://bugs.python.org/issue13072 opened by haypo #13073: message_body argument of HTTPConnection.endheaders is undocume http://bugs.python.org/issue13073 opened by petri.lehtinen #13074: Improve documentation of locale encoding functions http://bugs.python.org/issue13074 opened by gjb1002 #13075: PEP-0001 contains dead links http://bugs.python.org/issue13075 opened by ezander #13076: Bad links to 'time' in datetime documentation http://bugs.python.org/issue13076 opened by gjb1002 #13077: Unclear behavior of daemon threads on main thread exit http://bugs.python.org/issue13077 opened by etuardu Most recent 15 issues with no replies (15) ========================================== #13076: Bad links to 'time' in datetime documentation http://bugs.python.org/issue13076 #13075: PEP-0001 contains dead links http://bugs.python.org/issue13075 #13074: Improve documentation of locale encoding functions http://bugs.python.org/issue13074 #13073: message_body argument of HTTPConnection.endheaders is undocume http://bugs.python.org/issue13073 #13072: Getting a buffer from a Unicode array uses invalid format http://bugs.python.org/issue13072 #13070: segmentation fault in pure-python multi-threaded server http://bugs.python.org/issue13070 #13064: Port codecs and error handlers to the new Unicode API http://bugs.python.org/issue13064 #13056: test_multibytecodec.py:TestStreamWriter is skipped after PEP39 http://bugs.python.org/issue13056 #13055: Distutils tries to handle null versions but fails http://bugs.python.org/issue13055 #13051: Infinite recursion in curses.textpad.Textbox http://bugs.python.org/issue13051 #13050: RLock support the context manager protocol but this is not doc http://bugs.python.org/issue13050 #13045: socket.getsockopt may require custom buffer contents http://bugs.python.org/issue13045 #13038: distutils windows installer STATUS_INVALID_CRUNTIME_PARAMETER http://bugs.python.org/issue13038 #13032: h2py.py can fail with UnicodeDecodeError http://bugs.python.org/issue13032 #13024: cgitb uses stdout encoding http://bugs.python.org/issue13024 Most recent 15 issues waiting for review (15) ============================================= #13077: Unclear behavior of daemon threads on main thread exit http://bugs.python.org/issue13077 #13061: Decimal module yields incorrect results when Python compiled w http://bugs.python.org/issue13061 #13057: Thread not working for python 2.7.1 built with HP Compiler on http://bugs.python.org/issue13057 #13055: Distutils tries to handle null versions but fails http://bugs.python.org/issue13055 #13054: sys.maxunicode value after PEP-393 http://bugs.python.org/issue13054 #13051: Infinite recursion in curses.textpad.Textbox http://bugs.python.org/issue13051 #13045: socket.getsockopt may require custom buffer contents http://bugs.python.org/issue13045 #13041: argparse: terminal width is not detected properly http://bugs.python.org/issue13041 #13032: h2py.py can fail with UnicodeDecodeError http://bugs.python.org/issue13032 #13031: small speed-up for tarfile.py when unzipping tarballs http://bugs.python.org/issue13031 #13025: mimetypes should read the rule file using UTF-8, not the local http://bugs.python.org/issue13025 #13024: cgitb uses stdout encoding http://bugs.python.org/issue13024 #13018: dictobject.c: refleak http://bugs.python.org/issue13018 #13017: pyexpat.c: refleak http://bugs.python.org/issue13017 #13016: selectmodule.c: refleak http://bugs.python.org/issue13016 Top 10 most discussed issues (10) ================================= #13057: Thread not working for python 2.7.1 built with HP Compiler on http://bugs.python.org/issue13057 18 msgs #13060: allow other rounding modes in round() http://bugs.python.org/issue13060 10 msgs #1621: Do not assume signed integer overflow behavior http://bugs.python.org/issue1621 7 msgs #13054: sys.maxunicode value after PEP-393 http://bugs.python.org/issue13054 7 msgs #12242: distutils2 environment marker for current compiler http://bugs.python.org/issue12242 5 msgs #12806: argparse: Hybrid help text formatter http://bugs.python.org/issue12806 5 msgs #12966: cookielib.LWPCookieJar breaks on cookie values with a newline http://bugs.python.org/issue12966 5 msgs #11751: Increase distutils.filelist / packaging.manifest test coverage http://bugs.python.org/issue11751 4 msgs #12737: str.title() is overzealous by upcasing combining marks inappro http://bugs.python.org/issue12737 4 msgs #13033: Add shutil.chowntree http://bugs.python.org/issue13033 4 msgs Issues closed (23) ================== #1092365: Distutils needs a way *not* to install files http://bugs.python.org/issue1092365 closed by eric.araujo #3130: In some UCS4 builds, sizeof(Py_UNICODE) could end up being mor http://bugs.python.org/issue3130 closed by haypo #8654: Improve ABI compatibility between UCS2 and UCS4 builds http://bugs.python.org/issue8654 closed by stutzbach #8927: Handle version incompatibilities in dependencies http://bugs.python.org/issue8927 closed by eric.araujo #9306: distutils: raise informative error message when cmd_class is N http://bugs.python.org/issue9306 closed by eric.araujo #9395: clean does not remove all temp files http://bugs.python.org/issue9395 closed by eric.araujo #12746: normalization is affected by unicode width http://bugs.python.org/issue12746 closed by benjamin.peterson #12819: PEP 393 - Flexible Unicode String Representation http://bugs.python.org/issue12819 closed by haypo #12981: rewrite multiprocessing (senfd|recvfd) in Python http://bugs.python.org/issue12981 closed by neologix #13008: syntax error when pasting valid snippet into console without e http://bugs.python.org/issue13008 closed by eric.araujo #13012: Allow keyword argument in str.splitlines() http://bugs.python.org/issue13012 closed by ezio.melotti #13013: _ctypes.c: refleak http://bugs.python.org/issue13013 closed by meador.inge #13035: "maintainer" value clear the "author" value when registering http://bugs.python.org/issue13035 closed by eric.araujo #13037: [Regression] socket.error does not inherit from IOError as doc http://bugs.python.org/issue13037 closed by Christopher.Egner #13042: argparse: terminal width is not detected properly http://bugs.python.org/issue13042 closed by ezio.melotti #13043: Unexpected behavior of imp.find_module(".") with a package pre http://bugs.python.org/issue13043 closed by Arfrever #13046: imp.find_module() should not find unimportable modules http://bugs.python.org/issue13046 closed by brett.cannon #13058: Fix file descriptor leak on error http://bugs.python.org/issue13058 closed by neologix #13065: test http://bugs.python.org/issue13065 closed by vsemionov #13066: test http://bugs.python.org/issue13066 closed by vsemionov #13067: test http://bugs.python.org/issue13067 closed by vsemionov #13068: test http://bugs.python.org/issue13068 closed by vsemionov #13069: test http://bugs.python.org/issue13069 closed by ezio.melotti

1 0

range objects in 3.x
by Ethan Furman 29 Sep '11

29 Sep '11

A question came up on StackOverflow about range objects and floating point numbers. I thought about writing an frange that did for floats what range does for ints, so started examining the range class. I noticed it has __le__, __lt__, __eq__, __ne__, __ge__, and __gt__ methods. Some experiments show that xrange in 2.x does indeed implement those operations, but in 3.x range does not (TypeError: unorderable types: range() > range()). Was this intentional, or should I file a bug report? (I was unable to find anything in the What's New documents; also, I did not test in 3.0, just in 2.7, 3.1, 3.2.) ~Ethan~

15 57

unittest missing assertNotRaises
by Wilfred Hughes 28 Sep '11

28 Sep '11

Hi folks I wasn't sure if this warranted a bug in the tracker, so I thought I'd raise it here first. unittest has assertIn, assertNotIn, assertEqual, assertNotEqual and so on. So, it seems odd to me that there isn't assertNotRaises. Is there any particular motivation for not putting it in? I've attached a simple patch against Python 3's trunk to give an idea of what I have in mind. Thanks Wilfred

9 12

Re: [Python-Dev] cpython: Implement PEP 393.
by Georg Brandl 28 Sep '11

28 Sep '11

Am 28.09.2011 08:35, schrieb martin.v.loewis: > http://hg.python.org/cpython/rev/8beaa9a37387 > changeset: 72475:8beaa9a37387 > user: Martin v. Löwis <martin(a)v.loewis.de> > date: Wed Sep 28 07:41:54 2011 +0200 > summary: > Implement PEP 393. > [...] > > diff --git a/Doc/c-api/unicode.rst b/Doc/c-api/unicode.rst > --- a/Doc/c-api/unicode.rst > +++ b/Doc/c-api/unicode.rst > @@ -1072,6 +1072,15 @@ > occurred and an exception has been set. > > > +.. c:function:: Py_ssize_t PyUnicode_FindChar(PyObject *str, Py_UCS4 ch, Py_ssize_t start, Py_ssize_t end, int direction) > + > + Return the first position of the character *ch* in ``str[start:end]`` using > + the given *direction* (*direction* == 1 means to do a forward search, > + *direction* == -1 a backward search). The return value is the index of the > + first match; a value of ``-1`` indicates that no match was found, and ``-2`` > + indicates that an error occurred and an exception has been set. > + > + > .. c:function:: Py_ssize_t PyUnicode_Count(PyObject *str, PyObject *substr, Py_ssize_t start, Py_ssize_t end) > > Return the number of non-overlapping occurrences of *substr* in This is the only doc change for this change (and it doesn't have a versionadded). Surely there must be more new APIs and changes that need documenting? Georg

2 1