Mailman 3 June 2011 - Python-Dev

Re: [Python-Dev] cpython: remove duplicate -I
by Ned Deily June 28, 2011

June 28, 2011

In article <E1QYQFe-0006Ir-1o(a)dinsdale.python.org>, benjamin.peterson <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/0d0ca6f95d9d > changeset: 70879:0d0ca6f95d9d > user: Benjamin Peterson <benjamin(a)python.org> > date: Sun Jun 19 17:17:30 2011 -0500 > summary: > remove duplicate -I > > files: > Makefile.pre.in | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > > diff --git a/Makefile.pre.in b/Makefile.pre.in > --- a/Makefile.pre.in > +++ b/Makefile.pre.in > @@ -73,7 +73,7 @@ > # Both CPPFLAGS and LDFLAGS need to contain the shell's value for setup.py > to > # be able to build extension modules using the directories specified in the > # environment variables > -PY_CPPFLAGS= -I. -IInclude -I$(srcdir)/Include $(CONFIGURE_CPPFLAGS) > $(CPPFLAGS) > +PY_CPPFLAGS= -I. -IInclude $(CONFIGURE_CPPFLAGS) $(CPPFLAGS) > PY_LDFLAGS= $(CONFIGURE_LDFLAGS) $(LDFLAGS) > NO_AS_NEEDED= @NO_AS_NEEDED@ > LDLAST= @LDLAST@ I think someone has already mentioned that this change breaks builds with a source directory outside the build directory and that breaks my OS X installer builds. Please revert or make the following change which works for me (but not tested elsewhere): -PY_CPPFLAGS= -I. -IInclude $(CONFIGURE_CPPFLAGS) $(CPPFLAGS) +PY_CPPFLAGS= -I. -I$(srcdir)/Include $(CONFIGURE_CPPFLAGS) $(CPPFLAGS) -- Ned Deily, nad(a)acm.org

2 1

pdb and generators
by Guido van Rossum June 28, 2011

June 28, 2011

When debugging generators (especially when using them as coroutines) I often want 'next' to step over a yield statement/expression, instead of the current behavior, which is to step out of the frame, since pdb doesn't seem to see the difference between yield and return. Or I could live with a separate command to step over the yield. Has anyone looked into this yet? I found a question about this on StackOverflow.com but the answers were particularly unhelpful, so I'm guessing I'm not the first to want this but it hasn't been solved yet. It might be a good project for someone looking into hacking pdb. -- --Guido van Rossum (python.org/~guido)

1 0

Re: [Python-Dev] [Python-checkins] peps: Happy Tau Day folks! :)
by Benjamin Peterson June 27, 2011

June 27, 2011

2011/6/27 nick.coghlan <python-checkins(a)python.org>: > http://hg.python.org/peps/rev/1e3d663c67ee > changeset: 3892:1e3d663c67ee > user: Nick Coghlan <ncoghlan(a)gmail.com> > date: Tue Jun 28 00:23:57 2011 +1000 > summary: > Happy Tau Day folks! :) > > files: > pep-0628.html | 149 ++++++++++++++++++++++++++++++++++++++ You're not going to give us the source? -- Regards, Benjamin

2 1

Patching builtin_id to allow for C proxy objects?
by Tom Whittock June 27, 2011

June 27, 2011

Hi all. I'm writing a module to proxy C++ objects into Python for a large C++ application. There are hundreds of thousands of C++ objects, some of which are temporary while others are very long lived. Currently every time one of these objects is accessed from Python, a new "myproxy" instance is created. So if I were to access the same field of an object twice, I would receive two python objects proxying the same underlying C++ object. This messes up "id" and "is", and is causing me issues when, for example, I run into circular references when enoding json or otherwise attempt to determine whether two proxy objects refer to the same C++ object. I can't see how to cache the "myproxy" objects instead of returning new instances - due to the architecture of the C++ application, there's no weak reference support at all, and the number of objects is very large. My current plan would be for me to override the id builtin to return the underlying C++ object instance pointer instead of the PyObject instance pointer in the case of the "myproxy" object type, probably using a new type method slot tp_id or similar. The old behaviour would be unchanged for all other types, naturally. I'd also need to alter ceval.c to use builtin_id instead of the raw pointer for comparison when using PyCmp_IS and PyCmp_IS_NOT. I can see that there could very well be many other sites throughout the C source where the pointer was directly compared, and would cause interesting issues for me down the line. I'm just not sure what else to try. I'd like to know if I'm being laughably naive or not before I went about this plan, and whether it'd be worthwhile contributing the patch back, considering the number of potentially overridden-id-unaware areas throught the rest of the python source base. Thanks. Tom.

3 4

Re: [Python-Dev] [Python-checkins] cpython (3.2): #11669: rephrase footnote in the Compound Statements page.
by Nick Coghlan June 27, 2011

June 27, 2011

On Sun, Jun 26, 2011 at 6:38 PM, ezio.melotti <python-checkins(a)python.org> wrote: > -.. [#] The exception is propagated to the invocation stack only if there is no > - :keyword:`finally` clause that negates the exception. > +.. [#] The exception is propagated to the invocation stack unless > + there is a :keyword:`finally` clause which happens to raise another > + exception. That new exception causes the old one to be lost. I believe the footnote was talking about this case: >>> def f(): ... try: ... raise Exception() ... finally: ... return "What exception?" ... >>> f() 'What exception?' The new wording doesn't accurately reflect that. Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

2 2

Re: [Python-Dev] [Python-checkins] peps: Record Guido's acceptance of PEP 380
by Barry Warsaw June 26, 2011

June 26, 2011

On Jun 26, 2011, at 05:02 AM, nick.coghlan wrote: >http://hg.python.org/peps/rev/9f7a0b4e38a7 >changeset: 3889:9f7a0b4e38a7 >user: Nick Coghlan <ncoghlan(a)gmail.com> >date: Sun Jun 26 13:02:17 2011 +1000 >summary: > Record Guido's acceptance of PEP 380 > >files: > pep-0380.txt | 10 ++++++++-- > 1 files changed, 8 insertions(+), 2 deletions(-) > > >diff --git a/pep-0380.txt b/pep-0380.txt >--- a/pep-0380.txt >+++ b/pep-0380.txt >@@ -3,11 +3,11 @@ > Version: $Revision$ > Last-Modified: $Date$ > Author: Gregory Ewing <greg.ewing(a)canterbury.ac.nz> >-Status: Draft >+Status: Accepted > Type: Standards Track > Content-Type: text/x-rst > Created: 13-Feb-2009 >-Python-Version: 3.x >+Python-Version: 3.3 > Post-History: Please add a Resolution header as per PEP 1. Thanks! -Barry

1 0

Summary of Python tracker Issues
by Python tracker June 24, 2011

June 24, 2011

ACTIVITY SUMMARY (2011-06-17 - 2011-06-24) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 2845 ( +2) closed 21335 (+43) total 24180 (+45) Open issues with patches: 1235 Issues opened (30) ================== #3067: setlocale error message is confusing http://bugs.python.org/issue3067 reopened by terry.reedy #12354: packaging.pypi.simple docs use both client and crawler variabl http://bugs.python.org/issue12354 opened by gruszczy #12355: Crawler doesn't follow redirection http://bugs.python.org/issue12355 opened by gruszczy #12361: Memory Leak in File Logging http://bugs.python.org/issue12361 opened by japerk #12364: Timeout (1 hour) in test_concurrent_futures.tearDown() on spar http://bugs.python.org/issue12364 opened by haypo #12365: URLopener should support context manager protocol http://bugs.python.org/issue12365 opened by mcjeff #12366: packaging.pypi.dist should abstract download errors. http://bugs.python.org/issue12366 opened by michael.mulich #12368: packaging.pypi.simple.Crawler assumes external download links http://bugs.python.org/issue12368 opened by michael.mulich #12372: semaphore errors on AIX 7.1 http://bugs.python.org/issue12372 opened by reshmi.george #12374: Execution model should explain compile vs definition vs execut http://bugs.python.org/issue12374 opened by ncoghlan #12375: Add packages_root to sys.path for hooks http://bugs.python.org/issue12375 opened by erik.bray #12376: unittest.TextTestResult.__init__ breaks under complex __mro__ http://bugs.python.org/issue12376 opened by branker #12377: Clean up use of packages_root/package_dir http://bugs.python.org/issue12377 opened by erik.bray #12378: smtplib.SMTP_SSL leaks socket connections on SSL error http://bugs.python.org/issue12378 opened by joeshaw #12379: build outside source fail in head http://bugs.python.org/issue12379 opened by rpetrov #12380: bytearray methods center, ljust, rjust don't accept a bytearra http://bugs.python.org/issue12380 opened by py.user #12381: bytearray methods count, find, index don't support None as in http://bugs.python.org/issue12381 opened by py.user #12382: [msilib] Obscure exception message when trying to open a non-e http://bugs.python.org/issue12382 opened by Robin.Jarry #12384: difflib.SequenceMatcher and Match: code and doc bugs http://bugs.python.org/issue12384 opened by terry.reedy #12385: the help for bytearray.maketrans describes bytes.maketrans http://bugs.python.org/issue12385 opened by py.user #12386: packaging fails in install_distinfo when writing RESOURCES http://bugs.python.org/issue12386 opened by vinay.sajip #12387: IDLE save keyboard shortcut problem http://bugs.python.org/issue12387 opened by Jacob.VB #12388: cannot specify recursive extra_files in packaging setup.cfg http://bugs.python.org/issue12388 opened by vinay.sajip #12391: packaging install fails to clean up temp files http://bugs.python.org/issue12391 opened by vinay.sajip #12392: pthread_kill() doesn't work on the main thread on FreeBSD6 http://bugs.python.org/issue12392 opened by haypo #12393: Packaging should provide support for extensible categories http://bugs.python.org/issue12393 opened by vinay.sajip #12394: packaging: generate scripts from callable (dotted paths) http://bugs.python.org/issue12394 opened by vinay.sajip #12395: packaging remove fails under Windows http://bugs.python.org/issue12395 opened by vinay.sajip #12397: re match object methods have no docstrings http://bugs.python.org/issue12397 opened by nedbat #12398: Sending binary data with a POST request in httplib can cause U http://bugs.python.org/issue12398 opened by sorin Most recent 15 issues with no replies (15) ========================================== #12398: Sending binary data with a POST request in httplib can cause U http://bugs.python.org/issue12398 #12397: re match object methods have no docstrings http://bugs.python.org/issue12397 #12391: packaging install fails to clean up temp files http://bugs.python.org/issue12391 #12376: unittest.TextTestResult.__init__ breaks under complex __mro__ http://bugs.python.org/issue12376 #12347: add an "extras" in packaging.pypi.simple.Crawler http://bugs.python.org/issue12347 #12336: tkinter.test.test_ttk.test_widgets.test_select() failure on Fr http://bugs.python.org/issue12336 #12323: ElementPath 1.3 expressions http://bugs.python.org/issue12323 #12322: ElementPath 1.3 expressions documentation http://bugs.python.org/issue12322 #12317: inspect.getabsfile() is not documented http://bugs.python.org/issue12317 #12297: Clarifications to atexit.register and unregister doc http://bugs.python.org/issue12297 #12295: Fix ResourceWarning in turtledemo help window http://bugs.python.org/issue12295 #12294: multiprocessing.Pool: Need a way to find out if work are finis http://bugs.python.org/issue12294 #12288: Python 2.7.1 tkSimpleDialog initialvalue http://bugs.python.org/issue12288 #12259: Test and document which compilers can be created on which plat http://bugs.python.org/issue12259 #12258: Clean up bytes I/O in get_compiler_versions http://bugs.python.org/issue12258 Most recent 15 issues waiting for review (15) ============================================= #12392: pthread_kill() doesn't work on the main thread on FreeBSD6 http://bugs.python.org/issue12392 #12372: semaphore errors on AIX 7.1 http://bugs.python.org/issue12372 #12354: packaging.pypi.simple docs use both client and crawler variabl http://bugs.python.org/issue12354 #12353: argparse cannot handle empty arguments http://bugs.python.org/issue12353 #12350: Improve stat_result.st_blocks and st_blksize documentation http://bugs.python.org/issue12350 #12344: Add **kwargs to get_reinitialized_command http://bugs.python.org/issue12344 #12341: Some additions to .hgignore http://bugs.python.org/issue12341 #12328: multiprocessing's overlapped PipeConnection on Windows http://bugs.python.org/issue12328 #12308: Add link to PEP 0 for topical index in wiki http://bugs.python.org/issue12308 #12306: zlib: Expose zlibVersion to query runtime version of zlib http://bugs.python.org/issue12306 #12304: expose signalfd(2) in the signal module http://bugs.python.org/issue12304 #12303: expose sigwaitinfo() and sigtimedwait() in the signal module http://bugs.python.org/issue12303 #12297: Clarifications to atexit.register and unregister doc http://bugs.python.org/issue12297 #12296: Minor clarification in devguide http://bugs.python.org/issue12296 #12295: Fix ResourceWarning in turtledemo help window http://bugs.python.org/issue12295 Top 10 most discussed issues (10) ================================= #12291: file written using marshal in 3.2 can be read by 2.7, but not http://bugs.python.org/issue12291 14 msgs #12394: packaging: generate scripts from callable (dotted paths) http://bugs.python.org/issue12394 14 msgs #12326: Linux 3: tests should avoid using sys.platform == 'linux2' http://bugs.python.org/issue12326 11 msgs #4470: smtplib SMTP_SSL not working. http://bugs.python.org/issue4470 8 msgs #12255: A few changes to .*ignore http://bugs.python.org/issue12255 8 msgs #2202: urllib2 fails against IIS 6.0 (No support for MD5-sess auth) http://bugs.python.org/issue2202 7 msgs #3067: setlocale error message is confusing http://bugs.python.org/issue3067 7 msgs #12353: argparse cannot handle empty arguments http://bugs.python.org/issue12353 7 msgs #10206: python program starting with unmatched quote spews spaces to s http://bugs.python.org/issue10206 6 msgs #11812: transient socket failure to connect to 'localhost' http://bugs.python.org/issue11812 6 msgs Issues closed (41) ================== #1874: email parser does not register a defect for invalid Content-Tr http://bugs.python.org/issue1874 closed by r.david.murray #4015: Make installed scripts executable on windows http://bugs.python.org/issue4015 closed by eric.araujo #5905: strptime fails in non-UTF locale http://bugs.python.org/issue5905 closed by haypo #6697: Check that _PyUnicode_AsString() result is not NULL http://bugs.python.org/issue6697 closed by haypo #6734: Imap lib implicit conversion from bytes to string http://bugs.python.org/issue6734 closed by r.david.murray #6771: Curses.wrapper: documentation/implementation error http://bugs.python.org/issue6771 closed by r.david.murray #9921: os.path.join('x','') behavior http://bugs.python.org/issue9921 closed by r.david.murray #10354: tempfile.template is broken http://bugs.python.org/issue10354 closed by r.david.murray #10636: subprocess module has race condition with SIGCHLD handlers http://bugs.python.org/issue10636 closed by rosslagerwall #11637: Add cwd to sys.path for hooks http://bugs.python.org/issue11637 closed by eric.araujo #11690: Devguide: Add "communication" FAQ http://bugs.python.org/issue11690 closed by ncoghlan #11700: mailbox.py proxy close method cannot be called multiple times http://bugs.python.org/issue11700 closed by r.david.murray #11781: test/test_email directory does not get installed by 'make inst http://bugs.python.org/issue11781 closed by r.david.murray #11795: Better core dev guidelines for committing submitted patches http://bugs.python.org/issue11795 closed by ncoghlan #12090: 3.2: build --without-threads fails http://bugs.python.org/issue12090 closed by georg.brandl #12223: Datamodel documentation page: 'operator' where 'operand' shoul http://bugs.python.org/issue12223 closed by eli.bendersky #12261: urllib.parse docs still refer to urlparse http://bugs.python.org/issue12261 closed by python-dev #12278: Core mentorship mention in the devguide http://bugs.python.org/issue12278 closed by python-dev #12285: Unexpected behavior for 0 or negative processes in multiproces http://bugs.python.org/issue12285 closed by haypo #12289: http.server.CGIHTTPRequestHandler doesn't check if a Python sc http://bugs.python.org/issue12289 closed by python-dev #12313: make install misses test dirs for packaging and email modules http://bugs.python.org/issue12313 closed by vinay.sajip #12315: Improve http.client.HTTPResponse.read documentation http://bugs.python.org/issue12315 closed by python-dev #12337: Need real TextIOWrapper for stdin/stdout http://bugs.python.org/issue12337 closed by haypo #12356: more argument error improving http://bugs.python.org/issue12356 closed by python-dev #12357: Python dist modifications for secure PyPI uploads http://bugs.python.org/issue12357 closed by eric.araujo #12358: validate server certificate when uploading packages to PyPI http://bugs.python.org/issue12358 closed by eric.araujo #12359: tutorial: Module search path description is incorrect http://bugs.python.org/issue12359 closed by python-dev #12360: Doc Typo http://bugs.python.org/issue12360 closed by python-dev #12362: General Windows stdout redirection not working http://bugs.python.org/issue12362 closed by r.david.murray #12363: test_signal.test_without_siginterrupt() sporadic failures on F http://bugs.python.org/issue12363 closed by python-dev #12367: select.error has no errno attribute http://bugs.python.org/issue12367 closed by pitrou #12369: Revised core mentorship section of help.rst http://bugs.python.org/issue12369 closed by ncoghlan #12370: Use of super overwrites use of __class__ in class namespace http://bugs.python.org/issue12370 closed by python-dev #12371: datetime.now() bug http://bugs.python.org/issue12371 closed by haypo #12373: Duplicate packets in Multicast Receiver http://bugs.python.org/issue12373 closed by neologix #12383: subprocess.Popen(..., env={}) fails to pass empty env. http://bugs.python.org/issue12383 closed by python-dev #12389: typo in urllib: missing space after dot at sentence end http://bugs.python.org/issue12389 closed by r.david.murray #12390: urllib.parse.urlencode encoding lists as strings http://bugs.python.org/issue12390 closed by orsenthil #12396: Delivery failed http://bugs.python.org/issue12396 closed by eric.araujo #976869: Stripping script extensions with distutils http://bugs.python.org/issue976869 closed by eric.araujo #870479: Scripts need platform-dependent handling http://bugs.python.org/issue870479 closed by eric.araujo

1 0

Re: [Python-Dev] cpython: #1874: detect invalid multipart CTE and report it as a defect.
by Georg Brandl June 22, 2011

June 22, 2011

On 22.06.2011 19:48, r.david.murray wrote: > http://hg.python.org/cpython/rev/5a2602939d5d > changeset: 70925:5a2602939d5d > user: R David Murray <rdmurray(a)bitdance.com> > date: Wed Jun 22 13:47:53 2011 -0400 > summary: > #1874: detect invalid multipart CTE and report it as a defect. > > files: > Lib/email/errors.py | 3 + > Lib/email/feedparser.py | 5 ++ > Lib/test/test_email/test_email.py | 45 +++++++++++++++++++ > Misc/NEWS | 3 + > 4 files changed, 56 insertions(+), 0 deletions(-) > > > diff --git a/Lib/email/errors.py b/Lib/email/errors.py > --- a/Lib/email/errors.py > +++ b/Lib/email/errors.py > @@ -55,3 +55,6 @@ > > class MultipartInvariantViolationDefect(MessageDefect): > """A message claimed to be a multipart but no subparts were found.""" > + > +class InvalidMultipartContentTransferEncodingDefect(MessageDefect): > + """An invalid content transfer encoding was set on the multipart itself.""" Dear Mr. Murray, thank you very much for competing in the PSU's Longest Class Name in the Standard Library competition. Unfortunately, your class name of 45 characters has been surpassed by four other contestants. However, it is my pleasure to inform you that your entry wins the consolation prize for the Longest Exception Name! A framed certificate and a PSU-branded wooden keyboard will be delivered to you shortly. Yours sincerely, the PSU ministry of silly stats

2 1

PEP 382 sprint
by Barry Warsaw June 22, 2011

June 22, 2011

Hi folks, Yesterday, 6 Washington DC area Pythonistas met to work on PEP 382. I wrote up a summary based on my notes and blogged about it here: http://www.wefearchange.org/2011/06/pep-382-sprint-summary.html Hopefully, the other participants will correct my mistakes and fill in the holes. A few other things to mention: * I resurrected the import-sig in order to shepherd PEP 382 to landing in Python 3.3. If you're at all interested in helping out, please join the mailing list: http://mail.python.org/mailman/admin/import-sig * We created a wiki page to track our results, questions, and plan of action: http://wiki.python.org/moin/Pep382Sprint I want to thank my fellow sprint participants for coming out and really doing a great job working on this. And I especially want to thank the PSF for sponsoring our sprint. What a great way to encourage Python developers to meet and work on improving Python! Cheers, -Barry

1 0

Is there any fun with benchmarks
by anatoly techtonik June 22, 2011

June 22, 2011

I run across a snippet in SCons.Util (don't worry, I've double-checked To: field) that claims it is faster than os.path.splitext() while basically doing the same thing. def splitext(path): "Same as os.path.splitext() but faster." sep = rightmost_separator(path, os.sep) dot = path.rfind('.') # An ext is only real if it has at least one non-digit char if dot > sep and not containsOnly(path[dot:], "0123456789."): return path[:dot],path[dot:] else: return path,"" I wonder if upcoming speed.python.org has any means to validate these claims for different Python releases? Is there any place where I can upload my two to compare performance? Are there any instructions how to create such snippets and add/enhance dataset for them? Any plans or opinions if that will be useful or not? -- anatoly t.

4 3