Mailman 3 June 2011 - Python-Dev

Re: [Python-Dev] [Python-checkins] devguide: Fix copy-paste glitch :)
by Nick Coghlan 19 Jun '11

19 Jun '11

On Mon, Jun 20, 2011 at 12:57 AM, eric.araujo <python-checkins(a)python.org> wrote: > http://hg.python.org/devguide/rev/f55ad3dc4526 > changeset: 434:f55ad3dc4526 > user: Éric Araujo <merwok(a)netwok.org> > date: Sun Jun 19 16:56:58 2011 +0200 > summary: > Fix copy-paste glitch :) > > files: > committing.rst | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > > diff --git a/committing.rst b/committing.rst > --- a/committing.rst > +++ b/committing.rst > @@ -16,7 +16,7 @@ > (using Tools/scripts/reindent-rst.py) > * Has the documentation been updated? > * Has the test suite been updated? > -* Has ``Misc/ACKS`` been updated? > +* Has ``Misc/NEWS`` been updated? > * Has ``Misc/ACKS`` been updated? > * Has the test suite been run? D'oh! I had it right at one point, too, but then I rearranged it and must have clobbered the wrong line in the process. Thanks for fixing it :) Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

1 0

Re: [Python-Dev] [Python-checkins] cpython: edit and rewrite
by Victor Stinner 19 Jun '11

19 Jun '11

Le samedi 18 juin 2011 à 02:51 +0200, benjamin.peterson a écrit : > .. function:: dump_traceback(file=sys.stderr, all_threads=True) > > - Dump the traceback of all threads, or of the current thread if *all_threads* > - is ``False``, into *file*. > + Dump the traceback of all threads into *file*. If *all_threads* is ``True``, > + produce tracebacks for every running thread. Otherwise, dump only the current > + thread. The first sentence is confusing. I suggest: Dump the traceback of all threads into *file*. If *all_threads* is ``False``, dump the traceback of only the current thread. or Dump the traceback into *file*. If *all_threads* is ``True``, produce tracebacks for every running thread. Otherwise, dump only the current thread. > @@ -69,15 +75,14 @@ > .. function:: dump_tracebacks_later(timeout, repeat=False, file=sys.stderr, exit=False) > > Dump the tracebacks of all threads, after a timeout of *timeout* seconds, or > - each *timeout* seconds if *repeat* is ``True``. If *exit* is True, call > - :c:func:`_exit` with status=1 after dumping the tracebacks to terminate > - immediatly the process, which is not safe. For example, :c:func:`_exit` > - doesn't flush file buffers. If the function is called twice, the new call > - replaces previous parameters (resets the timeout). The timer has a > - sub-second resolution. > + every *timeout* seconds if *repeat* is ``True``. If *exit* is ``True``, call > + :c:func:`_exit` with status=1 after dumping the tracebacks. (Note > + :c:func:`_exit` doesn't flush file buffers.) If the function is called twice, > + the new call replaces previous parameters and resets the timeout. The timer > + has a sub-second resolution. You removed "to terminate immediatly the process, which is not safe" sentence which is very important. It doesn't exit like sys.exit(): it exits immediatly. Not flushing file buffers is just an example. Anyway, thank you for rephrasing the doc. Victor

1 0

Re: [Python-Dev] [Python-checkins] cpython: #11781: update windows build script to account for move of email tests
by "Martin v. Löwis" 19 Jun '11

19 Jun '11

>> # This should contain all non-.svn files listed in >> subversion > > Should this be mercurial Perhaps. > >> for f in os.listdir(lib.absolute): >> if f.endswith(".txt") or f==".svn":continue > > and this .hg? No. Martin

1 0

Summary of Python tracker Issues
by Python tracker 17 Jun '11

17 Jun '11

ACTIVITY SUMMARY (2011-06-10 - 2011-06-17) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 2843 (+17) closed 21292 (+24) total 24135 (+41) Open issues with patches: 1244 Issues opened (29) ================== #10884: pkgutil EggInfoDistribution requirements for .egg-info metadat http://bugs.python.org/issue10884 reopened by eric.araujo #12298: Sphinx glitch in library/functions http://bugs.python.org/issue12298 reopened by eric.araujo #12313: make install misses test dirs for packaging and email modules http://bugs.python.org/issue12313 opened by eric.araujo #12314: regrtest checks (os.environ, sys.path, etc.) are hard to use http://bugs.python.org/issue12314 opened by eric.araujo #12315: Improve http.client.HTTPResponse.read documentation http://bugs.python.org/issue12315 opened by harobed #12317: inspect.getabsfile() is not documented http://bugs.python.org/issue12317 opened by giampaolo.rodola #12319: [http.client] HTTPConnection.putrequest not support "chunked" http://bugs.python.org/issue12319 opened by harobed #12321: documentation of ElementTree.find http://bugs.python.org/issue12321 opened by patrick.vrijlandt #12322: ElementPath 1.3 expressions documentation http://bugs.python.org/issue12322 opened by patrick.vrijlandt #12323: ElementPath 1.3 expressions http://bugs.python.org/issue12323 opened by patrick.vrijlandt #12326: Linux 3: tests should avoid using sys.platform == 'linux2' http://bugs.python.org/issue12326 opened by neologix #12327: in HTTPConnection the are len(body) and TypeError catch except http://bugs.python.org/issue12327 opened by harobed #12328: multiprocessing's overlapped PipeConnection on Windows http://bugs.python.org/issue12328 opened by sbt #12331: lib2to3 and packaging tests fail because they write into prote http://bugs.python.org/issue12331 opened by vinay.sajip #12335: pysetup create: ask before moving an existing setup.cfg http://bugs.python.org/issue12335 opened by barry #12336: tkinter.test.test_ttk.test_widgets.test_select() failure on Fr http://bugs.python.org/issue12336 opened by haypo #12337: Need real TextIOWrapper for stdin/stdout http://bugs.python.org/issue12337 opened by r_mosaic #12338: multiprocessing.util._eintr_retry doen't recalculate timeouts http://bugs.python.org/issue12338 opened by sbt #12340: Access violation when using the C version of the io module http://bugs.python.org/issue12340 opened by OscarL #12341: Some additions to .hgignore http://bugs.python.org/issue12341 opened by sandro.tosi #12342: characters with ord above 65535 fail to display in IDLE http://bugs.python.org/issue12342 opened by wujek.srujek #12343: ssl documentation needs comments about non-blocking behaviour http://bugs.python.org/issue12343 opened by jcea #12344: Add **kwargs to get_reinitialized_command http://bugs.python.org/issue12344 opened by higery #12346: Python 2.7.2 source code build (release) depends on mercurial http://bugs.python.org/issue12346 opened by Graeme.Winter #12347: add an "extras" in packaging.pypi.simple.Crawler http://bugs.python.org/issue12347 opened by tarek #12348: case sensitivness in packaging.pypi.simple.Crawler http://bugs.python.org/issue12348 opened by tarek #12350: Improve stat_result.st_blocks and st_blksize documentation http://bugs.python.org/issue12350 opened by liw #12352: multiprocessing.Value() hangs http://bugs.python.org/issue12352 opened by greg.ath #12353: argparse cannot handle empty arguments http://bugs.python.org/issue12353 opened by bjacobs Most recent 15 issues with no replies (15) ========================================== #12353: argparse cannot handle empty arguments http://bugs.python.org/issue12353 #12352: multiprocessing.Value() hangs http://bugs.python.org/issue12352 #12347: add an "extras" in packaging.pypi.simple.Crawler http://bugs.python.org/issue12347 #12338: multiprocessing.util._eintr_retry doen't recalculate timeouts http://bugs.python.org/issue12338 #12336: tkinter.test.test_ttk.test_widgets.test_select() failure on Fr http://bugs.python.org/issue12336 #12323: ElementPath 1.3 expressions http://bugs.python.org/issue12323 #12322: ElementPath 1.3 expressions documentation http://bugs.python.org/issue12322 #12321: documentation of ElementTree.find http://bugs.python.org/issue12321 #12317: inspect.getabsfile() is not documented http://bugs.python.org/issue12317 #12315: Improve http.client.HTTPResponse.read documentation http://bugs.python.org/issue12315 #12303: expose sigwaitinfo() and sigtimedwait() in the signal module http://bugs.python.org/issue12303 #12297: Clarifications to atexit.register and unregister doc http://bugs.python.org/issue12297 #12296: Minor clarification in devguide http://bugs.python.org/issue12296 #12295: Fix ResourceWarning in turtledemo help window http://bugs.python.org/issue12295 #12294: multiprocessing.Pool: Need a way to find out if work are finis http://bugs.python.org/issue12294 Most recent 15 issues waiting for review (15) ============================================= #12350: Improve stat_result.st_blocks and st_blksize documentation http://bugs.python.org/issue12350 #12344: Add **kwargs to get_reinitialized_command http://bugs.python.org/issue12344 #12341: Some additions to .hgignore http://bugs.python.org/issue12341 #12328: multiprocessing's overlapped PipeConnection on Windows http://bugs.python.org/issue12328 #12315: Improve http.client.HTTPResponse.read documentation http://bugs.python.org/issue12315 #12313: make install misses test dirs for packaging and email modules http://bugs.python.org/issue12313 #12308: Add link to PEP 0 for topical index in wiki http://bugs.python.org/issue12308 #12306: zlib: Expose zlibVersion to query runtime version of zlib http://bugs.python.org/issue12306 #12304: expose signalfd(2) in the signal module http://bugs.python.org/issue12304 #12297: Clarifications to atexit.register and unregister doc http://bugs.python.org/issue12297 #12296: Minor clarification in devguide http://bugs.python.org/issue12296 #12295: Fix ResourceWarning in turtledemo help window http://bugs.python.org/issue12295 #12291: file written using marshal in 3.2 can be read by 2.7, but not http://bugs.python.org/issue12291 #12290: __setstate__ is called for false values http://bugs.python.org/issue12290 #12289: http.server.CGIHTTPRequestHandler doesn't check if a Python sc http://bugs.python.org/issue12289 Top 10 most discussed issues (10) ================================= #11610: Improved support for abstract base classes with descriptors http://bugs.python.org/issue11610 15 msgs #12313: make install misses test dirs for packaging and email modules http://bugs.python.org/issue12313 13 msgs #12326: Linux 3: tests should avoid using sys.platform == 'linux2' http://bugs.python.org/issue12326 12 msgs #12343: ssl documentation needs comments about non-blocking behaviour http://bugs.python.org/issue12343 12 msgs #12281: bytes.decode('mbcs', 'ignore') does replace undecodable bytes http://bugs.python.org/issue12281 9 msgs #11553: Docs for: import, packages, site.py, .pth files http://bugs.python.org/issue11553 7 msgs #12167: test_packaging reference leak http://bugs.python.org/issue12167 7 msgs #12287: ossaudiodev: stack corruption with FD >= FD_SETSIZE http://bugs.python.org/issue12287 7 msgs #12328: multiprocessing's overlapped PipeConnection on Windows http://bugs.python.org/issue12328 7 msgs #9302: distutils API Reference: setup() and Extension parameters' des http://bugs.python.org/issue9302 6 msgs Issues closed (26) ================== #9284: inspect.findsource() cannot find source for doctest code http://bugs.python.org/issue9284 closed by python-dev #10457: "Related help topics" shown outside pager http://bugs.python.org/issue10457 closed by eric.araujo #11595: Miscellaneous bugs in cfg_to_args() utility function http://bugs.python.org/issue11595 closed by eric.araujo #12009: netrc module crashes if netrc file has comment lines http://bugs.python.org/issue12009 closed by python-dev #12084: os.stat() on windows doesn't consider relative symlink http://bugs.python.org/issue12084 closed by brian.curtin #12133: ResourceWarning in urllib.request http://bugs.python.org/issue12133 closed by haypo #12206: Documentation Std. Library 15.7.5 "LogRecord objects": Paramet http://bugs.python.org/issue12206 closed by python-dev #12240: Allow multiple setup_hooks http://bugs.python.org/issue12240 closed by eric.araujo #12246: Warn when trying to install third-party module from an uninsta http://bugs.python.org/issue12246 closed by eric.araujo #12248: __dir__ semantics changed in Python 2.7.2 http://bugs.python.org/issue12248 closed by benjamin.peterson #12310: Segfault in test_multiprocessing http://bugs.python.org/issue12310 closed by haypo #12316: test_signal: test_sigwait_thread failure on FreeBSD 6.4 buildb http://bugs.python.org/issue12316 closed by haypo #12318: list + tuple inconsistency http://bugs.python.org/issue12318 closed by rhettinger #12320: test_packaging failures http://bugs.python.org/issue12320 closed by haypo #12324: [3.2] sorted(big dict) http://bugs.python.org/issue12324 closed by mark.dickinson #12325: regex matches incorrectly on literal dot (99.9% confirmed) http://bugs.python.org/issue12325 closed by r.david.murray #12329: XHTML entity apos missing in htmlentitydefs http://bugs.python.org/issue12329 closed by eric.araujo #12330: Named set methods on collections.Set and dict view objects http://bugs.python.org/issue12330 closed by Julian #12332: Float division http://bugs.python.org/issue12332 closed by benjamin.peterson #12333: test_packaging failures under Solaris http://bugs.python.org/issue12333 closed by haypo #12334: Strange sort error http://bugs.python.org/issue12334 closed by rengel #12339: logging.Formatter.format() assumes exception to support str() http://bugs.python.org/issue12339 closed by vinay.sajip #12345: Add math.tau http://bugs.python.org/issue12345 closed by pitrou #12349: Typo in 3.2 "What's New": WGSI / WSGI http://bugs.python.org/issue12349 closed by sandro.tosi #12351: Update URL for pycrypto project http://bugs.python.org/issue12351 closed by python-dev #1711800: SequenceMatcher bug with insert/delete block after "replace" http://bugs.python.org/issue1711800 closed by terry.reedy

1 0

Lazy unpacking for struct module
by Lukas Lueg 17 Jun '11

17 Jun '11

Hi. We extensively use the struct module to crunch large amounts of binary data. There are basically two operations for us that only seem to the naked eye as one: Filtering (see if certain fields have certain values, throw everything away if not) and inspection (care about all the fields' values). The filtering-part is very important as most of the binary data can actually be thrown away and never have to be inspected any further. When thinking about how to increase performance, one thought was that a lot of objects are generated by the struct module that we never need: Unpacking six fields in order to look at one and then throwing everything away is inefficient concerning the five other fields. It also makes filtering and inspecting basically the same operation regarding the (slow) unpacking of values so we don't really benefit from filtering. This is a huge problem when crunching gigabytes of data and creating millions of fields. One solution to this is using two format-strings instead of only one (e.g. '4s4s i 4s2s2s'): One that unpacks just the filtered fields (e.g. '8x i 8x') and one that unpacks all the fields except the one already created by the filter (e.g. '4s4s 4x 4s2s2s'). This solution works very well and increases throughput by far. It however also creates complexity in the code as we have to keep track and combine field-values that came from the filtering-part with the ones unpacked during inspection-part (we don't want to simply unpack twice). I'd like to propose an enhancement to the struct module that should solve this dilemma and ask for your comments. The function s_unpack_internal() inside _struct.c currently unpacks all values from the buffer-object passed to it and returns a tuple holding these values. Instead, the function could create a tuple-like object that holds a reference to it's own Struct-object (which holds the format) and a copy of the memory it is supposed to unpack. This object allows access to the unpacked values through the sequence protocol, basically unpacking the fields if - and only if - accessed through sq_item (e.g. foo = struct.unpack('2s2s', 'abcd'); foo[0] == 'ab'). The object can also unpack all fields only once (as all unpacked objects are immutable, we can hold references to them and return these instead once known). This approach is possible because there are no further error conditions inside the unpacking-functions that we would *have* to deal with at the time .unpack() is called; in other words: Unpacking can't fail if the format-string's syntax had been correct and can therefor be deferred (while packing can't). I understand that this may seem like a single-case-optimization. We can however assume that most people will benefit from the new behavior unknowingly while everyone else takes now harm: The object mimicking the otherwise returned tuple is immutable (therefor it's not suddenly part of GC) and the memory overhead caused by holding references to the original memory a little longer (reclaimed after the result becomes unreachable) should be comparable to the memory used by unneeded fields (reclaimed directly after creation). I'd like to hear your thoughts and am perfectly willing to provide a patch if it has a chance of inclusion. Best regards Lukas

6 10

Re: [Python-Dev] [Python-checkins] cpython (3.2): Fix typo.
by Nick Coghlan 17 Jun '11

17 Jun '11

On Fri, Jun 17, 2011 at 7:33 AM, raymond.hettinger <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/0fe3b81c7c89 > changeset: 70822:0fe3b81c7c89 > branch: 3.2 > parent: 70819:8a9d25804c3d > user: Raymond Hettinger <python(a)rcn.com> > date: Thu Jun 16 22:32:10 2011 +0100 > summary: > Fix typo. > > files: > Doc/whatsnew/3.2.rst | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > > > diff --git a/Doc/whatsnew/3.2.rst b/Doc/whatsnew/3.2.rst > --- a/Doc/whatsnew/3.2.rst > +++ b/Doc/whatsnew/3.2.rst > @@ -385,7 +385,7 @@ > ===================================================== > > This informational PEP clarifies how bytes/text issues are to be handled by the > -WGSI protocol. The challenge is that string handling in Python 3 is most > +WSGI protocol. The challenge is that string handling in Python 3 is most > conveniently handled with the :class:`str` type even though the HTTP protocol > is itself bytes oriented. Ah, the cognitive scientist in me *loves* diffs like this one. Even *knowing* there's a typo on the line, it's still hard to spot :) Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

1 0

Buildbot status web pages
by David Bolen 16 Jun '11

16 Jun '11

I've been receiving 503 errors from the buildbot web status pages beneath www.python.org/dev/buildbot for a day or two now - is there perhaps something that needs a bit of a kick-start? Thanks. -- David

1 0

Python language summit on ustream.tv
by M.-A. Lemburg 16 Jun '11

16 Jun '11

Dear Python Developers, for the upcoming language summit at EuroPython, I'd like to try out whether streaming such meetings would work. I'll setup a webcam and stream the event live to a private channel on ustream.tv. These are the details in case you want to watch: URL: http://www.ustream.tv/channel/python-language-summit PWD: fpmUtuL4 Date: Sunday, 2011-06-19 Time: 10:00 - 16:00 CEST with breaks I'm not sure whether I can stream the whole summit, but at least the morning session should be possible, provided the network works on that day. Interaction will likely be a bit difficult in case we have heated discussions :-), but we'll keep the IRC channel #python-language-summit on freenode open as well. Thanks, -- Marc-Andre Lemburg eGenix.com Professional Python Services directly from the Source (#1, Jun 16 2011) >>> Python/Zope Consulting and Support ... http://www.egenix.com/ >>> mxODBC.Zope.Database.Adapter ... http://zope.egenix.com/ >>> mxODBC, mxDateTime, mxTextTools ... http://python.egenix.com/ ________________________________________________________________________ 2011-05-23: Released eGenix mx Base 3.2.0 http://python.egenix.com/ 2011-05-25: Released mxODBC 3.1.1 http://python.egenix.com/ 2011-06-20: EuroPython 2011, Florence, Italy 4 days to go ::: Try our new mxODBC.Connect Python Database Interface for free ! :::: eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg Registered at Amtsgericht Duesseldorf: HRB 46611 http://www.egenix.com/company/contact/

1 0

Some additions to .hgignore
by Sandro Tosi 15 Jun '11

15 Jun '11

Hi all, following http://docs.python.org/devguide/coverage.html doc you'll end up with several "new" files/dirs in your checkout: - .coverage, used by coveragepy to save its info - coverage/ , the symlink to coveragepy/coverage - htmlcov/ , the dir where the coverage HTML pages are written I think they should be added to .hgignore so that hg st won't show them. I'm writing here since I don't think an issue is needed for such matter, if that's not the case, I apologize. Regards, -- Sandro Tosi (aka morph, morpheus, matrixhasu) My website: http://matrixhasu.altervista.org/ Me at Debian: http://wiki.debian.org/SandroTosi

2 2

pysetup as a top script
by Tarek Ziadé 15 Jun '11

15 Jun '11

Hello If no one objects, I'll promote Tools/scripts/pysetup3 to a top level script that gets installed in scripts/ like 2to3, pydoc etc.. That way, people will be able to use it directly when installing, removing projects, or studying what's installed Cheers Tarek -- Tarek Ziadé | http://ziade.org

3 3