Mailman 3 June 2011 - Python-Dev

Re: [Python-Dev] [Python-checkins] devguide: Fix copy-paste glitch :)
by Nick Coghlan June 19, 2011

June 19, 2011

On Mon, Jun 20, 2011 at 12:57 AM, eric.araujo <python-checkins(a)python.org> wrote: > http://hg.python.org/devguide/rev/f55ad3dc4526 > changeset: 434:f55ad3dc4526 > user: Éric Araujo <merwok(a)netwok.org> > date: Sun Jun 19 16:56:58 2011 +0200 > summary: > Fix copy-paste glitch :) > > files: > committing.rst | 2 +- > 1 files changed, 1 insertions(+), 1 deletions(-) > … [View More]

1 0

Re: [Python-Dev] [Python-checkins] cpython: edit and rewrite
by Victor Stinner June 19, 2011

June 19, 2011

Le samedi 18 juin 2011 à 02:51 +0200, benjamin.peterson a écrit : > .. function:: dump_traceback(file=sys.stderr, all_threads=True) > > - Dump the traceback of all threads, or of the current thread if *all_threads* > - is ``False``, into *file*. > + Dump the traceback of all threads into *file*. If *all_threads* is ``True``, > + produce tracebacks for every running thread. Otherwise, dump only the current > + thread. The first sentence is confusing. I suggest: … [View More]

1 0

Re: [Python-Dev] [Python-checkins] cpython: #11781: update windows build script to account for move of email tests
by "Martin v. Löwis" June 19, 2011

June 19, 2011

>> # This should contain all non-.svn files listed in >> subversion > > Should this be mercurial Perhaps. > >> for f in os.listdir(lib.absolute): >> if f.endswith(".txt") or f==".svn":continue > > and this .hg? No. Martin

1 0

Summary of Python tracker Issues
by Python tracker June 17, 2011

June 17, 2011

ACTIVITY SUMMARY (2011-06-10 - 2011-06-17) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 2843 (+17) closed 21292 (+24) total 24135 (+41) Open issues with patches: 1244 Issues opened (29) ================== #10884: pkgutil EggInfoDistribution requirements for .egg-info metadat http://bugs.python.org/issue10884 reopened by eric.araujo #12298: … [View More]

1 0

Lazy unpacking for struct module
by Lukas Lueg June 17, 2011

June 17, 2011

Hi. We extensively use the struct module to crunch large amounts of binary data. There are basically two operations for us that only seem to the naked eye as one: Filtering (see if certain fields have certain values, throw everything away if not) and inspection (care about all the fields' values). The filtering-part is very important as most of the binary data can actually be thrown away and never have to be inspected any further. When thinking about how to increase performance, one thought … [View More]was that a lot of objects are generated by the struct module that we never need: Unpacking six fields in order to look at one and then throwing everything away is inefficient concerning the five other fields. It also makes filtering and inspecting basically the same operation regarding the (slow) unpacking of values so we don't really benefit from filtering. This is a huge problem when crunching gigabytes of data and creating millions of fields. One solution to this is using two format-strings instead of only one (e.g. '4s4s i 4s2s2s'): One that unpacks just the filtered fields (e.g. '8x i 8x') and one that unpacks all the fields except the one already created by the filter (e.g. '4s4s 4x 4s2s2s'). This solution works very well and increases throughput by far. It however also creates complexity in the code as we have to keep track and combine field-values that came from the filtering-part with the ones unpacked during inspection-part (we don't want to simply unpack twice). I'd like to propose an enhancement to the struct module that should solve this dilemma and ask for your comments. The function s_unpack_internal() inside _struct.c currently unpacks all values from the buffer-object passed to it and returns a tuple holding these values. Instead, the function could create a tuple-like object that holds a reference to it's own Struct-object (which holds the format) and a copy of the memory it is supposed to unpack. This object allows access to the unpacked values through the sequence protocol, basically unpacking the fields if - and only if - accessed through sq_item (e.g. foo = struct.unpack('2s2s', 'abcd'); foo[0] == 'ab'). The object can also unpack all fields only once (as all unpacked objects are immutable, we can hold references to them and return these instead once known). This approach is possible because there are no further error conditions inside the unpacking-functions that we would *have* to deal with at the time .unpack() is called; in other words: Unpacking can't fail if the format-string's syntax had been correct and can therefor be deferred (while packing can't). I understand that this may seem like a single-case-optimization. We can however assume that most people will benefit from the new behavior unknowingly while everyone else takes now harm: The object mimicking the otherwise returned tuple is immutable (therefor it's not suddenly part of GC) and the memory overhead caused by holding references to the original memory a little longer (reclaimed after the result becomes unreachable) should be comparable to the memory used by unneeded fields (reclaimed directly after creation). I'd like to hear your thoughts and am perfectly willing to provide a patch if it has a chance of inclusion. Best regards Lukas [View Less]

6 10

Re: [Python-Dev] [Python-checkins] cpython (3.2): Fix typo.
by Nick Coghlan June 17, 2011

June 17, 2011

On Fri, Jun 17, 2011 at 7:33 AM, raymond.hettinger <python-checkins(a)python.org> wrote: > http://hg.python.org/cpython/rev/0fe3b81c7c89 > changeset: 70822:0fe3b81c7c89 > branch: 3.2 > parent: 70819:8a9d25804c3d > user: Raymond Hettinger <python(a)rcn.com> > date: Thu Jun 16 22:32:10 2011 +0100 > summary: > Fix typo. > > files: > Doc/… [View More]

1 0

Buildbot status web pages
by David Bolen June 16, 2011

June 16, 2011

I've been receiving 503 errors from the buildbot web status pages beneath www.python.org/dev/buildbot for a day or two now - is there perhaps something that needs a bit of a kick-start? Thanks. -- David

1 0

Python language summit on ustream.tv
by M.-A. Lemburg June 16, 2011

June 16, 2011

Dear Python Developers, for the upcoming language summit at EuroPython, I'd like to try out whether streaming such meetings would work. I'll setup a webcam and stream the event live to a private channel on ustream.tv. These are the details in case you want to watch: URL: http://www.ustream.tv/channel/python-language-summit PWD: fpmUtuL4 Date: Sunday, 2011-06-19 Time: 10:00 - 16:00 CEST with breaks I'm not sure whether I can stream the whole summit, but at least the morning session should … [View More]

1 0

Some additions to .hgignore
by Sandro Tosi June 15, 2011

June 15, 2011

Hi all, following http://docs.python.org/devguide/coverage.html doc you'll end up with several "new" files/dirs in your checkout: - .coverage, used by coveragepy to save its info - coverage/ , the symlink to coveragepy/coverage - htmlcov/ , the dir where the coverage HTML pages are written I think they should be added to .hgignore so that hg st won't show them. I'm writing here since I don't think an issue is needed for such matter, if that's not the case, I apologize. Regards, -- Sandro … [View More]

2 2

pysetup as a top script
by Tarek Ziadé June 15, 2011

June 15, 2011

Hello If no one objects, I'll promote Tools/scripts/pysetup3 to a top level script that gets installed in scripts/ like 2to3, pydoc etc.. That way, people will be able to use it directly when installing, removing projects, or studying what's installed Cheers Tarek -- Tarek Ziadé | http://ziade.org

3 3