Mailman 3 March 2006 - Python-Dev

Discussing the Great Library Reorganization
by Brett Cannon 30 Mar '06

30 Mar '06

While this is going to require a PEP (which I am willing to write), the discussion of adding pysqlite has brought forth some discussion on naming and packaging in the stdlub. Perhaps it's time to start discussing the Great Library Reorganization that has been discussed for eons. Here is a place I think we can take a queue from Java. I think we should have a root package, 'py', and then have subpackages within that. Those subpackages would group the existing modules that are not already in a nice package hierarchy. In other words, try to make it so that importing an actual module takes no more than three dots in the general case: ``from py.dev import pdb``, etc. I do think it is okay to put things without proper classification just under 'py' without being in a subpackage. The three dots idea is not hard. We could, for instance, have a py.dist subpackage and have pkgutil and distutils under it. That will make the modules in distutils take four dots, but that's just life and I think within reason for something that is not used directly by a large number of people. I also have no issue taking certain names from existing modules and making them both a module directly (as in putting what exists in a module into __init__.py for the subpackage with the same name) on top of putting more modules in the subpackage. The issue I see with this, though, is people doing something like ``from py import pickle; pickle.pickletools.dis()``, not realizing they need to import pickletools directly instead of getting to it through py.pickle . I don't want to spark a subpackage grouping discussion yet since we should decide on a general strategy of how we want the basic stdlib organized. I also don't want to argue over module renaming directly since that can be based on what subpackages there might be. -Brett

9 12

Re: [Python-Dev] pysqlite for 2.5?
by Delaney, Timothy (Tim) 30 Mar '06

30 Mar '06

Anthony Baxter wrote: > My only concern about this is that it wouldn't be possible for other > authors to provide 3rd party packages as (for instance) db.mysqldb > because of the way package importing works. And I'd prefer > 'database.sqlite' rather than 'db.sqlite'. Perhaps dbapi2.sqlite? Tim Delaney

1 0

RELEASED Python 2.4.3, final.
by Anthony Baxter 30 Mar '06

30 Mar '06

On behalf of the Python development team and the Python community, I'm happy to announce the release of Python 2.4.3 (final). Python 2.4.3 is a bug-fix release. See the release notes at the website (also available as Misc/NEWS in the source distribution) for details of the more than 50 bugs squished in this release, including a number found by the Coverity Scan project. Assuming no major bugs pop up, the next release of Python will be Python 2.5 (alpha 1), with a final 2.4.4 release of Python shortly after the final version of Python 2.5. The release plan for Python 2.5 is documented in PEP-0356. For more information on Python 2.4.3, including download links for various platforms, release notes, and known issues, please see: http://www.python.org/2.4.3/ Highlights of this new release include: - Bug fixes. According to the release notes, at least 50 have been fixed. - A small number of bugs, regressions and reference leaks have been fixed since Python 2.4.3 release candidate 1. See NEWS.txt for more. Highlights of the previous major Python release (2.4) are available from the Python 2.4 page, at http://www.python.org/2.4/highlights.html Enjoy this new release, Anthony Anthony Baxter anthony(a)python.org Python Release Manager (on behalf of the entire python-dev team)

1 0

Re: [Python-Dev] pysqlite for 2.5?
by Robert Brewer 30 Mar '06

30 Mar '06

Martin v. Löwis wrote: > Guido van Rossum wrote: > > Unless you've recanted on that already, let me point out that I've > > never seen sqlite, and I've ignored this thread, so I don't > know what > > the disagreement is all about. Perhaps one person in favor and one > > person against could summarize the argument for me? Otherwise I'll > > have to go with "no" just to err on the side of safety. I > have strong > > feelings about the language. Sometimes I have strong feelings about > > the library. This doesn't seem to be one of those cases though... > > Let me try to take both sides simultaneously: > > For: would add an SQL library to the standard distribution, and one > that doesn't depend on additional infrastructure on the target machine > (such as an existing database server); the author of that library is > fine with including it in Python > > Against: Adds work-load on the release process, adding more libraries > to the already-large list of new libraries for 2.5. Choice of naming > things is ad-hoc, but gets cast in stone by the release; likewise, > choice of specific SQL library might inhibit addition of different > libraries later. More Against?: Explaining "database is locked" errors (due to SQLite's exposed multiple-readers/one-writer design) on a daily basis (FAQ entries notwithstanding). Robert Brewer System Architect Amor Ministries fumanchu(a)amor.org

2 1

What about PEP 299?
by Georg Brandl 30 Mar '06

30 Mar '06

Hi, since I found myself writing "if __name__ == '__main__'" often these days, I wondered whether PEP 299 could be pronounced upon. I'm not proposing putting it into 2.5, but it should be relatively small a change. Cheers, Georg

6 11

Re: [Python-Dev] [Python-3000] Iterators for dict keys, values, and items == annoying :)
by Robert Brewer 30 Mar '06

30 Mar '06

Nick Coghlan wrote: > There are three big use cases: > > dict.keys > dict.values > dict.items > > Currently these all return lists, which may be expensive in > terms of copying. They all have iter* variants which while > memory efficient, are far less convenient to work with. I'm still wondering what "far less convenient" means. Is it simply the 4 extra key presses? I find the iter* variants to be a great solution. Robert Brewer System Architect Amor Ministries fumanchu(a)amor.org

1 0

Re: [Python-Dev] pysqlite for 2.5?
by Michael Chermside 29 Mar '06

29 Mar '06

Gerhard Häring writes: > db.sql.sqlite is another possibility, if adding something like Durus or > ZODB in the same top-level namespace could be considered for 2.6. Flat is better than nested. I see no reason why we couldn't have all of this: database.sqllite database.zodb database.duras database.oracle there's no need to group the SQL databases. -- Michael Chermside

2 1

Weekly Python Patch/Bug Summary
by Kurt B. Kaiser 29 Mar '06

29 Mar '06

Patch / Bug Summary ___________________ Patches : 389 open ( -3) / 3117 closed (+23) / 3506 total (+20) Bugs : 901 open ( -6) / 5687 closed (+41) / 6588 total (+35) RFE : 214 open ( +1) / 206 closed ( +4) / 420 total ( +5) New / Reopened Patches ______________________ Minimalist fix for bug 1446847 (2006-03-17) CLOSED http://python.org/sf/1452332 opened by Nick Coghlan N-d array interface for array object (2006-03-17) http://python.org/sf/1452906 opened by Alexander Belopolsky IDNA codec simplification (2006-03-18) http://python.org/sf/1453235 opened by Walter Dörwald popen2 new parameter and setpgid (2006-03-20) CLOSED http://python.org/sf/1454425 opened by Oskar Anderö 2 Tools for easy inter-thread communication->Queue,threading (2006-03-20) http://python.org/sf/1454452 opened by kxroberto Make thread stack size runtime tunable (2006-03-20) http://python.org/sf/1454481 opened by Andrew I MacIntyre patch for SIGSEGV in arraymodule.c (2006-03-20) http://python.org/sf/1454485 reopened by tbmetin patch for SIGSEGV in arraymodule.c (2006-03-20) http://python.org/sf/1454485 opened by Baris Metin Use dlopen() to load extensions on Darwin, where possible (2006-03-20) http://python.org/sf/1454844 opened by Zach Pincus patch for mbcs codecs (2006-03-22) http://python.org/sf/1455898 opened by ocean-city timestamp() method for datetime objects (2006-03-23) CLOSED http://python.org/sf/1457227 opened by Chris AtLee Support different GPG keys in upload --sign (2006-03-23) http://python.org/sf/1457316 opened by Stefan Behnel patch for building trunk with VC6 (2006-03-24) http://python.org/sf/1457736 opened by ocean-city floor division (2006-03-25) CLOSED http://python.org/sf/1458419 opened by Andy Improved PySet C API (2006-03-25) CLOSED http://python.org/sf/1458476 opened by Barry A. Warsaw Mutable Iterators PEP (2006-03-26) http://python.org/sf/1459011 opened by Adam DePrince Install PKG-INFO with packages (2006-03-27) http://python.org/sf/1459476 opened by Phillip J. Eby Add docs for zlib.decompressobj.flush optional param (2006-03-27) CLOSED http://python.org/sf/1459630 opened by Chris AtLee Update docs for zlib.decompressobj.flush() (2006-03-27) http://python.org/sf/1459631 opened by Chris AtLee convenient Message.as_string to use mangle_from_=unixfrom ? (2006-03-28) http://python.org/sf/1459867 opened by kxroberto Patches Closed ______________ PEP 338 implementation (2006-02-11) http://python.org/sf/1429601 closed by ncoghlan patch for 1441408 compiler fails to spot extended slice (2006-03-10) http://python.org/sf/1446847 closed by ncoghlan Minimalist fix for bug 1441408 (2006-03-17) http://python.org/sf/1452332 closed by ncoghlan PEP 338 documentation (2006-02-11) http://python.org/sf/1429605 closed by ncoghlan error checking after PyXXX_New (2006-03-08) http://python.org/sf/1445505 closed by gbrandl audioop - alaw encoding/decoding added, code updated (2005-07-02) http://python.org/sf/1231053 closed by anthonybaxter Method for cell objects to access contents (2005-03-25) http://python.org/sf/1170323 closed by gbrandl Incremental codecs for CJKCodecs (2006-03-05) http://python.org/sf/1443155 closed by perky A wait4() implementation (2005-09-30) http://python.org/sf/1309579 closed by nnorwitz Make itertools.tee participate in GC (2006-03-06) http://python.org/sf/1444398 closed by twouters more leaky, leaky (2006-03-07) http://python.org/sf/1445431 closed by nnorwitz Some fixes for the binary distribution builder (2005-12-14) http://python.org/sf/1380777 closed by ronaldoussoren popen2 new parameter and setpgid (2006-03-20) http://python.org/sf/1454425 closed by oskar_andero CALL_ATTR opcode (2003-03-26) http://python.org/sf/709744 closed by twouters FreeBSD is system scope threads capable (2006-01-04) http://python.org/sf/1396919 closed by perky timestamp() method for datetime objects (2006-03-23) http://python.org/sf/1457227 closed by gvanrossum Add method to function objects to simplify decoration (2005-03-12) http://python.org/sf/1161819 closed by ncoghlan Simplify using Queues with consumer threads (2006-03-21) http://python.org/sf/1455676 closed by rhettinger floor division (2006-03-25) http://python.org/sf/1458419 closed by nnorwitz Improved PySet C API (2006-03-25) http://python.org/sf/1458476 closed by gvanrossum Add docs for zlib.decompressobj.flush optional param (2006-03-27) http://python.org/sf/1459630 closed by gbrandl New / Reopened Bugs ___________________ xmlrpclib.py problem solved (2006-03-17) CLOSED http://python.org/sf/1452174 opened by varun bhansaly htmllib doesn't properly substitute entities (2006-03-17) http://python.org/sf/1452246 opened by Helmut Grohne broken string on mbcs (2006-03-18) CLOSED http://python.org/sf/1452697 opened by ocean-city Defining a class with __dict__ brakes attributes assignment (2006-03-11) CLOSED http://python.org/sf/1448042 reopened by gbrandl Unexpected module reloading (2006-03-18) CLOSED http://python.org/sf/1453145 opened by Ali Gholami Rudi try-except-finally in the tutorial (2006-03-19) CLOSED http://python.org/sf/1453570 opened by George Yoshida conditional expression documentation missing/incorrect (2006-03-19) CLOSED http://python.org/sf/1453579 opened by Alan makesetup fails to tolerate valid linker options (2006-03-20) http://python.org/sf/1454227 opened by Jeff Blaine test_parsedate_acceptable_to_time_functions+DST = :-( (2006-03-20) http://python.org/sf/1454285 opened by Anthony Baxter Explanation of pow() in lib (2006-03-20) CLOSED http://python.org/sf/1454855 opened by Christoph Zwerschke import email fails (2006-03-20) CLOSED http://python.org/sf/1454912 opened by Sjoerd Mullender Incompatible size for long (int) in Python Win and Linux? (2006-03-21) CLOSED http://python.org/sf/1455357 opened by Michael Yanowitz pyport.h freebsd inconsistent (2006-03-21) CLOSED http://python.org/sf/1455641 opened by Jim Jewett Simplify use of Queues with consumer threads (2006-03-21) CLOSED http://python.org/sf/1455676 opened by Raymond Hettinger dictobject.c:dictresize() vulnerability (2006-03-22) http://python.org/sf/1456209 opened by Armin Rigo Traceback error when compiling Regex (2006-03-22) http://python.org/sf/1456280 opened by Wolfgang Grafen sliceobject ssize_t (and index) not completed (2006-03-22) http://python.org/sf/1456470 opened by Jim Jewett PEP Links broken on new website (2006-03-22) CLOSED http://python.org/sf/1456609 opened by Grant Olson round not rounding correctly (2006-03-23) CLOSED http://python.org/sf/1456775 opened by Norbert Sebok Unifying pickle and cPickle exception class hierarchies (2006-03-23) http://python.org/sf/1457119 opened by Ori Peleg urllib.splithost parses incorrectly (2006-03-23) CLOSED http://python.org/sf/1457264 opened by Steve AttributeError in upload_file on interrupted connection (2006-03-23) http://python.org/sf/1457312 opened by Stefan Behnel floor division not documented (2006-03-23) CLOSED http://python.org/sf/1457358 opened by Christoph Zwerschke byext.py errors (2006-03-23) CLOSED http://python.org/sf/1457411 opened by Jeff Lowery regs attribute on regex objects not documented (2006-03-24) CLOSED http://python.org/sf/1457470 opened by Jeff Lowery Malloc error on MacOSX/imaplib (2006-03-24) http://python.org/sf/1457783 opened by Andreas Jung cgi.FormContentDict constructor should support parse options (2006-03-25) http://python.org/sf/1457823 opened by John Belmonte Log._log needs to be more forgiving... (2006-03-24) http://python.org/sf/1458017 opened by Skip Montanaro sys.maxint should be mentioned in explanation of int type (2006-03-25) CLOSED http://python.org/sf/1458220 opened by Christoph Zwerschke lambda with a parenthesized argument raises TypeError (2006-03-27) CLOSED http://python.org/sf/1458903 opened by Jeong-Min Lee -Q warn option is still not default in 2.4 (2006-03-26) CLOSED http://python.org/sf/1458927 opened by Christoph Zwerschke Doubled backslash in repr() method for unicode (2006-03-27) CLOSED http://python.org/sf/1459029 opened by Christoph Zwerschke missing links beetween strftime()'s... (2006-03-27) CLOSED http://python.org/sf/1459103 opened by Jens Diemer inspect.getargspec() is wrong for def foo((x)): (2006-03-27) http://python.org/sf/1459159 opened by Neal Norwitz sgmllib.SGMLparser and hexadecimal numeric character refs (2006-03-27) http://python.org/sf/1459279 opened by Francesco Ricciardi time.timezone / time.strftime('%z') problem (2006-03-27) CLOSED http://python.org/sf/1459642 opened by Simon Lanzmich sets.Set can't be subclassed (2006-03-28) CLOSED http://python.org/sf/1459733 opened by Michal Kwiatkowski test suite should pass with -Qnew ? (2006-03-28) CLOSED http://python.org/sf/1459808 opened by Anthony Baxter urllib2 changes header names (2006-03-28) CLOSED http://python.org/sf/1459963 opened by Michael Vert random.sample can raise KeyError (2006-03-29) http://python.org/sf/1460340 opened by paul rubin Bugs Closed ___________ make frameworkinstall fails on Intel Macs (2006-03-10) http://python.org/sf/1447607 closed by gbrandl xmlrpclib.py problem solved (2006-03-17) http://python.org/sf/1452174 deleted by gbrandl bug with xmlrpclib (2006-03-09) http://python.org/sf/1446690 closed by gbrandl asyncore dispatcher.__getattr__() masks self._map (2006-03-13) http://python.org/sf/1448639 closed by gbrandl svn head compiler fails to spot extended slicing (2006-03-02) http://python.org/sf/1441408 closed by ncoghlan (XMLRPC) multitude of sockets ending up in TIME_WAIT (2005-02-25) http://python.org/sf/1151968 closed by gbrandl README build instructions for fpectl (2004-01-07) http://python.org/sf/872175 closed by gbrandl Built-in compile function with PEP 0263 encoding bug (2005-02-03) http://python.org/sf/1115379 closed by nnorwitz broken string on mbcs (2006-03-18) http://python.org/sf/1452697 deleted by ocean-city Defining a class with __dict__ brakes attributes assignment (2006-03-11) http://python.org/sf/1448042 closed by gbrandl Python drops core when stdin is bogus (2005-11-10) http://python.org/sf/1353504 closed by gbrandl Inconsistency between StringIO and cStringIO (2006-01-27) http://python.org/sf/1416477 closed by gbrandl optparse docs double-dash confusion (2006-02-16) http://python.org/sf/1432838 closed by gbrandl Http redirection error in urllib2.py (2005-11-10) http://python.org/sf/1353433 closed by gbrandl Unexpected module reloading (2006-03-18) http://python.org/sf/1453145 closed by loewis try-except-finally in the tutorial (2006-03-19) http://python.org/sf/1453570 closed by gbrandl conditional expression documentation missing/incorrect (2006-03-19) http://python.org/sf/1453579 closed by gbrandl shelve/bsddb crash on db close (2005-06-26) http://python.org/sf/1227955 closed by nnorwitz Explanation of pow() in lib (2006-03-20) http://python.org/sf/1454855 closed by rhettinger import email fails (2006-03-20) http://python.org/sf/1454912 closed by bwarsaw Incompatible size for long (int) in Python Win and Linux? (2006-03-21) http://python.org/sf/1455357 closed by perky pyport.h freebsd inconsistent (2006-03-22) http://python.org/sf/1455641 closed by perky problems with too many sockets in FreeBSD (2006-03-11) http://python.org/sf/1448058 closed by nnorwitz PEP Links broken on new website (2006-03-23) http://python.org/sf/1456609 closed by gbrandl Pointer freed twice in Py_InitializeEx() (03/07/06) http://python.org/sf/1444893 closed by sf-robot Popen4 wait() fails sporadically with threads (2005-04-15) http://python.org/sf/1183780 closed by loewis Python 2.2.3 crashes using popen2 to spawn lots of children (2004-01-28) http://python.org/sf/886492 closed by nnorwitz round not rounding correctly (2006-03-23) http://python.org/sf/1456775 closed by gbrandl urllib.splithost parses incorrectly (2006-03-23) http://python.org/sf/1457264 closed by gbrandl floor division not documented (2006-03-23) http://python.org/sf/1457358 closed by nnorwitz byext.py errors (2006-03-23) http://python.org/sf/1457411 closed by nnorwitz regs attribute on regex objects not documented (2006-03-24) http://python.org/sf/1457470 closed by gbrandl build doesn't pick up bsddb w/Mandrake 9.2 (2004-09-23) http://python.org/sf/1033390 closed by nnorwitz sys.maxint should be mentioned in explanation of int type (2006-03-25) http://python.org/sf/1458220 closed by gbrandl lambda with a parenthesized argument raises TypeError (2006-03-26) http://python.org/sf/1458903 closed by nnorwitz -Q warn option is still not default in 2.4 (2006-03-26) http://python.org/sf/1458927 closed by gbrandl Doubled backslash in repr() method for unicode (2006-03-27) http://python.org/sf/1459029 closed by anthonybaxter missing links beetween strftime()'s... (2006-03-27) http://python.org/sf/1459103 closed by gbrandl time.timezone / time.strftime('%z') problem (2006-03-27) http://python.org/sf/1459642 closed by gbrandl sets.Set can't be subclassed (2006-03-28) http://python.org/sf/1459733 closed by gbrandl test suite should pass with -Qnew ? (2006-03-28) http://python.org/sf/1459808 closed by gbrandl urllib2 changes header names (2006-03-28) http://python.org/sf/1459963 closed by gbrandl New / Reopened RFE __________________ sys.setatomicexecution - for critical sections (2006-03-18) http://python.org/sf/1453341 opened by kxroberto addheaders for urlopen / open / xxxx_open (2006-03-19) http://python.org/sf/1453973 opened by kxroberto Make more out of 'as' : general ad-hoc right-assignment (2006-03-20) CLOSED http://python.org/sf/1454344 opened by kxroberto Python space syntax & pythonic long lambda's (2006-03-20) CLOSED http://python.org/sf/1454364 opened by kxroberto RFE Closed __________ Missing 4 socket object properties (2002-06-12) http://python.org/sf/567972 closed by gbrandl Constructor for counting things (2003-05-17) http://python.org/sf/739029 closed by gbrandl Make more out of 'as' : general ad-hoc right-assignment (2006-03-20) http://python.org/sf/1454344 closed by gbrandl Python space syntax & pythonic long lambda's (2006-03-20) http://python.org/sf/1454364 closed by gbrandl

1 0

Re: [Python-Dev] PySet API
by Raymond Hettinger 29 Mar '06

29 Mar '06

>> Thank would be nice. It gives me the ability to keep a clean, sane API while >> at >> the same time making sure that my most important customer (Barry) gets his >> needs >> met. > I'm having a hard time deciphering whether you're being condescending or > trying to be funny. I'm going to go with the latter. Good one! :) Neither. I was serious. You are a principal customer for setobjects. It seems that you make extensive use of them in your code. While I don't favor the proposed API, I think is essential that you not be left hanging without good options. Raymond

3 2

Re: [Python-Dev] [Python-checkins] r43358 - python/trunk/Modules/itertoolsmodule.c
by Thomas Wouters 29 Mar '06

29 Mar '06

On 3/27/06, Raymond Hettinger <raymond.hettinger(a)verizon.net> wrote: > > > Modified: > > python/trunk/Modules/itertoolsmodule.c > > Log: > > > > Make itertools.tee and its internal teedataobject participate in GC. > This > > alone does not solve the leak in test_generators, unfortunately, but it > is > > part of test_generators' problem and it does solve other cycles. > > Thanks for getting this in. > > To get the leak in test_generators, I think you make need to add GC to the > teeobject as well as the teedataobject. The teeobject has GC (hence the word 'and' in 'itertools.tee and its internal teedataobject' ;-) The problem with test_generators is that this also leaks: def leak(): def gen(): while True: yield g g = gen() leak() It doesn't leak in 2.4. I'm using a little shell script to work backwards through the 2.5 changes to find out which one introduced this, although I somehow suspect it's the coroutine stuff... ;P -- Thomas Wouters <thomas(a)python.org> Hi! I'm a .signature virus! copy me into your .signature file to help me spread!

4 5