Mailman 3 March 2005 - Python-Dev

Weekly Python Patch/Bug Summary
by Kurt B. Kaiser 09 Mar '05

09 Mar '05

Patch / Bug Summary ___________________ Patches : 279 open (-24) / 2797 closed (+33) / 3076 total ( +9) Bugs : 851 open ( +2) / 4853 closed (+16) / 5704 total (+18) RFE : 173 open ( +4) / 150 closed ( +2) / 323 total ( +6) New / Reopened Patches ______________________ Fix for win32 proxy bypass support (no_proxy) in urllib(2) (2005-03-01) http://python.org/sf/1154227 opened by mullendr Fix for win32 proxy bypass support (no_proxy) in urllib(2) (2005-03-02) CLOSED http://python.org/sf/1155083 opened by mullendr exception doc updates (2005-03-03) CLOSED http://python.org/sf/1156102 opened by Michael Hudson patch for bug 1158490 (locale breakage) (2005-03-08) http://python.org/sf/1158909 opened by Wummel cookielib mis-handles RFC 2109 cookies in Netscape mode (2005-03-04) http://python.org/sf/1157027 opened by John J Lee fix for a deadlock in the logging module (2005-03-07) http://python.org/sf/1158052 opened by Sebastian Prause Names conflict with QT (on linux) (2005-03-08) http://python.org/sf/1158926 opened by CyberRan Handle corrupted gzip files with unexpected EOF (2005-03-08) http://python.org/sf/1159051 opened by Wummel cgi.py invalid REQUEST_METHOD set (2005-03-08) http://python.org/sf/1159139 opened by Joe Improve %s support for unicode (2005-03-09) http://python.org/sf/1159501 opened by Neil Schemenauer Patches Closed ______________ Reference count bug fix (2005-02-12) http://python.org/sf/1121234 closed by loewis PEP 309 reference implementation (2004-04-07) http://python.org/sf/931005 closed by rhettinger Fix for win32 proxy bypass support (no_proxy) in urllib(2) (2005-03-02) http://python.org/sf/1155083 closed by loewis Flush stdout/stderr if closed (fix for bug 1074011) (2004-11-29) http://python.org/sf/1075147 closed by loewis setup.py --help and --help-commands altered. (2005-01-17) http://python.org/sf/1104111 closed by loewis tarfile.ExFileObject iterators (2005-01-23) http://python.org/sf/1107973 closed by loewis patch for gzip.GzipFile.flush() (2005-01-26) http://python.org/sf/1110248 closed by loewis PyArg_ParseTuple problem with 'L' format (2003-04-17) http://python.org/sf/723201 closed by loewis crach link c++ extension by mingw (2004-06-29) http://python.org/sf/981773 closed by loewis Patch for Lib/bsddb/__init__.py to work with modulefinder (2005-01-31) http://python.org/sf/1112812 closed by loewis Changes to cookielib.py & friends for 2.4b1 (2004-09-16) http://python.org/sf/1028908 closed by loewis cookielib and cookies with special names (2005-02-06) http://python.org/sf/1117339 closed by loewis cookielib.LWPCookieJar incorrectly loads value-less cookies (2005-02-06) http://python.org/sf/1117454 closed by loewis Consistent retrieval of Python version. (2004-10-14) http://python.org/sf/1046831 closed by loewis allow UNIX mmap size to default to current file size (new) (2005-02-19) http://python.org/sf/1144555 closed by loewis allow UNIX mmap size to default to current file size (2003-06-06) http://python.org/sf/749830 closed by loewis better timer resolution for profile.py (2002-11-30) http://python.org/sf/645894 closed by loewis better parser error message for non-EOL following line cont. (2003-09-08) http://python.org/sf/802188 closed by loewis Updated "Working on Cygwin" section (2005-01-22) http://python.org/sf/1107221 closed by loewis Non-ascii in non-unicode __credits__ in Lib/pydoc.py (2004-08-15) http://python.org/sf/1009389 closed by mwh exception doc updates (2005-03-03) http://python.org/sf/1156102 closed by mwh support PY_LONGLONG in structmember (2005-02-02) http://python.org/sf/1115086 closed by loewis HEAD/PUT/DELETE support for urllib2.py (2005-01-28) http://python.org/sf/1111653 closed by loewis tarfile.py: fix for bug #1100429 (2005-01-16) http://python.org/sf/1103407 closed by loewis Patch for bug 1088077 (2004-12-19) http://python.org/sf/1088078 closed by loewis gcc compiler on Windows (2004-11-30) http://python.org/sf/1075887 closed by loewis tarfile: add extractall() method (2004-10-10) http://python.org/sf/1043890 closed by loewis Arrange 64bits detection for ReliantUnix (2004-05-24) http://python.org/sf/959534 closed by loewis tarfile.py enhancements (2004-03-17) http://python.org/sf/918101 closed by loewis Allow compilation of C/C++ Python extensions without MSVC (2004-05-19) http://python.org/sf/957033 closed by loewis Fix crash in xmlprase_GetInputContext in pyexpat.c (2005-02-08) http://python.org/sf/1118602 closed by loewis Minor improvement on 1116583 (2005-02-06) http://python.org/sf/1117114 closed by jjlee New / Reopened Bugs ___________________ Duplicate output with unbuffered IO after fork (2005-03-02) CLOSED http://python.org/sf/1154811 opened by Michael Aivazis getElementsbyTagName('*') in dom.minidom (2005-03-02) CLOSED http://python.org/sf/1155207 opened by bugmenot Bugs in parsedate_tz (2005-03-02) http://python.org/sf/1155362 opened by TH self.length shield exception in httplib (2005-03-03) http://python.org/sf/1155638 opened by Andrew P. Lentvorski, Jr. yield in __init__ causes broken new-style class (2005-03-03) CLOSED http://python.org/sf/1155938 opened by Steve Alexander Calls from VBScript clobber passed args (2005-03-03) http://python.org/sf/1156179 opened by Erik Rose [2.4 regression] seeking in codecs.reader broken (2005-03-03) http://python.org/sf/1156259 opened by Matthias Klose cmd.Cmd().cmdloop() can't read from file (2005-03-03) http://python.org/sf/1156280 opened by jamesthiele add documentation for __new__ (2005-03-03) CLOSED http://python.org/sf/1156412 opened by Steven Bethard doctest should support -m (2005-03-03) http://python.org/sf/1156430 opened by Ian Bicking Solaris and Python/pykota (2005-03-04) http://python.org/sf/1156441 opened by Kelly Ormsby csv Sniffer returns bad dialect? (2005-03-05) http://python.org/sf/1157169 opened by Neil Schemenauer PEP 328 and Python 2.4 error (2005-03-05) http://python.org/sf/1157255 opened by Kent Johnson pickle errors (2005-03-05) CLOSED http://python.org/sf/1157576 opened by Laxori666 RuntimeWarning: unfiltered RuntimeWarning (2005-03-06) CLOSED http://python.org/sf/1157665 opened by Grzegorz Makarewicz xml.dom.minidom.Node.removeChild() doesn't remove (2005-03-06) http://python.org/sf/1157901 opened by Matthias Kempka unixccompiler.py should deal with env in linker (2005-03-06) http://python.org/sf/1158005 opened by Edward Moy string.Template does not allow step-by-step replacements (2005-03-07) http://python.org/sf/1158231 opened by Stefan Behnel heapq should provide iterators: itersmallest, iterlargest (2005-03-07) CLOSED http://python.org/sf/1158313 opened by Stefan Behnel locale fails if LANGUAGE has multiple locales (2005-03-07) http://python.org/sf/1158490 opened by mixedpuppy --disable-unicode fails when linking (2005-03-07) CLOSED http://python.org/sf/1158607 opened by Frank Baumgart 2.4 crashes when try to exit app and mulitple threads active (2005-03-08) http://python.org/sf/1159425 opened by hugendian Bugs Closed ___________ Python 2.4.0 crashes with a segfault, EXAMPLE ATTACHED (2005-02-11) http://python.org/sf/1120452 closed by nascheme Duplicate output with unbuffered IO after fork (2005-03-01) http://python.org/sf/1154811 closed by aivazis getElementsbyTagName('*') in dom.minidom (2005-03-02) http://python.org/sf/1155207 closed by bugmenot gzip.GzipFile.flush() does not flush all internal buffers (2005-01-26) http://python.org/sf/1110242 closed by loewis Bugs in rfc822.parseaddr() (2002-03-18) http://python.org/sf/531205 closed by loewis Subtle bug in os.path.realpath on Cygwin (2003-07-09) http://python.org/sf/768419 closed by loewis uu.decode prints to stderr (2003-09-09) http://python.org/sf/803413 closed by loewis segfault in readline (2004-12-16) http://python.org/sf/1086603 closed by loewis yield in __init__ causes broken new-style class (2005-03-03) http://python.org/sf/1155938 closed by rhettinger test_subprocess is far too slow (2005-02-17) http://python.org/sf/1124637 closed by astrand subprocess example missing "stdout=PIPE" (2005-02-13) http://python.org/sf/1121579 closed by astrand TarFile iteration can break (on Windows) if file has links (2005-01-11) http://python.org/sf/1100429 closed by loewis add documentation for __new__ (2005-03-03) http://python.org/sf/1156412 closed by gward buffer problem in pyexpat.c(xmlparse_GetInputContext) (2004-03-29) http://python.org/sf/925152 closed by loewis pickle errors (2005-03-05) http://python.org/sf/1157576 closed by tim_one RuntimeWarning: unfiltered RuntimeWarning (2005-03-06) http://python.org/sf/1157665 closed by rhettinger --disable-unicode fails when linking (2005-03-07) http://python.org/sf/1158607 closed by loewis New / Reopened RFE __________________ add get_current_dir_name() to os module (2005-03-01) http://python.org/sf/1154351 opened by Michael Hoffman file() on a file (2005-03-02) http://python.org/sf/1155485 opened by Felix Lee __getattr__ and __setattr__ methods for modules (2005-03-04) http://python.org/sf/1156499 opened by Reinhold Birkenfeld RFE Closed __________ ossaudiodev object does not support common readonly attrs (2003-10-05) http://python.org/sf/818006 closed by gward heapq should provide iterators: itersmallest, iterlargest (2005-03-07) http://python.org/sf/1158313 closed by rhettinger

1 0

Urllib code or the docs appear wrong
by Skip Montanaro 09 Mar '05

09 Mar '05

It seems to me that either urllib's docs are wrong or its code is wrong w.r.t. how the User-agent header is handled. In part, the docs say: By default, the URLopener class sends a User-Agent: header of "urllib/VVV", where VVV is the urllib version number. Applications can define their own User-Agent: header by subclassing URLopener or FancyURLopener and setting the instance attribute version to an appropriate string value before the open() method is called. Looking at the code it seems to me that the User-agent header is fixed at instantiation time: version = "Python-urllib/%s" % __version__ # Constructor def __init__(self, proxies=None, **x509): ... self.addheaders = [('User-agent', self.version)] ... and that when open_http() is called, it simply calls putheader() for each element of addheaders. Setting the version instance attribute will have no effect. If I managed to add another User-agent header before open_http() was called, the request would wind up with two copies which is probably not desirable either. I can see a couple ways around this: * Just change the docs to match the current implementation. Users wishing to override the User-agent header would then have to subclass FancyURLopener and set the version class attribute. * Defer decisions about the value of the User-agent until open_http() is called. It appears the OpenerDirector class in urllib2 has a similar "early binding" problem. I don't particularly care how this is solved, but it appears to need solving. Skip

2 2

RE: [Python-Dev] LinkedHashSet/LinkedHashMap equivalents
by Delaney, Timothy C (Timothy) 09 Mar '05

09 Mar '05

Greg Ward wrote: > I'll attach another approach to the same problem, an ordered > dictionary object. I believe the semantics of > adding/readding/deleting keys is the same as java.util.LinkedHashMap > -- certainly it seems the most sensible and easy-to-implement > semantics. That's essentially the same approach I used - I didn't get around to properly implementing a doubly-linked list between the keys - I just maintained a list with the correct order. If I'm going to write a Cookbook recipe though I should probably do it properly ... Personally, I think it would be quite nice if all python dictionaries had these semantics - it would be nice to be able to say that items will be returned in the order they're inserted - but I wouldn't want to incur the additional cost in such a fundamental data structure. One thing I did notice - dict.__repr__ and dict.__str__ don't produce strings in the iteration order of subclasses - they always use the arbitrary dict iteration order. Is this intentional? Tim Delaney

1 0

Re: [Python-checkins] python/dist/src/Modules ossaudiodev.c, 1.35, 1.36
by Anthony Baxter 09 Mar '05

09 Mar '05

Greg, Um, unless I misread this, you added new attributes to the ossaudiodev objects in the 2.4 branch. Please don't do this - this is a new feature, and suddenly people who want to use those new attributes have to either test for version >= 2.4.1, or else do a hasattr test. Please see the bugfix PEP for more rationale on this... Anthony -- Anthony Baxter <anthony(a)interlink.com.au> It's never too late to have a happy childhood.

3 4

Re: Useful thread project for 2.5?
by Fazal Majid 08 Mar '05

08 Mar '05

Tim Peters wrote: > Florent's DeadlockDebugger in turn builds on an external C threadframe > module: > > http://www.majid.info/mylos/stories/2004/06/10/threadframe.html > > Folding the functionality of that (or similar functionality) into the > core would, IMO, be a valuable addition for 2.5, and would make an > excellent intro project for an aspiring contributor interested in how > threads work in CPython (what this module does is conceptually > simple). It belongs in the core because it's not safe to chase the > tstate chain without holding pystate.c's internal head_mutex lock > (holding the GIL isn't enough -- it's normal practice to call > PyThreadState_Delete() while not holding the GIL). > > I'd do it myself (and maybe I will anyway), but this really would make > a good (finite; conceptually simple) project for someone who wants to > gain Python developer experience. Since I started this, I might as well finish it. I do have some Python developer experience (hey, I even voted for comp.lang.python back when...) but not in the core interpreter itself. I suspect integrating this feature (let's call it sys._current_frames() for the sake of argument, although it probably belongs in the threads module) in the core is not going to be quite as trivial as you say, as there are potential memory leaks. If the function returns a dictionary, it should probably be a weak dict to avoid a circular reference between the frame of the thread that calls _current_frames and its locals that contain the returned dictionary. But that would also mean the references to other threads' frames are going to be weak, thus not allowing the current thread to inspect their locals and backtraces at will as those weak references may be broken. -- Fazal Majid Email: python-dev(a)fromemail.com Home: +1 415 359-0918 1111 Jones Apt. 1 Cell: +1 415 244-1337 San Francisco, CA 94109, USA Web: www.majid.info

5 7

Migrating to subversion
by "Martin v. Löwis" 08 Mar '05

08 Mar '05

I don't know whether anybody has done this before, but I just tried to run cvs2svn on the Python repository. The conversion took 7 hours, and the result is now available at http://www.dcl.hpi.uni-potsdam.de/python/branches/ Because of the load that the conversion produces on the machine, I cannot run the entire conversion every day. Reportedly, cvs2svn is able to run in incremental mode, but I haven't tried this out yet. On close inspection, you might notice a few things: - A few branches/tags are missing, namely r16b1|cnri-16-start|descr-branch|release152p1-patches|after-c all-reorg|r22a1|before-call-reorg|release16|r161|r161-branch|r16a2|release152p2 I had to manually exclude these tags, because cvs2svn complained that they (some of them) are tags on some files, and branches on other files. When I excluded these, it then complained that some other tags depend on the excluded ones, so I had to exclude these as well. I suspect that this can be fixed by modifying the CVS repository before the conversion, typically by converting the version tags to branch tags. cvs2svn did not report what files specifically caused the problems, and I don't know the proper cvs/rcs incantation to fix these. So if anybody has done that before, or knows how to, please let me know. - A few tags are useless, most notably the "vendor" branches. I think they should be excluded in the conversion. I don't know where the "unlabeled" branches come from, but they appear to be useless as well. - It has imported the CVSROOT directory as well. I don't know whether this is deliberate/useful. Anyway, this repository is now online for anonymous read-only access. Anybody interested in playing with it is welcome to do so. For those interested in server side issues: the repository is an 1.1.1 fsfs repository. The CVS repository consumes 368MiB; the SVN repository 797MiB. Regards, Martin

3 5

Documentation for __new__
by Nick Coghlan 08 Mar '05

08 Mar '05

Steven Bethard has put together some text to add __new__ to the list of Basic Customisation methods in the language reference. Would one of the documentation folks care to take a look at it? The relevant SF tracker item is http://www.python.org/sf/1156412 Regards, Nick. -- Nick Coghlan | ncoghlan(a)email.com | Brisbane, Australia --------------------------------------------------------------- http://boredomandlaziness.skystorm.net

4 5

Re: [Python-Dev] Decimal & returning NotImplemented (or not)
by Nick Coghlan 07 Mar '05

07 Mar '05

Greg Ewing wrote: > Is there some reason why Context couldn't invoke the binary > operator methods using binary operators, rather than calling > their methods directly? I had a similar idea, but then I remembered that the whole point of invoking the methods through a specific Context is to override the default context that the binary operators pick up. Cheers, Nick. -- Nick Coghlan | ncoghlan(a)email.com | Brisbane, Australia --------------------------------------------------------------- http://boredomandlaziness.skystorm.net

1 0

Failing tests: marshal, warnings
by Greg Ward 07 Mar '05

07 Mar '05

Anyone else seeing test failures on the 2.4 branch right now? I started seeing this failure: test_warnings test test_warnings failed -- Traceback (most recent call last): File "/scratch/src/python-2.4/Lib/test/test_warnings.py", line 57, in test_warn_specific_category warnings.warn(text, category) File "/scratch/src/python-2.4/Lib/warnings.py", line 57, in warn warn_explicit(message, category, filename, lineno, module, registry) File "/scratch/src/python-2.4/Lib/warnings.py", line 92, in warn_explicit raise message RuntimeWarning: unfiltered RuntimeWarning yesterday, so I "cvs up"'d today to see if it had been fixed. Now, not only is test_warnings failing, so is test_marshal: test_marshal test test_marshal failed -- Traceback (most recent call last): File "/scratch/src/python-2.4/Lib/test/test_marshal.py", line 88, in test_floats got = marshal.load(file(test_support.TESTFN, "rb")) IOError: [Errno 2] No such file or directory: '@test' Naturally, they only fail when running the full test suite. ;-( I sure hope my recent fix to textwrap isn't to blame! I'll fiddle around a bit in my working dir and see if I can figure out what's going on, but I'd like to know if I'm the only one seeing these problems... Greg -- Greg Ward <gward(a)python.net> http://www.gerg.ca/ Never underestimate the power of human stupidity.

3 7

Useful thread project for 2.5?
by Tim Peters 07 Mar '05

07 Mar '05

Florent Guillaume recently wrote a valuable addin for Zope: http://www.zope.org/Members/nuxeo/Products/DeadlockDebugger When a Zope has threads that are hung, this can give a report of Python's current state (stack trace) across all threads -- even the ones that are hung (the deadlocked threads don't have to cooperate). The same flavor of thing would (of course) be handy outside of Zope too -- debugging deadlocked Python threads is a PITA regardless of context. Florent's DeadlockDebugger in turn builds on an external C threadframe module: http://www.majid.info/mylos/stories/2004/06/10/threadframe.html Folding the functionality of that (or similar functionality) into the core would, IMO, be a valuable addition for 2.5, and would make an excellent intro project for an aspiring contributor interested in how threads work in CPython (what this module does is conceptually simple). It belongs in the core because it's not safe to chase the tstate chain without holding pystate.c's internal head_mutex lock (holding the GIL isn't enough -- it's normal practice to call PyThreadState_Delete() while not holding the GIL). I'd do it myself (and maybe I will anyway), but this really would make a good (finite; conceptually simple) project for someone who wants to gain Python developer experience.

2 2