Mailman 3 February 2006 - Python-Dev

Fixing copy.py to allow copying functions
by Guido van Rossum 21 Feb '06

21 Feb '06

While playing around with the defaultdict patch, adding __reduce__ to make defaultdict objects properly copyable through the copy module, I noticed that copy.py doesn't support copying function objects. This seems an oversight, since the (closely related) pickle module *does* support copying functions. The semantics of pickling a function is that it just stores the module and function name in the pickle; that is, if you unpickle it in the same process it'll just return a reference to the same function object. This would translate into "atomic" semantics for copying functions: the "copy" is just the original, for shallow as well as deep copies. It's a simple patch: --- Lib/copy.py (revision 42537) +++ Lib/copy.py (working copy) @@ -101,7 +101,8 @@ return x for t in (type(None), int, long, float, bool, str, tuple, frozenset, type, xrange, types.ClassType, - types.BuiltinFunctionType): + types.BuiltinFunctionType, + types.FunctionType): d[t] = _copy_immutable for name in ("ComplexType", "UnicodeType", "CodeType"): t = getattr(types, name, None) @@ -217,6 +218,7 @@ d[xrange] = _deepcopy_atomic d[types.ClassType] = _deepcopy_atomic d[types.BuiltinFunctionType] = _deepcopy_atomic +d[types.FunctionType] = _deepcopy_atomic def _deepcopy_list(x, memo): y = [] Any objections? Given that these are picklable, I can't imagine there are any but I thought I'd ask anyway. -- --Guido van Rossum (home page: http://www.python.org/~guido/)

1 0

Weekly Python Patch/Bug Summary
by Kurt B. Kaiser 21 Feb '06

21 Feb '06

Patch / Bug Summary ___________________ Patches : 385 open (-14) / 3067 closed (+25) / 3452 total (+11) Bugs : 864 open (-59) / 5621 closed (+68) / 6485 total ( +9) RFE : 211 open ( +2) / 200 closed ( +2) / 411 total ( +4) New / Reopened Patches ______________________ GNU uses double-dashes not single (2006-02-16) http://python.org/sf/1433148 opened by splitscreen restrict codec lookup to encodings package (2006-02-16) CLOSED http://python.org/sf/1433198 reopened by lemburg restrict codec lookup to encodings package (2006-02-16) CLOSED http://python.org/sf/1433198 opened by Guido van Rossum add on_missing() and default_factory to dict (2006-02-17) http://python.org/sf/1433928 opened by Guido van Rossum CHM file contains proprietary link format (2006-02-18) http://python.org/sf/1434298 opened by Alexander Schremmer Patch to support lots of file descriptors (2006-02-19) http://python.org/sf/1434657 opened by Sven Berkvens-Matthijsse Add copy() method to zlib's compress and decompress objects (2006-02-20) http://python.org/sf/1435422 opened by Chris AtLee PEP 343 with statement (2006-02-21) http://python.org/sf/1435715 opened by mbland Incremental codecs (2006-02-21) http://python.org/sf/1436130 opened by Walter Dörwald fix inplace assignment for immutable sequences (2006-02-21) http://python.org/sf/1436226 opened by Georg Brandl Patches Closed ______________ GNU uses double-dashes not single (2006-02-16) http://python.org/sf/1433166 deleted by gvanrossum restrict codec lookup to encodings package (2006-02-16) http://python.org/sf/1433198 closed by lemburg restrict codec lookup to encodings package (2006-02-16) http://python.org/sf/1433198 closed by lemburg use computed goto's in ceval loop (2006-01-18) http://python.org/sf/1408710 closed by loewis have SimpleHTTPServer return last-modified headers (2006-01-28) http://python.org/sf/1417555 closed by birkenfeld Feed style codec API (2005-01-12) http://python.org/sf/1101097 closed by lemburg chunk.py can't handle >2GB chunks (2005-12-05) http://python.org/sf/1373643 closed by birkenfeld Fix of bug 1366000 (2005-11-30) http://python.org/sf/1370147 closed by birkenfeld Optional second argument for startfile (2005-12-29) http://python.org/sf/1393157 closed by birkenfeld Clairify docs on reference stealing (2006-01-26) http://python.org/sf/1415507 closed by birkenfeld urllib proxy_bypass broken (2006-02-07) http://python.org/sf/1426648 closed by birkenfeld Speed up EnumKey call (2004-06-22) http://python.org/sf/977553 closed by birkenfeld [PATCH] Bug #1351707 (2005-11-10) http://python.org/sf/1352711 closed by birkenfeld fileinput patch for bug #1336582 (2005-10-25) http://python.org/sf/1337756 closed by birkenfeld Fix for int(string, base) wrong answers (2005-10-22) http://python.org/sf/1334979 closed by birkenfeld [PATCH] 100x optimization for ngettext (2005-11-06) http://python.org/sf/1349274 closed by birkenfeld commands.getstatusoutput() (2005-11-02) http://python.org/sf/1346211 closed by birkenfeld two fileinput enhancements (fileno, openhook) (2005-06-05) http://python.org/sf/1215184 closed by birkenfeld mode argument for fileinput class (2005-05-31) http://python.org/sf/1212287 closed by birkenfeld do not add directory of sys.argv[0] into sys.path (2004-05-02) http://python.org/sf/946373 closed by gbrandl prefix and exec_prefix as root dir bug (2004-04-08) http://python.org/sf/931938 closed by gbrandl New / Reopened Bugs ___________________ optparse docs double-dash confusion (2006-02-16) http://python.org/sf/1432838 opened by John Veness Logging hangs thread after detaching a StreamHandler's termi (2006-02-13) CLOSED http://python.org/sf/1431253 reopened by yangzhang os.path.expandvars sometimes doesn't expand $HOSTNAME (2006-02-17) CLOSED http://python.org/sf/1433667 opened by Doug Fort normalize function in minidom unlinks empty child nodes (2006-02-17) http://python.org/sf/1433694 opened by RomanKliotzkin string parameter to ioctl not null terminated, includes fix (2006-02-17) http://python.org/sf/1433877 opened by Quentin Barnes pointer aliasing causes core dump, with workaround (2006-02-17) http://python.org/sf/1433886 opened by Quentin Barnes Python crash on __init__/__getattr__/__setattr__ interaction (2004-04-26) CLOSED http://python.org/sf/942706 reopened by hhas Crash when decoding UTF8 (2006-02-20) CLOSED http://python.org/sf/1435487 opened by Viktor Ferenczi CGIHTTPServer doesn't handle path names with embeded space (2006-02-21) http://python.org/sf/1436206 opened by Richard Coupland Bugs Closed ___________ Logging hangs thread after detaching a StreamHandler's termi (2006-02-14) http://python.org/sf/1431253 closed by vsajip logging module's setLoggerClass not really working (2005-09-08) http://python.org/sf/1284928 closed by vsajip pydoc still doesn't handle lambda well (2006-02-15) http://python.org/sf/1432260 closed by birkenfeld smtplib: empty mail addresses (2006-02-12) http://python.org/sf/1430298 closed by birkenfeld IMPORT PROBLEM: Local submodule shadows global module (2006-02-01) http://python.org/sf/1421513 closed by birkenfeld class dictionary shortcircuits __getattr__ (2006-01-31) http://python.org/sf/1419989 closed by birkenfeld SimpleHTTPServer doesn't return last-modified headers (2006-01-28) http://python.org/sf/1417554 closed by birkenfeld os.path.expandvars sometimes doesn't expand $HOSTNAME (2006-02-17) http://python.org/sf/1433667 closed by birkenfeld http response dictionary incomplete (2006-02-01) http://python.org/sf/1421696 closed by birkenfeld Bug bz2.BZ2File(...).seek(0,2) (2005-11-25) http://python.org/sf/1366000 closed by birkenfeld Incorrect Decimal-float behavior for + (2005-11-13) http://python.org/sf/1355842 closed by arigo http auth documentation/implementation conflict (2005-08-13) http://python.org/sf/1258485 closed by birkenfeld bsddb.__init__ causes error (2006-01-04) http://python.org/sf/1396678 closed by birkenfeld StreamReader.readline doesn't advance on decode errors (2005-12-13) http://python.org/sf/1379393 closed by birkenfeld zipimport produces incomplete IOError instances (2005-11-08) http://python.org/sf/1351707 closed by birkenfeld zipfile: inserting some filenames produces corrupt .zips (2006-01-24) http://python.org/sf/1413790 closed by birkenfeld socketmodule.c compile error using SunPro cc (2003-10-06) http://python.org/sf/818490 closed by birkenfeld Python-2.3.3c1, Solaris 2.7: socketmodule does not compile (2003-12-05) http://python.org/sf/854823 closed by birkenfeld README build instructions for fpectl (2004-01-07) http://python.org/sf/872175 closed by birkenfeld test_fcntl fails on netbsd2 (2005-01-12) http://python.org/sf/1101233 closed by birkenfeld Python 2.4 and 2.3.5 won't build on OpenBSD 3.7 (2005-11-01) http://python.org/sf/1345313 closed by loewis getwindowsversion() constants in sys module (2005-10-10) http://python.org/sf/1323369 closed by gbrandl No documentation for PyFunction_* (C-Api) (2004-08-22) http://python.org/sf/1013800 closed by gbrandl pickle files should be opened in binary mode (2005-01-14) http://python.org/sf/1102649 closed by gbrandl os.stat returning a time (2003-09-22) http://python.org/sf/810887 closed by gbrandl test_sax fails on python 2.2.3 & patch for regrtest.py (2003-06-21) http://python.org/sf/758504 closed by gbrandl a exception ocurrs when compiling a Python file (2003-12-09) http://python.org/sf/856841 closed by gbrandl Ms VC 2003 not supported (2003-06-18) http://python.org/sf/756842 closed by gbrandl site.py breaks if prefix is empty (2003-04-01) http://python.org/sf/713601 closed by gbrandl AESend on Jaguar (2002-08-14) http://python.org/sf/595105 closed by jackjansen source files using encoding ./. universal newlines (2003-07-31) http://python.org/sf/780730 closed by lemburg Solaris 8 declares gethostname(). (2005-08-12) http://python.org/sf/1257687 closed by gbrandl httplib.HTTPConnection._send_request header parsing bug (2003-10-27) http://python.org/sf/831271 closed by gbrandl Problem with ftplib on HP-UX11i (2003-09-25) http://python.org/sf/812376 closed by gbrandl locale.getdefaultlocale doesnt handle all locales gracefully (2003-09-27) http://python.org/sf/813449 closed by gbrandl NotImplemented return value misinterpreted in new classes (2003-11-22) http://python.org/sf/847024 closed by gbrandl fileinput does not use universal input (2003-12-15) http://python.org/sf/860515 closed by gbrandl Cursors not correctly closed after exception. (2005-05-28) http://python.org/sf/1210377 closed by gbrandl urllib2 doesn't handle username/password in url (2004-04-29) http://python.org/sf/944396 closed by gbrandl urllib2.HTTPBasicAuthHandler problem with [HOST]:[PORT] (2004-11-29) http://python.org/sf/1075427 closed by gbrandl urllib.urlopen() fails to raise exception (2004-05-04) http://python.org/sf/947571 closed by gbrandl __mul__ taken as __rmul__ for mul-by-int only (2003-10-25) http://python.org/sf/830261 closed by gbrandl Python crash on __init__/__getattr__/__setattr__ interaction (2004-04-26) http://python.org/sf/942706 closed by gbrandl Error "exec"ing python code (2005-03-21) http://python.org/sf/1167300 closed by gbrandl type() and isinstance() do not call __getattribute__ (2005-08-19) http://python.org/sf/1263635 closed by gbrandl Crash when decoding UTF8 (2006-02-20) http://python.org/sf/1435487 closed by nnorwitz New / Reopened RFE __________________ Implement preemptive threads in Python (2006-02-16) http://python.org/sf/1432694 reopened by darkprokoba Implement preemptive threads in Python (2006-02-16) http://python.org/sf/1432694 opened by Andrey Petrov Use new expat version 2.0 (2006-02-17) http://python.org/sf/1433435 opened by Wolfgang Langner python executable optionally should search script on PATH (2005-12-13) http://python.org/sf/1379573 reopened by cconrad Extend pre-allocated integers to cover [0, 255] (2006-02-21) http://python.org/sf/1436243 opened by Tim Delaney RFE Closed __________ Implement preemptive threads in Python (2006-02-16) http://python.org/sf/1432694 closed by mwh fileinput/gzip modules should play well (2002-06-01) http://python.org/sf/563141 closed by birkenfeld

1 0

Re: [Python-Dev] Using and binding relative names (was Re: PEP for Better Control of Nested Lexical Scopes)
by Phillip J. Eby 21 Feb '06

21 Feb '06

At 11:50 PM 2/21/2006 +0100, Morel Xavier wrote: >Phillip J. Eby wrote: >>The '.' would mean "this name, but in the nearest outer scope that >>defines it". Note that this could include the global scope, so the >>'global' keyword could go away in 2.5. And in Python 3.0, the '.' could >>become *required* for use in closures, so that it's not necessary for the >>reader to check a function's outer scope to see whether closure is taking >>place. EIBTI. > >While the idea is interesting, how would this solution behave if the >variable (the name) didn't exist in any outer scope? The compiler should consider it a name in the global scope, and for an assignment the name would be required to have an existing binding, or a NameError would result. (Indicating you are assigning to a global that hasn't been defined.) >Would it create and bind the name in the current scope? No, never. > If yes, why wouldn't this behavior become the default (without > any leading dot), efficiency issues of the lookup? No, it would be because explicit is better than implicit. The whole point of requiring '.' for closures in Python 3.0 would be to keep the person who's reading the code from having to inspect an entire function and its context to figure out which names are referring to variables in outer scopes. That is, it would go against the whole point of my idea, which is to make explicit what variables are part of your closure.

1 0

Re: [Python-Dev] s/bytes/octet/ [Was:Re: bytes.from_hex() [Was:PEP332 revival in coordination with pep 349?]]
by Delaney, Timothy (Tim) 21 Feb '06

21 Feb '06

Delaney, Timothy (Tim) wrote: >>> Perhaps we should extend the pre-allocated integer objects to cover >>> the full byte range. >> >> +1 > > Want me to raise an SF request? Done. Item # 1436243. Tim Delaney

1 0

Re: [Python-Dev] s/bytes/octet/ [Was:Re: bytes.from_hex() [Was: PEP332 revival in coordination with pep 349?]]
by Delaney, Timothy (Tim) 21 Feb '06

21 Feb '06

Raymond Hettinger wrote: >> Speaking of which, I suspect it'll be a lot more common to need >> integer objects in the full range [0, 255] than it is now. >> >> Perhaps we should extend the pre-allocated integer objects to cover >> the full byte range. > > +1 Want me to raise an SF request? Tim Delaney

1 0

Re: [Python-Dev] s/bytes/octet/ [Was:Re: bytes.from_hex() [Was: PEP 332 revival in coordination with pep 349?]]
by Delaney, Timothy (Tim) 21 Feb '06

21 Feb '06

Greg Ewing wrote: > I don't quite see the point here. Inside a bytes object, > they would be stored 1 byte per byte. Nobody is suggesting > that they would take up more than that just because > a_bytes_object[i] happens to return an int. Speaking of which, I suspect it'll be a lot more common to need integer objects in the full range [0, 255] than it is now. Perhaps we should extend the pre-allocated integer objects to cover the full byte range. Tim Delaney

2 1

Two patches
by Georg Brandl 21 Feb '06

21 Feb '06

Hi, I have two patches lying around here, please comment: * I think I've submitted this one to the tracker, but can't remember: It's for PySequence_SetItem and makes something like this possible: tup = ([], ) tup[0] += [1] I can upload it once more to allow review. * One patch for staticmethod and classmethod, which currently silently accept keyword arguments and throw them away. The patch adds error messages. Georg

2 2

readline compilarion fails on OSX
by Guido van Rossum 21 Feb '06

21 Feb '06

On OSX (10.4.4) the readline module in the svn HEAD fails compilation as follows. This is particularly strange since the buildbot is green for OSX... What could be up with this? building 'readline' extension gcc -fno-strict-aliasing -Wno-long-double -no-cpp-precomp -mno-fused-madd -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -I. -I/Users/guido/projects/python/trunk/./Include -I/Users/guido/projects/python/trunk/./Mac/Include -I../Include -I. -I/usr/local/include -I/Users/guido/projects/python/trunk/Include -I/Users/guido/projects/python/trunk/osx -c /Users/guido/projects/python/trunk/Modules/readline.c -o build/temp.darwin-8.4.0-Power_Macintosh-2.5/readline.o /Users/guido/projects/python/trunk/Modules/readline.c: In function 'write_history_file': /Users/guido/projects/python/trunk/Modules/readline.c:112: warning: implicit declaration of function 'history_truncate_file' /Users/guido/projects/python/trunk/Modules/readline.c: In function 'py_remove_history': /Users/guido/projects/python/trunk/Modules/readline.c:301: warning: implicit declaration of function 'remove_history' /Users/guido/projects/python/trunk/Modules/readline.c:301: warning: assignment makes pointer from integer without a cast /Users/guido/projects/python/trunk/Modules/readline.c:310: warning: passing argument 1 of 'free' discards qualifiers from pointer target type /Users/guido/projects/python/trunk/Modules/readline.c:312: warning: passing argument 1 of 'free' discards qualifiers from pointer target type /Users/guido/projects/python/trunk/Modules/readline.c: In function 'py_replace_history': /Users/guido/projects/python/trunk/Modules/readline.c:338: warning: implicit declaration of function 'replace_history_entry' /Users/guido/projects/python/trunk/Modules/readline.c:338: warning: assignment makes pointer from integer without a cast /Users/guido/projects/python/trunk/Modules/readline.c:347: warning: passing argument 1 of 'free' discards qualifiers from pointer target type /Users/guido/projects/python/trunk/Modules/readline.c:349: warning: passing argument 1 of 'free' discards qualifiers from pointer target type /Users/guido/projects/python/trunk/Modules/readline.c: In function 'get_current_history_length': /Users/guido/projects/python/trunk/Modules/readline.c:453: error: 'HISTORY_STATE' undeclared (first use in this function) /Users/guido/projects/python/trunk/Modules/readline.c:453: error: (Each undeclared identifier is reported only once /Users/guido/projects/python/trunk/Modules/readline.c:453: error: for each function it appears in.) /Users/guido/projects/python/trunk/Modules/readline.c:453: error: 'hist_st' undeclared (first use in this function) /Users/guido/projects/python/trunk/Modules/readline.c:455: warning: implicit declaration of function 'history_get_history_state' /Users/guido/projects/python/trunk/Modules/readline.c: In function 'insert_text': /Users/guido/projects/python/trunk/Modules/readline.c:503: warning: implicit declaration of function 'rl_insert_text' /Users/guido/projects/python/trunk/Modules/readline.c: In function 'on_completion': /Users/guido/projects/python/trunk/Modules/readline.c:637: error: 'rl_attempted_completion_over' undeclared (first use in this function) /Users/guido/projects/python/trunk/Modules/readline.c: In function 'flex_complete': /Users/guido/projects/python/trunk/Modules/readline.c:675: warning: passing argument 2 of 'completion_matches' from incompatible pointer type /Users/guido/projects/python/trunk/Modules/readline.c: In function 'setup_readline': /Users/guido/projects/python/trunk/Modules/readline.c:700: warning: passing argument 2 of 'rl_bind_key_in_map' from incompatible pointer type /Users/guido/projects/python/trunk/Modules/readline.c:701: warning: passing argument 2 of 'rl_bind_key_in_map' from incompatible pointer type /Users/guido/projects/python/trunk/Modules/readline.c: In function 'readline_until_enter_or_signal': /Users/guido/projects/python/trunk/Modules/readline.c:758: warning: passing argument 2 of 'rl_callback_handler_install' from incompatible pointer type /Users/guido/projects/python/trunk/Modules/readline.c:788: warning: implicit declaration of function 'rl_free_line_state' /Users/guido/projects/python/trunk/Modules/readline.c:789: warning: implicit declaration of function 'rl_cleanup_after_signal' /Users/guido/projects/python/trunk/Modules/readline.c: In function 'call_readline': /Users/guido/projects/python/trunk/Modules/readline.c:883: error: 'HISTORY_STATE' undeclared (first use in this function) /Users/guido/projects/python/trunk/Modules/readline.c:883: error: 'state' undeclared (first use in this function) /Users/guido/projects/python/trunk/Modules/readline.c:885: warning: assignment discards qualifiers from pointer target type (Yes, the keynote slides are coming along just fine... :-) -- --Guido van Rossum (home page: http://www.python.org/~guido/)

4 4

PEP 343 "with" statement patch
by Mike Bland 21 Feb '06

21 Feb '06

With Neal Norwitz's help, I've submitted an initial patch to implement the "with" statement from PEP 343 (SourceForge request ID 1435715). There is a little more work to be done (on the doc especially), and I have a couple of questions written up on the SourceForge page, but the code works to the best of my understanding of PEP 343 and has a fairly comprehensive set of unit tests to verify it. Looking forward to the review, Mike

1 0

Deprecate ``multifile``?
by Georg Brandl 21 Feb '06

21 Feb '06

Hi, as Jim Jewett noted, multifile is supplanted by email as much as mimify etc. but it is not marked as deprecated. Should it be deprecated in 2.5? Georg

3 6