Mailman 3 June 2007 - Python-Dev

handling the granularity of possible Py3K warnings in 2.6
by Brett Cannon June 26, 2007

June 26, 2007

My rewrite of import is written for 2.6. But I am going to try to bootstrap it into 3.0. But I want to bootstrap into 2.6 if it works out well in 3.0. That means coding in 2.6 but constantly forward-porting to 3.0. In other words I am going to be a guinea pig of our transition plan. And being the guinea pig means I want to know where we want to take the Py3K warnings in 2.6. As of right now the -3 option causes some DeprecationWarnings to be raised (mostly about callable and dict.has_key). But I was thinking that a certain level of granularity existed amongst what should be warned against. There is syntactic vs. semantic. For syntactic there is stuff you can do in versions of Python older than 2.6 (e.g., backtick removal), stuff you can only do in 2.6 (e.g., new exception syntax), or stuff that you can't do at all without a __future__ statement (e.g., 'print'). For semantics, there is removal (e.g., callable), and then there is new semantics (dict.items). What I was thinking was having these various types of changes be represented by proper warnings. That allows for using the -W option to control what warnings you care about. So I envision something like: + Py3KWarning + Py3KSyntaxWarning + some reasonable name for stuff that can be done in 2.6. + some name for stuff that can be done in older than 2.6. + something for stuff like the 'print' removal that require a __future__ statement. + Py3KSemanticWarning + Py3KDeprecationWarning + Py3KChangedSemanticsWarning (or whatever name you prefer) The key point is that when I am forward-porting I want to easily tell what syntax changes I can deal with now in older, e.g. 2.5 code, stuff that I can change directly in 2.6, and stuff that requires 2to3 or a __future__ statement. Similar idea for semantic changes. That way I can do this all in steps. Does this sound reasonable to people at all? -Brett

1 0

Proposal for a new function "open_noinherit" to avoid problems with subprocesses and security risks
by Henning von Bargen June 24, 2007

June 24, 2007

I'd like to propose a new function "open_noinherit" or maybe even a new mode flag "n" for the builtin "open" (see footnote for the names). The new function should work exactly like the builtin "open", with one difference: The open file is not inherited to any child processes (whereas files opened with "open" will be inherited). The new function can be implemented (basically) using os.O_NOINHERIT on MS Windows resp. fcntl / FD_CLOEXEC on Posix. I will post a working Python implementation next week. There are five reasons for the proposal: 1) The builtin "open" causes unexpected problems in conjunction with subprocesses, in particular in multi-threaded programs. It can cause file permission errors in the subprocess or in the current process. On Microsoft Windows, some of the possible file permission errors are not documented by Microsoft (thus very few programs written for Windows will react properly). 2) Inheriting open file handles to subprocesses is a security risk. 3) For the developer, finding "cause and effect" is *very* hard, in particular in multi-threaded programs, when the errors occur only in race-conditions. 4) The problems arise in some of the standard library modules as well, i.e. shutil.filecopy. 5) Very few developers are aware of the possible problems. As a work-around, one can replace open with os.fdopen (os.open (..., + os.O_NOINHERIT), ... ) on Windows, but that's really ugly, hard to read, may raise a different exception than open (IOError instead of OSError), and needs careful work to take platform-specific code into account Here is a single-threaded example to demonstrate the effect: import os import subprocess outf = open ("blah.tmp", "wt") subprocess.Popen("notepad.exe") # or whatever program you like, but # It must be a program that does not exit immediately! # Now the subprocess has inherited the open file handle # We can still write: outf.write ("Hello world!\n") outf.close() # But we can not rename the file (at least on Windows) os.rename ("blah.tmp", "blah.txt") # this fails with OSError: [Errno 13] Permission denied # Similar problems with other file operations on non-Windows platforms. Ok, in this little program one can see what is going wrong easily. But what if the subprocess exits very quickly? Then perhaps you see the OSError, perhaps not - depending on the process scheduler of your operation system. In a commercial multi-theaded daemon application, the error only occured under heavy load and was hard to reproduce - and it was even harder to find the cause. That's because cause and effect were in two different threads in two completely different parts of the program: - Thread A opens a file and starts to write data - Thread B starts a subprocess (which inherits the file handle from thread A!) - Thread A continues writing to the file and closes it. - And now it's a race condition: - a) Thread A wants to rename the file - b) the subprocess exits. If a) is first: Error, if b) is first: no error. To make things more complicated, even two subprocesses can disturb each other. The new function should be implemented in C ideally, because the GIL could prevent a thread-switch between os.open and the fcntl.F_SETFD call. Note that the problem described here arises not only for files, but for sockets as well. See bug 1222790: SimpleXMLRPCServer does not set FD_CLOEXEC Once there is an easy-to-use, platform-independent, documented builtin "open_noinherit" (or a new mode flag for "open"), the standard library should be considered. For each occurence of "open" or "file", it should be considered if it necessary to inherit the file to subprocesses. If not, it should be replaced with open_noinherit. One example is shutil.filecopy, where open_noiherit should be used instead of open. The socket module is another candidate, I think - but I'm not sure about that. A nice effect of using "open_noinherit" is that - in many cases - one no longer needs to speficy close_fds = True when calling subprocess.Popen. [Note that close_fds is *terribly* slow if MAX_OPEN_FILES is "big", e.g. 800, see bug 1663329] Footnote: While writing this mail, at least 3 times I typed "nonherit" instead of "noinherit". So maybe someone can propose a better name? Or a new mode flag character could be "p" (like "private" or "protected"). Henning

7 16

Issues with PEP 3101 (string formatting)
by Chris McDonough June 24, 2007

June 24, 2007

Wrt http://www.python.org/dev/peps/pep-3101/ PEP 3101 says Py3K should allow item and attribute access syntax within string templating expressions but "to limit potential security issues", access to underscore prefixed names within attribute/item access expressions will be disallowed. I am a person who has lived with the aftermath of a framework designed to prevent data access by restricting access to underscore- prefixed names (Zope 2, ahem), and I've found it's very hard to explain and justify. As a result, I feel that this is a poor default policy choice for a framework. In some cases, underscore names must become part of an object's external interface. Consider a URL with one or more underscore- prefixed path segment elements (because prefixing a filename with an underscore is a perfectly reasonable thing to do on a filesystem, and path elements are often named after file names) fed to a traversal algorithm that attempts to resolve each path element into an object by calling __getitem__ against the parent found by the last path element's traversal result. Perhaps this is poor design and __getitem__ should not be consulted here, but I doubt that highly because there's nothing particularly special about calling a method named __getitem__ as opposed to some method named "traverse". The only precedent within Python 2 for this sort of behavior is limiting access to variables that begin with __ and which do not end with __ to the scope defined by a class and its instances. I personally don't believe this is a very useful feature, but it's still only an advisory policy and you can worm around it with enough gyrations. Given that security is a concern at all, the only truly reasonable way to "limit security issues" is to disallow item and attribute access completely within the string templating expression syntax. It seems gratuituous to me to encourage string templating expressions with item/attribute access, given that you could do it within the format arguments just as easily in the 99% case, and we've (well... I've) happily been living with that restriction for years now. But if this syntax is preserved, there really should be no *default* restrictions on the traversable names within an expression because this will almost certainly become a hard-to-explain, hard-to-justify bug magnet as it has become in Zope. - C

3 2

Re: [Python-Dev] [Python-3000] Issues with PEP 3101 (string formatting)
by Talin June 24, 2007

June 24, 2007

I haven't responded to this thread because I was hoping some of the original proponents of the feature would come out to defend it. (Remember, 3101 is a synthesis of a lot of people's ideas gleaned from many forum postings - In some cases I am willing to defend particular aspects of the PEP, and in others I just write down what I think the general consensus is.) That being said - from what I've read so far, the evidence on both sides of the argument seems anecdotal to me. I'd rather wait and see what more people have to say on the topic. -- Talin Aurélien Campéas wrote: > On Tue, Jun 19, 2007 at 08:20:25AM -0700, Guido van Rossum wrote: >> Those are valid concerns. I'm cross-posting this to the python-3000 >> list in the hope that the PEP's author and defendents can respond. I'm >> sure we can work something out. > > Thanks to raise this. It is horrible enough that I feel obliged to > de-lurk. > > -10 on this part of PEP3101. > > >> Please keep further discussion on the python-3000(a)python.org list. >> >> --Guido >> >> On 6/19/07, Chris McDonough <chrism(a)plope.com> wrote: >>> Wrt http://www.python.org/dev/peps/pep-3101/ >>> >>> PEP 3101 says Py3K should allow item and attribute access syntax >>> within string templating expressions but "to limit potential security >>> issues", access to underscore prefixed names within attribute/item >>> access expressions will be disallowed. > > People talking about potential security issues should have an > obligation to show how their proposals *really* improve security (in > general); this is of course, a hard thing to do; mere hand-waving is > not sufficient. > >>> I am a person who has lived with the aftermath of a framework >>> designed to prevent data access by restricting access to underscore- >>> prefixed names (Zope 2, ahem), and I've found it's very hard to >>> explain and justify. As a result, I feel that this is a poor default >>> policy choice for a framework. > > And it's even poorer in the context of a language (for it's probably > harder to escape language-level restrictions than framework > obscurities ...). > >>> In some cases, underscore names must become part of an object's >>> external interface. Consider a URL with one or more underscore- >>> prefixed path segment elements (because prefixing a filename with an >>> underscore is a perfectly reasonable thing to do on a filesystem, and >>> path elements are often named after file names) fed to a traversal >>> algorithm that attempts to resolve each path element into an object >>> by calling __getitem__ against the parent found by the last path >>> element's traversal result. Perhaps this is poor design and >>> __getitem__ should not be consulted here, but I doubt that highly >>> because there's nothing particularly special about calling a method >>> named __getitem__ as opposed to some method named "traverse". > > This is trying to make a technical argument, but the 'consenting > adults' policy might be enough. In my experience, zope forbiding > access to _ prefixed attributes just led to work around the > limitation, thus adding more useless indirection to an already crufty > code base. The result is more obfuscation and probably even less > security (as in auditability of the code). > >>> The only precedent within Python 2 for this sort of behavior is >>> limiting access to variables that begin with __ and which do not end >>> with __ to the scope defined by a class and its instances. I >>> personally don't believe this is a very useful feature, but it's >>> still only an advisory policy and you can worm around it with enough >>> gyrations. > > FWIW I've come to never use __attrs. The obfuscation feature seems to > bring nothing but pain (the few times I've fell into that trap as a > beginner python programmer). > >>> Given that security is a concern at all, the only truly reasonable >>> way to "limit security issues" is to disallow item and attribute >>> access completely within the string templating expression syntax. It >>> seems gratuituous to me to encourage string templating expressions >>> with item/attribute access, given that you could do it within the >>> format arguments just as easily in the 99% case, and we've (well... >>> I've) happily been living with that restriction for years now. >>> >>> But if this syntax is preserved, there really should be no *default* >>> restrictions on the traversable names within an expression because >>> this will almost certainly become a hard-to-explain, hard-to-justify >>> bug magnet as it has become in Zope. > > I'd add that Zope in general looks to me like a giant collection of > python anti-patterns and as such can be used as a clue source about > what not to do, especially what not to include in Py3k. > > I don't want to offense people, well no more than necessary (imho zope > *is* an offense to common sense in many ways), but that's the opinion > from someone who earns its living mostly from zope/plone products > dev. and maintenance (these days, anyway). > > Regards, > Aurélien. > _______________________________________________ > Python-3000 mailing list > Python-3000(a)python.org > http://mail.python.org/mailman/listinfo/python-3000 > Unsubscribe: http://mail.python.org/mailman/options/python-3000/talin%40acm.org >

1 0

Summary of Tracker Issues
by Tracker June 24, 2007

June 24, 2007

ACTIVITY SUMMARY (06/17/07 - 06/24/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1645 open ( +0) / 8584 closed ( +0) / 10229 total ( +0) Average duration of open issues: 836 days. Median duration of open issues: 784 days. Open Issues Breakdown open 1645 ( +0) pending 0 ( +0)

1 0

bzr on dinsdale
by "Martin v. Löwis" June 23, 2007

June 23, 2007

If I do "bzr status" in dinsdale:/etc/apache2, I get bzr: ERROR: bzrlib.errors.BzrCheckError: Internal check failed: file u'/etc/init.d/stop-bootlogd' entered as kind 'symlink' id 'stopbootlogd-20070303140018-fe340b888f6e9c69', now of kind 'file' Traceback (most recent call last): File "/usr/lib/python2.4/site-packages/bzrlib/commands.py", line 611, in run_bzr_catch_errors return run_bzr(argv) ...... BzrCheckError: Internal check failed: file u'/etc/init.d/stop-bootlogd' entered as kind 'symlink' id 'stopbootlogd-20070303140018-fe340b888f6e9c69', now of kind 'file' bzr 0.11.0 on python 2.4.4.final.0 (linux2) arguments: ['/usr/bin/bzr', 'status'] ** please send this report to bazaar-ng(a)lists.ubuntu.com Can somebody experienced with bzr please help? Regards, Martin

2 2

Weekly Python Patch/Bug Summary
by Kurt B. Kaiser June 23, 2007

June 23, 2007

Patch / Bug Summary ___________________ Patches : 385 open (+21) / 3790 closed (+21) / 4175 total (+42) Bugs : 1029 open (+43) / 6744 closed (+43) / 7773 total (+86) RFE : 262 open ( +4) / 291 closed ( +4) / 553 total ( +8) New / Reopened Patches ______________________ syslog syscall support for SysLogLogger (2007-05-02) http://python.org/sf/1711603 reopened by luke-jr syslog syscall support for SysLogLogger (2007-05-02) http://python.org/sf/1711603 reopened by luke-jr syslog syscall support for SysLogLogger (2007-05-02) http://python.org/sf/1711603 reopened by luke-jr syslog syscall support for SysLogLogger (2007-05-02) http://python.org/sf/1711603 reopened by luke-jr dict size changes during iter (2007-05-24) http://python.org/sf/1724999 opened by Ali Gholami Rudi Line ending bug SimpleXMLRPCServer (2007-05-24) http://python.org/sf/1725295 opened by bgrubbs IDLE - cursor color configuration bug (2007-05-25) http://python.org/sf/1725576 opened by Tal Einat Distutils default exclude doesn't match top level .svn (2007-05-25) http://python.org/sf/1725737 opened by Petteri Räty ftplib.py: IndexError in voidresp occasionally (2007-05-26) http://python.org/sf/1726172 opened by kxroberto Patch to vs 2005 build (2007-05-26) http://python.org/sf/1726195 opened by Joseph Armbruster Windows Build Warnings (2007-05-26) http://python.org/sf/1726196 opened by Joseph Armbruster Line iteration readability (2007-05-26) http://python.org/sf/1726198 opened by Joseph Armbruster SimpleHTTPServer extensions_map (2007-05-26) http://python.org/sf/1726208 opened by Joseph Armbruster ftplib and ProFTPD NLST 226 without 1xx response (2007-05-27) http://python.org/sf/1726451 opened by Kenneth Loafman First steps towards new super (PEP 367) (2007-05-28) CLOSED http://python.org/sf/1727209 opened by Guido van Rossum move intern to sys, make intern() optionally warn (2007-05-31) http://python.org/sf/1728741 opened by Anthony Baxter IDLE - configDialog layout cleanup (2007-06-03) http://python.org/sf/1730217 opened by Tal Einat telnetlib: A callback for monitoring the telnet session (2007-06-04) http://python.org/sf/1730959 opened by Samuel Abels BufReader, TextReader for PEP 3116 "New I/O" (2007-06-04) http://python.org/sf/1731036 opened by Ilguiz Latypov Pruning threading.py from asserts (2007-06-05) CLOSED http://python.org/sf/1731049 opened by Björn Lindqvist Expect skips by platform (2007-06-04) http://python.org/sf/1731169 opened by Matt Kraai Missing Py_DECREF in pysqlite_cache_display (2007-06-05) CLOSED http://python.org/sf/1731330 opened by Tim Delaney Improve doc for time.strptime (2007-06-05) http://python.org/sf/1731659 opened by Björn Lindqvist urllib.urlretrieve/URLopener.retrieve - 'buff' argument (2007-06-05) http://python.org/sf/1731720 opened by Dariusz Suchojad Document the constants in the socket module (2007-06-06) http://python.org/sf/1732367 opened by Björn Lindqvist Allow T_LONGLONG to accepts ints (2007-06-09) CLOSED http://python.org/sf/1733960 opened by Roger Upole _lsprof.c:ptrace_enter_call assumes PyErr_* is clean (2007-06-09) http://python.org/sf/1733973 opened by Eyal Lotem PY_LLONG_MAX and so on (2007-06-09) CLOSED http://python.org/sf/1734014 opened by Hirokazu Yamamoto Fast path for unicodedata.normalize() (2007-06-10) http://python.org/sf/1734234 opened by Rauli Ruohonen patch for bug 1170311 "zipfile UnicodeDecodeError" (2007-06-10) http://python.org/sf/1734346 opened by Alexey Borzenkov platform.py patch to support turbolinux (2007-06-11) CLOSED http://python.org/sf/1734945 opened by Yayati_Turbolinux Fix selectmodule.c compilation on GNU/Hurd (2007-06-11) http://python.org/sf/1735030 opened by Michael Banck Kill StandardError (2007-06-12) CLOSED http://python.org/sf/1735485 opened by Collin Winter asyncore should handle also ECONNABORTED in recv (2007-06-12) http://python.org/sf/1736101 opened by billiejoex asyncore/asynchat patches (2007-06-12) http://python.org/sf/1736190 opened by Josiah Carlson EasyDialogs patch to remove aepack dependency (2007-06-15) http://python.org/sf/1737832 opened by has help() can't find right source file (2007-06-15) http://python.org/sf/1738179 opened by Greg Couch Add a -z interpreter flag to execute a zip file (2007-06-19) http://python.org/sf/1739468 opened by andy-chu zipfile.testzip() using progressive file reads (2007-06-19) http://python.org/sf/1739648 opened by Grzegorz Adam Hankiewicz Patch inspect.py for IronPython / Jython Compatibility (2007-06-19) http://python.org/sf/1739696 opened by Mike Foord Accelerate attr dict lookups (2007-06-19) http://python.org/sf/1739789 opened by Eyal Lotem Add reduce to functools in 2.6 (2007-06-19) http://python.org/sf/1739906 opened by Christian Heimes Fix Decimal.sqrt bugs described in #1725899 (2007-06-22) http://python.org/sf/1741308 opened by Mark Dickinson Patches Closed ______________ Make isinstance/issubclass overloadable for PEP 3119 (2007-04-26) http://python.org/sf/1708353 closed by gvanrossum subprocess: Support close_fds on Win32 (2007-02-26) http://python.org/sf/1669481 closed by astrand First steps towards new super (PEP 3135) (2007-05-28) http://python.org/sf/1727209 closed by gvanrossum platform.system() returns incorrect value in Vista (2007-05-28) http://python.org/sf/1726668 closed by lemburg Fix warnings related to PyLong_FromVoidPtr (2007-05-05) http://python.org/sf/1713234 closed by theller fix 1668596: copy datafiles properly when package_dir is ' ' (2007-05-17) http://python.org/sf/1720897 closed by nnorwitz Hide iteration variable in list comprehensions (2007-02-15) http://python.org/sf/1660500 closed by gbrandl urllib2 raises an UnboundLocalError if "auth-int" is the qop (2007-02-24) http://python.org/sf/1667860 closed by gbrandl Pruning threading.py from asserts (2007-06-04) http://python.org/sf/1731049 closed by collinwinter Missing Py_DECREF in pysqlite_cache_display (2007-06-05) http://python.org/sf/1731330 closed by gbrandl Fix tests that assume they can write to Lib/test (2006-07-12) http://python.org/sf/1520904 closed by dgreiman Allow specifying headers for MIME parts (2007-02-22) http://python.org/sf/1666625 closed by nnorwitz x64 clean compile patch for _ctypes (2007-05-09) http://python.org/sf/1715718 closed by theller bug fix: ctypes truncates 64-bit pointers (2007-04-19) http://python.org/sf/1703286 closed by theller fixes non ansi c declarations in libffi (2007-04-19) http://python.org/sf/1703300 closed by theller Allow T_LONGLONG to accepts ints (2007-06-09) http://python.org/sf/1733960 closed by loewis PY_LLONG_MAX and so on (2007-06-09) http://python.org/sf/1734014 closed by loewis bdist_deb - Debian packager (2004-10-27) http://python.org/sf/1054967 closed by jafo platform.py patch to support turbolinux (2007-06-11) http://python.org/sf/1734945 closed by lemburg Kill StandardError (2007-06-12) http://python.org/sf/1735485 closed by collinwinter locale.getdefaultlocale() bug when _locale is missing (2006-09-06) http://python.org/sf/1553427 closed by gbrandl New / Reopened Bugs ___________________ inspect.formatargspec last argument ignored (2007-05-23) CLOSED http://python.org/sf/1723875 opened by Patrick Dobbs Grammar error in Python Tutorial 2.5 section 8.3 (2007-05-23) CLOSED http://python.org/sf/1724099 opened by sampson cPickle module doesn't work with universal line endings (2007-05-23) http://python.org/sf/1724366 opened by Geoffrey Bache shlex.split problems on Windows (2007-05-24) http://python.org/sf/1724822 opened by Geoffrey Bache bsddb.btopen . del of record doesn't update index (2007-05-25) http://python.org/sf/1725856 opened by Charles Hixson bsddb.btopen . del of record doesn't update index (2007-05-25) CLOSED http://python.org/sf/1725862 opened by Charles Hixson decimal sqrt method doesn't use round-half-even (2007-05-25) http://python.org/sf/1725899 opened by Mark Dickinson Typo in ctypes.wintypes definition of WIN32_FIND_DATA field (2007-05-26) CLOSED http://python.org/sf/1726026 opened by Koby Kahane bsddb.btopen . del of record doesn't update index (2007-05-27) CLOSED http://python.org/sf/1726299 opened by Charles Hixson platform.system() returns incorrect value in Vista (2007-05-27) CLOSED http://python.org/sf/1726668 opened by Benjamin Leppard Bug found in datetime for Epoch time = -1 (2007-05-28) http://python.org/sf/1726687 opened by Martin Blais subprocess: unreliability of returncode not clear from docs (2007-05-28) http://python.org/sf/1727024 opened by Dan O'Huiginn 'assert statement' in doc index links to AssertionError (2007-05-29) CLOSED http://python.org/sf/1727417 opened by Åsmund Skjæveland xmlrpclib waits indefinately (2007-05-29) http://python.org/sf/1727418 opened by Arno Stienen 64/32-bit issue when unpickling random.Random (2007-05-29) http://python.org/sf/1727780 opened by Charles reading from malformed big5 document hangs cpython (2007-05-30) CLOSED http://python.org/sf/1728403 opened by tsuraan 0.0 and -0.0 end up referring to the same object (2007-05-31) http://python.org/sf/1729014 opened by Johnnyg os.stat producing incorrect / invalid results (2007-05-31) CLOSED http://python.org/sf/1729170 opened by Joe SVNVERSION redefined during compilation (2007-05-31) CLOSED http://python.org/sf/1729277 opened by Brett Cannon Error in example (2007-05-31) CLOSED http://python.org/sf/1729280 opened by accdak test_doctest fails when run in verbose mode (2007-05-31) http://python.org/sf/1729305 opened by Neal Norwitz missing int->Py_ssize_t in documentation (2007-06-01) http://python.org/sf/1729742 opened by Brian Wellington test_bsddb3 malloc corruption bug #1721309 broken in 2.6 (2007-06-02) CLOSED http://python.org/sf/1729929 opened by David Favor 2.5.1 latest svn fails test_curses and test_timeout (2007-06-02) http://python.org/sf/1729930 opened by David Favor cStringIO no loonger accepts array.array objects (2007-06-02) http://python.org/sf/1730114 opened by reedobrien tkFont.__eq__ gives type error (2007-06-02) http://python.org/sf/1730136 opened by L. Peter Deutsch getattr([], '__eq__')(some-object) is NotImplemented (2007-06-03) CLOSED http://python.org/sf/1730322 opened by L. Peter Deutsch When Mesa is built with NPTL support, Python extensions link (2007-06-03) http://python.org/sf/1730372 opened by Gazi Alankus strptime bug in time module (2007-06-03) CLOSED http://python.org/sf/1730389 opened by Emma __cmp__ present in type but not instance?? (2007-06-03) CLOSED http://python.org/sf/1730401 opened by L. Peter Deutsch os._execvpe raises assignment error in python 3000 svn (2007-06-04) CLOSED http://python.org/sf/1730441 opened by nifan dict constructor accesses internal items of dict derivative (2007-06-03) http://python.org/sf/1730480 opened by Blake Ross Importing a submodule after unloading its parent (2007-06-04) http://python.org/sf/1731068 opened by Blake Ross tkinter memory leak problem (2007-06-05) http://python.org/sf/1731706 opened by Robert Hancock race condition in subprocess module (2007-06-05) http://python.org/sf/1731717 opened by dsagal python 2.6 latest fails test_socketserver.py (2007-06-06) http://python.org/sf/1732145 opened by David Favor Unable to Start IDLE (2007-06-06) CLOSED http://python.org/sf/1732160 opened by Kishore Destructor behavior faulty (2007-05-12) http://python.org/sf/1717900 reopened by gbrandl repr of 'nan' floats not parseable (2007-06-06) http://python.org/sf/1732212 opened by Pete Shinners T_LONGLONG chokes on ints (2007-06-06) CLOSED http://python.org/sf/1732557 opened by Roger Upole Built-in open function fail. Too many file open (2007-06-07) CLOSED http://python.org/sf/1732629 opened by Alex socket makefile objects are not independent (2007-06-07) http://python.org/sf/1732662 opened by Jan Ondrej Built-in open function fail. Too many file open (2007-06-07) http://python.org/sf/1732686 reopened by alexteo21 Built-in open function fail. Too many file open (2007-06-07) http://python.org/sf/1732686 reopened by alexteo21 Built-in open function fail. Too many file open (2007-06-07) http://python.org/sf/1732686 opened by Alex sqlite3 module trigger problem (2007-06-07) http://python.org/sf/1733085 opened by Oinopion sqlite3.dll cannot be relocated (2007-06-08) http://python.org/sf/1733134 opened by Tim Delaney slice type is unhashable (2007-06-07) http://python.org/sf/1733184 opened by L. Peter Deutsch Solaris 64 bit LD_LIBRARY_PATH_64 needs to be set (2007-06-08) http://python.org/sf/1733484 opened by Brad Hochstetler AIX Objects/buffereobject.c does not build on AIX (2007-06-08) CLOSED http://python.org/sf/1733488 opened by Brad Hochstetler AIX Modules/unicodedata.c does not build (2007-06-08) CLOSED http://python.org/sf/1733493 opened by Brad Hochstetler Modules/ld_so_aix needs to strip path off of whichcc call (2007-06-08) http://python.org/sf/1733509 opened by Brad Hochstetler zlib configure behaves differently than main configure (2007-06-08) http://python.org/sf/1733513 opened by Brad Hochstetler setup.py incorrect for HP (2007-06-08) CLOSED http://python.org/sf/1733518 opened by Brad Hochstetler HP shared object option (2007-06-08) http://python.org/sf/1733523 opened by Brad Hochstetler HP automatic build of zlib (2007-06-08) http://python.org/sf/1733532 opened by Brad Hochstetler windows 64 bit builds (2007-06-08) CLOSED http://python.org/sf/1733536 opened by Brad Hochstetler HP 64 bit does not run (2007-06-08) http://python.org/sf/1733544 opened by Brad Hochstetler AIX shared object build of python 2.5 does not work (2007-06-08) http://python.org/sf/1733546 opened by Brad Hochstetler RuntimeWarning: tp_compare didn't return -1 or -2 (2007-06-08) http://python.org/sf/1733757 opened by Fabio Zadrozny Tkinter is not working on trunk (2.6) (2007-06-09) http://python.org/sf/1733943 opened by Hirokazu Yamamoto mmap.mmap can overrun buffer (2007-06-09) http://python.org/sf/1733986 opened by Roger Upole struct.Struct.size is not documented (2007-06-09) http://python.org/sf/1734111 opened by Yang Yang sqlite3 causes memory read error (2007-06-10) http://python.org/sf/1734164 opened by atsuo ishimoto Repr class from repr module ignores maxtuple attribute (2007-06-11) CLOSED http://python.org/sf/1734723 opened by Jason Roberts Tutorial Section 6.4 (2007-06-10) CLOSED http://python.org/sf/1734732 opened by Eric Naeseth sitecustomize.py not found (2007-06-11) http://python.org/sf/1734860 opened by www.spirito.de file.read() truncating strings under Windows (2007-06-12) http://python.org/sf/1735418 opened by cgkanchi Add O_NOATIME to os module (2007-06-12) http://python.org/sf/1735632 opened by sam morris Mac build fails if not building universal due to libtool (2007-06-12) http://python.org/sf/1736103 opened by Jack Jansen os.popen('yes | echo hello') stuck (2007-06-13) http://python.org/sf/1736483 opened by Eric dict reentrant/threading bug (2007-06-13) http://python.org/sf/1736792 opened by Adam Olsen re.findall hangs python completely (2007-06-14) http://python.org/sf/1737127 reopened by abakker re.findall hangs python completely (2007-06-14) http://python.org/sf/1737127 opened by Arno Bakker Add/Remove programs shows Martin v Löwis (2007-06-14) http://python.org/sf/1737210 opened by Simon Dahlbacka telnetlib.Telnet does not process DATA MARK (DM) (2007-06-15) http://python.org/sf/1737737 opened by Norbert Buchmüller logging.exception() does not allow empty string (2007-06-15) CLOSED http://python.org/sf/1737864 opened by Dmitrii Tisnek parser error : out of memory error (2007-06-15) CLOSED http://python.org/sf/1738193 opened by paul beard Universal MacPython 2.5.1 installation fails (2007-06-16) http://python.org/sf/1738250 opened by Shinichiro Wachi shutil.move doesn't work when only case changes (2007-06-16) http://python.org/sf/1738441 opened by Gabriel Gambetta Python-2.5.1.tar.bz2 build failed at Centos-4.5 server (2007-06-17) http://python.org/sf/1738559 opened by shuvo sqlite3 doc fix (2007-06-17) CLOSED http://python.org/sf/1738670 opened by Mark Carter Tutorial error in 3.1.2 Strings (2007-06-17) CLOSED http://python.org/sf/1738754 opened by otan Bug assigning list comprehension to __slots__ in python 2.5 (2007-06-18) CLOSED http://python.org/sf/1739107 opened by François Desloges shutil.rmtree's error message is confusing (2007-06-18) CLOSED http://python.org/sf/1739115 opened by Björn Lindqvist Investigated ref leak report related to thread(regrtest.py - (2007-06-18) http://python.org/sf/1739118 opened by Hirokazu Yamamoto Interactive help raise exception while listing modules (2007-06-19) CLOSED http://python.org/sf/1739659 opened by Dmitry Vasiliev xmlrpclib can no longer marshal Fault objects (2007-06-19) http://python.org/sf/1739842 opened by Mike Bonnet asynchat should call "handle_close" (2007-06-20) http://python.org/sf/1740572 opened by billiejoex python: Modules/gcmodule.c:240: update_refs: Assertion `gc-> (2007-06-20) http://python.org/sf/1740599 opened by Sean struct.pack("I", "foo"); struct.pack("L", "foo") should fail (2007-06-21) http://python.org/sf/1741130 opened by Thomas Heller string formatter %x problem with indirectly given long (2007-06-21) http://python.org/sf/1741218 opened by Kenji Noguchi defined format returns error (2007-06-22) CLOSED http://python.org/sf/1741524 opened by Ted Bell Odd UDP problems in socket library (2007-06-22) http://python.org/sf/1741898 opened by Jay Sherby Bugs Closed ___________ inspect.formatargspec last argument ignored (2007-05-23) http://python.org/sf/1723875 closed by patrickcd Crash in ctypes callproc function with unicode string arg (2007-05-22) http://python.org/sf/1723338 closed by theller Grammar error in Python Tutorial 2.5 section 8.3 (2007-05-23) http://python.org/sf/1724099 closed by gbrandl Option -OO doesn't remove docstrings (2007-05-21) http://python.org/sf/1722485 closed by gbrandl shlex.split problems on Windows (2007-05-24) http://python.org/sf/1724822 closed by gbrandl docu enhancement for logging.handlers.SysLogHandler (2007-05-17) http://python.org/sf/1720726 closed by vsajip tarfile stops expanding with long filenames (2007-05-16) http://python.org/sf/1719898 closed by gustaebel bsddb.btopen . del of record doesn't update index (2007-05-25) http://python.org/sf/1725862 closed by nnorwitz Typo in ctypes.wintypes definition of WIN32_FIND_DATA field (2007-05-26) http://python.org/sf/1726026 closed by theller bsddb.btopen . del of record doesn't update index (2007-05-26) http://python.org/sf/1726299 closed by nnorwitz 'assert statement' in doc index links to AssertionError (2007-05-29) http://python.org/sf/1727417 closed by gbrandl reading from malformed big5 document hangs cpython (2007-05-31) http://python.org/sf/1728403 closed by perky os.stat producing incorrect / invalid results (2007-05-31) http://python.org/sf/1729170 closed by loewis SVNVERSION redefined during compilation (2007-06-01) http://python.org/sf/1729277 closed by loewis Error in example (2007-05-31) http://python.org/sf/1729280 closed by nnorwitz distutils chops the first character of filenames (2007-02-25) http://python.org/sf/1668596 closed by nnorwitz test_bsddb3 malloc corruption bug #1721309 broken in 2.6 (2007-06-02) http://python.org/sf/1729929 closed by nnorwitz Compiler is not thread safe? (2007-05-16) http://python.org/sf/1720241 closed by loewis getattr([], '__eq__')(some-object) is NotImplemented (2007-06-03) http://python.org/sf/1730322 closed by collinwinter make testall shows many glibc detected malloc corruptions (2007-05-18) http://python.org/sf/1721309 closed by nnorwitz strptime bug in time module (2007-06-03) http://python.org/sf/1730389 closed by bcannon __cmp__ present in type but not instance?? (2007-06-03) http://python.org/sf/1730401 closed by bcannon os._execvpe raises assignment error in python 3000 svn (2007-06-03) http://python.org/sf/1730441 closed by nnorwitz Const(None) in compiler.ast.Return.value (2007-05-09) http://python.org/sf/1715581 closed by collinwinter CGIHttpServer fails if python exe has spaces (2007-05-02) http://python.org/sf/1711608 closed by collinwinter Unable to Start IDLE (2007-06-06) http://python.org/sf/1732160 closed by nnorwitz T_LONGLONG chokes on ints (2007-06-07) http://python.org/sf/1732557 closed by loewis Built-in open function fail. Too many file open (2007-06-07) http://python.org/sf/1732629 closed by gbrandl Built-in open function fail. Too many file open (2007-06-07) http://python.org/sf/1732686 closed by loewis Built-in open function fail. Too many file open (2007-06-07) http://python.org/sf/1732686 closed by gbrandl urllib2 has memory leaks (2006-02-13) http://python.org/sf/1430435 closed by gbrandl AIX Objects/buffereobject.c does not build on AIX (2007-06-08) http://python.org/sf/1733488 closed by loewis AIX Modules/unicodedata.c does not build (2007-06-08) http://python.org/sf/1733493 closed by perky setup.py incorrect for HP (2007-06-08) http://python.org/sf/1733518 closed by loewis windows 64 bit builds (2007-06-08) http://python.org/sf/1733536 closed by loewis ctypes Fundamental data types (2007-04-14) http://python.org/sf/1700455 closed by theller Repr class from repr module ignores maxtuple attribute (2007-06-10) http://python.org/sf/1734723 closed by nnorwitz Tutorial Section 6.4 (2007-06-10) http://python.org/sf/1734732 closed by nnorwitz logging.exception() does not allow empty string (2007-06-15) http://python.org/sf/1737864 closed by gbrandl parser error : out of memory error (2007-06-15) http://python.org/sf/1738193 closed by nnorwitz sqlite3 doc fix (2007-06-17) http://python.org/sf/1738670 closed by nnorwitz Tutorial error in 3.1.2 Strings (2007-06-17) http://python.org/sf/1738754 closed by nnorwitz Bug assigning list comprehension to __slots__ in python 2.5 (2007-06-18) http://python.org/sf/1739107 closed by gbrandl shutil.rmtree's error message is confusing (2007-06-18) http://python.org/sf/1739115 closed by gbrandl Interactive help raise exception while listing modules (2007-06-19) http://python.org/sf/1739659 closed by gbrandl defined format returns error (2007-06-22) http://python.org/sf/1741524 closed by gbrandl New / Reopened RFE __________________ provide a shlex.split alternative for Windows shell syntax (2007-05-24) http://python.org/sf/1724822 reopened by gbrandl add operator.fst and snd functions (2007-05-28) http://python.org/sf/1726697 opened by paul rubin add itertools.ichain function and count.getvalue (2007-05-28) CLOSED http://python.org/sf/1726707 opened by paul rubin -q (quiet) option for python interpreter (2007-05-30) http://python.org/sf/1728488 opened by Marcin Wojdyr ZipFile CallBack Needed... (2007-06-08) http://python.org/sf/1733259 opened by durumdara Newer reply format for imap commands in imaplib.py (2007-06-12) http://python.org/sf/1735509 opened by Naoyuki Tai make colon optional (2007-06-19) CLOSED http://python.org/sf/1739678 opened by Chris add multi-line comments (2007-06-19) CLOSED http://python.org/sf/1739679 opened by Chris RFE Closed __________ add itertools.ichain function and count.getvalue (2007-05-27) http://python.org/sf/1726707 closed by rhettinger new functool: "defaults" decorator (2007-05-15) http://python.org/sf/1719222 closed by rhettinger make colon optional (2007-06-19) http://python.org/sf/1739678 closed by gbrandl add multi-line comments (2007-06-19) http://python.org/sf/1739679 closed by gbrandl

1 0

Vilnius/Post EuroPython PyPy Sprint 12-14th of July
by Armin Rigo June 22, 2007

June 22, 2007

======================================================== Vilnius/Post EuroPython PyPy Sprint 12-14th of July ======================================================== The PyPy team is sprinting at EuroPython again and we invite you to participate in our 3 day long sprint at the conference hotel - Reval Hotel Lietuva. If you plan to attend the sprint we recommend you to listen to the PyPy technical talks (`EuroPython schedule`_) during the conference since it will give you a good overview of the status of development. On the morning of the first sprint day (12th) we will also have a tutorial session for those new to PyPy development. As 3 days is relatively short for a PyPy sprint we suggest to travel back home on the 15th if possible (but it is ok to attend less than 3 days too). ------------------------------ Goals and topics of the sprint ------------------------------ There are many possible and interesting sprint topics to work on - here we list some possible task areas: * completing the missing python 2.5 features and support * write or port more extension modules (e.g. zlib is missing) * identify slow areas of PyPy through benchmarking and work on improvements, possibly moving app-level parts of the Python interpreter to interp-level if useful. * there are some parts of PyPy in need of refactoring, we may spend some time on those, for example: - rctypes and the extension compiler need some rethinking - support for LLVM 2.0 for the llvm backend - ... * some JIT improvement work * port the stackless transform to ootypesystem * other interesting stuff that you would like to work on ...;-) ------------ Registration ------------ If you'd like to come, please subscribe to the `pypy-sprint mailing list`_ and drop a note about your interests and post any questions. More organisational information will be sent to that list. Please register by adding yourself on the following list (via svn): http://codespeak.net/svn/pypy/extradoc/sprintinfo/post-ep2007/people.txt or on the pypy-sprint mailing list if you do not yet have check-in rights: http://codespeak.net/mailman/listinfo/pypy-sprint --------------------------------------- Preparation (if you feel it is needed): --------------------------------------- * read the `getting-started`_ pages on http://codespeak.net/pypy * for inspiration, overview and technical status you are welcome to read `the technical reports available and other relevant documentation`_ * please direct any technical and/or development oriented questions to pypy-dev at codespeak.net and any sprint organizing/logistical questions to pypy-sprint at codespeak.net * if you need information about the conference, potential hotels, directions etc we recommend to look at http://www.europython.org. We are looking forward to meet you at the Vilnius Post EuroPython PyPy sprint! The PyPy team .. See also .. .. _getting-started: http://codespeak.net/pypy/dist/pypy/doc/getting-started.html .. _`pypy-sprint mailing list`: http://codespeak.net/mailman/listinfo/pypy-sprint .. _`the technical reports available and other relevant documentation`: http://codespeak.net/pypy/dist/pypy/doc/index.html .. _`EuroPython schedule`: http://indico.cern.ch/conferenceTimeTable.py?confId=13919&showDate=all&show…

1 0

Calling Methods from Pythons C API with Keywords
by Campbell Barton June 21, 2007

June 21, 2007

Hey Guys, My first post on this list so I hope this is the right place to post and relevant. Im rewriting parts of the Blender3D python API that has got a bit old and needs an update. Im making a PyList subtype with the C/Python API, this involves intercepting calls to standard list methods to make sure Blenders array data is in Sync with the list's data. Iv got it working for tp_as_sequence, tp_as_mapping, iter and dealloc etc but methods are a problem. I want to add my own call's before and after PyLists standard functions but have a proplem with functons that use keywords and have no API equivalent. For example, I cant use the API's PyList_Sort because that dosnt support keywords like... ls.sort(key=lambda a: a.foo)) And the Problem with PyObject_CallMethod is that it dosnt accept keywords. PyObject_CallMethod((PyObject *)mylist, "sort", "O", args); Looking at abstract.c, PyObject_CallMethod uses call_function_tail, which calls "PyObject_Call(callable, args, NULL);" - so Its not currently possible with PyObject_CallMethod. But I cant find any way to do this in a few lines. I could use PyEval_CallObjectWithKeywords but that would mean Id need to get the method from the list manually which Ill look into, but unless Im missing something here, it seems PyObject_CallMethodWithKeywords would be a nice addition to the Python API that cant be done in a straight forward way at the moment. - Thanks

3 9

Wanted: readers for a mailbox.py article
by A.M. Kuchling June 21, 2007

June 21, 2007

I'm writing an article about the mailbox module for an online publication, and would like to get comments on the current draft from people familiar with the module. If you'd like to take a look, please e-mail me and I'll tell you the draft's URL. --amk

1 0