Mailman 3 December 2007 - Python-Dev

2.5.2 is coming
by Neal Norwitz 23 Dec '07

23 Dec '07

We are planning the release of 2.5.2 for next week. Unless there are serious bugs, please hold off making big changes to the 2.5 branch until after 2.5.2 final is released. Anthony gets cranky when things break and he scares me...a lot. :-) Doc/test fixes as always are still fine. The plan is cut the release candidate around Tuesday/Wednesday next week (Oct 16/17). If all goes well, 2.5.2 final will follow a week later. Please test the 2.5 branch now and let us know if there are any serious problems. If there are serious bugs that you think should be addressed, let us know. Bugs are here: http://bugs.python.org/ I see the bugs below as possibly needing attention. Any comments on these? http://bugs.python.org/issue1692335 Fix exception pickling: Move initial args assignment to BaseException.__new__ http://bugs.python.org/issue815646 thread unsafe file objects cause crash http://bugs.python.org/issue1179 Integer overflow in imageop module I think Anthony might have a patch for 1179. Cheers, n

4 5

svn.python.org ?
by Joseph Armbruster 23 Dec '07

23 Dec '07

Is svn.python.org ok? I am unable to perform an update at the moment. Joseph Armbruster

4 4

Updating descrintro
by Titus Brown 22 Dec '07

22 Dec '07

Hi all, re http://www.python.org/download/releases/2.2.3/descrintro/ on "Unifying types and classes in Python 2.2", we have a GHOP task to "fill in" the Additional Topics section of this document. 'novanasa', the student who took this task, has written up a nice set of doctest additions in reST: http://code.google.com/p/google-highly-open-participation-psf/issues/attach… and has asked for feedback. My feedback at the moment is, "looks good, and useful!" I thought I'd ask on python-dev to see if anyone has any additional comments or ways to make this more directly useful to Python. You can just add comments on to the task directly, if you like, or send them to me. One set of possible additions is to go through and make annotations on stuff that is going to change in Py3K. Anything else? cheers, --titus

1 0

Converting tests to unittest/doctest?
by Titus Brown 21 Dec '07

21 Dec '07

Hi all, a bit of grep'ping and personal examination discovered the following tests in trunk/ that could be converted to unittest or doctests. Any thoughts, pro or con? (I understand from Brett that the goal is to eradicate "old-style" tests, by which I think he means tests that do not use unittest or doctest. There are some good reasons to switch to using unittests, not least of which is that you can use a variety of frameworks (nose, py.test) to do value-added wrapping and management of such tests.) Suggestions for additional things to test or tests to modify, clean up, or extend and expand are welcome. thanks, --titus --- test_select test_contains test_crypt test_dbm test_dummy_threading test_errno test_getargs test_gdbm test_pep247 test_strftime test_thread test_queue test_fcntl test_format test_curses test_descr test_funcattrs test_gdbm test_socketserver

3 3

Re: [Python-Dev] epoll() and kqueue wrapper for the select module
by Ross Cohen 21 Dec '07

21 Dec '07

On Fri, Dec 21, 2007 at 11:28:55AM +0100, Christian Heimes wrote: > Your wrapper is a good implementation. I even found an inconvenience in > my implementation when I studied your code. My wrapper raised an > exception when a closed fd was removed with EPOLL_CTL_DEL. It should be a good reference, it's gotten a lot of testing. > > I would also claim that adding a new interface to accomplish the same > > task is not more pythonic. But I did write the python-epoll module in > > question, so I may be a bit biased. > > I agree with Gregory on that part of your answer. I think we can both be right. The select.poll() code does not really map to the low level poll() call. In fact, it maps much better to the epoll() call. It appears that your new API is really a superset of the the select.poll() interface. The only thing which keeps a user from just importing your module and using it with code which uses the existing interface is that you've changed names. Why not change the names so that it Just Works? Also, everything but the edge-triggered functionality could be incorporated back into the select.poll() interface (where "everything" means the modify() call.) Ross

1 0

Make socket support TIPC
by Alberto Bertogli 21 Dec '07

21 Dec '07

Hi! I wrote a patch adding TIPC support to the socket module, you can find it in http://bugs.python.org/issue1646. TIPC (http://tipc.sf.net) is an open protocol designed for use in clustered computer environments. It currently has an open source implementation for Linux (>= 2.6.16), and VxWorks. On #python-dev, a very friendly person (whose name/nick I can't recall, I had a power cut and lost my IRC session) helped me with the submission explained that the patch will probably get rejected in order to keep the core slim, and suggested I should send an email to this mailing list so it can be discussed. I already wrote an external module to support TIPC (http://auriga.wearlab.de/~alb/pytipc/), but given that the socket module already supports Linux-specific protocols (AF_PACKET and AF_NETLINK), and the code impact was (IMHO) small, I wrote a patch to add TIPC support. The patch consists of adding the TIPC constants, and modifying makesockaddr(), getsockaddrarg() and getsockaddrlen() to handle the TIPC addresses. No generic code is changed. Compilation is completely conditional on having the TIPC headers, and has no runtime dependencies. The diff adds 156 new lines and changes 2, and on x86 increases code size by about 2k: text data bss dec hex filename 37158 11980 20 49158 c006 /tmp/so/wo-tipc.so 39162 11980 20 51162 c7da /tmp/so/w-tipc.so Thanks a lot, Alberto

1 1

Summary of Tracker Issues
by Tracker 21 Dec '07

21 Dec '07

ACTIVITY SUMMARY (12/14/07 - 12/21/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1366 open (+27) / 11799 closed (+27) / 13165 total (+54) Open issues with patches: 426 Average duration of open issues: 689 days. Median duration of open issues: 926 days. Open Issues Breakdown open 1358 (+27) pending 8 ( +0) Issues Created Or Reopened (54) _______________________________ Py_Size() should be named Py_SIZE() 12/14/07 CLOSED http://bugs.python.org/issue1629 created rhettinger sys.maxint is documented but should not be 12/15/07 CLOSED http://bugs.python.org/issue1630 created blair py3k Send output from subprocess.Popen objects to any object with a w 12/15/07 CLOSED http://bugs.python.org/issue1631 created ngrover email cannot be imported 12/15/07 CLOSED http://bugs.python.org/issue1632 created Wubbulous smtplib 12/15/07 CLOSED http://bugs.python.org/issue1633 created Wubbulous with Statement SyntaxError generated while following Tutorial 12/15/07 CLOSED http://bugs.python.org/issue1634 created astral451 Float patch for inf and nan on Windows (and other platforms) 12/15/07 CLOSED http://bugs.python.org/issue1635 created tiran py3k, patch Execfile unable to take arguments beyond 255! 12/16/07 http://bugs.python.org/issue1636 created jgatkinsn urlparse.urlparse misparses URLs with query but no path 12/16/07 http://bugs.python.org/issue1637 created nagle %zd configure test fails on Linux 12/16/07 CLOSED http://bugs.python.org/issue1638 created hniksic Low ascii 12 characters found in source. 12/17/07 CLOSED http://bugs.python.org/issue1639 created JosephArmbruster Enhancements for mathmodule 12/17/07 http://bugs.python.org/issue1640 created tiran patch asyncore delayed calls feature 12/17/07 http://bugs.python.org/issue1641 created giampaolo.rodola segfault when deleting value member in ctypes types 12/17/07 CLOSED http://bugs.python.org/issue1642 created cfbolz Add group() to itertools 12/18/07 CLOSED http://bugs.python.org/issue1643 created KirkMcDonald Patch submission guidelines outdated 12/18/07 CLOSED http://bugs.python.org/issue1644 created albertito Fix socketmodule.c:sock_recvfrom_guts() comment. 12/18/07 CLOSED http://bugs.python.org/issue1645 created albertito patch Make socket support TIPC. 12/18/07 http://bugs.python.org/issue1646 created albertito patch IDLE messes around with sys.exitfunc 12/18/07 http://bugs.python.org/issue1647 created tiran py3k add new function, sys.gettrace 12/18/07 http://bugs.python.org/issue1648 created titus patch IDLE error: dictionary changed size during iteration 12/18/07 CLOSED http://bugs.python.org/issue1649 created tiran IDLE: help() displays output on the wrong shell 12/18/07 http://bugs.python.org/issue1650 created tiran Limit the max size of PyUnicodeObject->defenc? 12/18/07 http://bugs.python.org/issue1651 created tiran py3k subprocess should have an option to restore SIGPIPE to default a 12/18/07 http://bugs.python.org/issue1652 created cjwatson a couple of documentation issues 12/18/07 CLOSED http://bugs.python.org/issue1653 created JosephArmbruster HTTPSConnection is not IPv6-capable 12/18/07 CLOSED http://bugs.python.org/issue1654 created dmorr imaplib is not IPv6-capable 12/18/07 http://bugs.python.org/issue1655 created dmorr patch Make math.{floor,ceil}(float) return ints per PEP 3141 12/19/07 http://bugs.python.org/issue1656 created jyasskin patch [patch] epoll and kqueue wrappers for the select module 12/19/07 http://bugs.python.org/issue1657 created tiran py3k, patch "RuntimeError: dictionary changed size during iteration" in Tkin 12/19/07 http://bugs.python.org/issue1658 created quentin.gallet-gilles patch Tests needing network flag? 12/19/07 http://bugs.python.org/issue1659 created skip.montanaro Tests needing network flag? 12/19/07 CLOSED http://bugs.python.org/issue1660 created skip.montanaro re.match ignores optional flags when receiving a compiled regex 12/19/07 CLOSED http://bugs.python.org/issue1661 created bcorfman [patch] assert tp_traverse in PyType_GenericAlloc() 12/19/07 http://bugs.python.org/issue1662 created bsilverthorn patch Modification HTMLParser.py 12/19/07 CLOSED http://bugs.python.org/issue1663 created diegorubenarias nntplib is not IPv6-capable 12/19/07 http://bugs.python.org/issue1664 created dmorr patch re.match.func_code.co_filename returns "re.py" 12/19/07 CLOSED http://bugs.python.org/issue1665 created thekorn integer subclass range behavior 12/20/07 CLOSED http://bugs.python.org/issue1666 created JosephArmbruster license() does not process keyboard input correctly 12/20/07 CLOSED http://bugs.python.org/issue1667 created JosephArmbruster -E command line parameter intent 12/20/07 http://bugs.python.org/issue1668 created JosephArmbruster patch shutil.rmtree fails on symlink, after deleting contents 12/20/07 http://bugs.python.org/issue1669 created Tesiph Threading.Condition.wait is non-iteruptable 12/20/07 CLOSED http://bugs.python.org/issue1670 created ronaldoussoren "World" tool ported to py3k 12/20/07 CLOSED http://bugs.python.org/issue1671 created quentin.gallet-gilles py3k, patch test_subprocess tempfile issue 12/20/07 CLOSED http://bugs.python.org/issue1672 created JosephArmbruster patch test_pep277 fails 12/20/07 CLOSED http://bugs.python.org/issue1673 created JosephArmbruster pythonw.exe crashes when run in one particular account on Window 12/20/07 http://bugs.python.org/issue1674 created Mr.E Race condition in os.makedirs 12/20/07 http://bugs.python.org/issue1675 created ijmorlan Fork/exec issues with Tk 8.5/Python 2.5.1 on OS X 12/21/07 http://bugs.python.org/issue1676 created wordtech Ctrl-C will exit out of Python interpreter in Windows 12/21/07 http://bugs.python.org/issue1677 created Dude-X py3k description of startswith is confused 12/21/07 CLOSED http://bugs.python.org/issue1678 created mft tokenizer permits invalid hex integer 12/21/07 http://bugs.python.org/issue1679 created MartinRinehart what is decimal.Context.get_manager()? 12/21/07 http://bugs.python.org/issue1680 created mft parameter name for optparse parse_args incorrect 12/21/07 http://bugs.python.org/issue1681 created wichert Move Demo/classes/Rat.py to Lib/rational.py and fix it up. 12/21/07 http://bugs.python.org/issue1682 created jyasskin Issues Now Closed (44) ______________________ Tools/msi/msi.py does not work with PCBuild8 53 days http://bugs.python.org/issue1337 tiran test_import breaks on Linux 42 days http://bugs.python.org/issue1377 tiran py3k VS2008, quick hack for distutils.msvccompiler 32 days http://bugs.python.org/issue1455 amaury.forgeotdarc py3k, patch building python 2.6 with VC Express 2008 Beta2 31 days http://bugs.python.org/issue1465 tiran patch SSL tests leak memory 25 days http://bugs.python.org/issue1469 gvanrossum py3k Patch to remove API to create new unbound methods 26 days http://bugs.python.org/issue1497 georg.brandl py3k, patch Regression with __hash__ definition and rich comparison operator 17 days http://bugs.python.org/issue1549 therve patch Backport sys.maxsize to Python 2.6 13 days http://bugs.python.org/issue1570 tiran Patch for signal.set_wakeup_fd 9 days http://bugs.python.org/issue1583 gvanrossum patch test_re.py fails 7 days http://bugs.python.org/issue1609 cartman test_socket.py fails 2 days http://bugs.python.org/issue1610 tiran Remove output comparison for test_pep277 1 days http://bugs.python.org/issue1624 tiran patch test_distutils unit test is failing rev:59499 0 days http://bugs.python.org/issue1628 tiran py3k Py_Size() should be named Py_SIZE() 5 days http://bugs.python.org/issue1629 gvanrossum sys.maxint is documented but should not be 0 days http://bugs.python.org/issue1630 tiran py3k Send output from subprocess.Popen objects to any object with a w 4 days http://bugs.python.org/issue1631 gvanrossum email cannot be imported 4 days http://bugs.python.org/issue1632 gvanrossum smtplib 0 days http://bugs.python.org/issue1633 brett.cannon with Statement SyntaxError generated while following Tutorial 0 days http://bugs.python.org/issue1634 georg.brandl Float patch for inf and nan on Windows (and other platforms) 4 days http://bugs.python.org/issue1635 tiran py3k, patch %zd configure test fails on Linux 2 days http://bugs.python.org/issue1638 tiran Low ascii 12 characters found in source. 0 days http://bugs.python.org/issue1639 tiran segfault when deleting value member in ctypes types 1 days http://bugs.python.org/issue1642 theller Add group() to itertools 0 days http://bugs.python.org/issue1643 rhettinger Patch submission guidelines outdated 3 days http://bugs.python.org/issue1644 georg.brandl Fix socketmodule.c:sock_recvfrom_guts() comment. 1 days http://bugs.python.org/issue1645 gvanrossum patch IDLE error: dictionary changed size during iteration 1 days http://bugs.python.org/issue1649 tiran a couple of documentation issues 0 days http://bugs.python.org/issue1653 loewis HTTPSConnection is not IPv6-capable 0 days http://bugs.python.org/issue1654 janssen Tests needing network flag? 0 days http://bugs.python.org/issue1660 skip.montanaro re.match ignores optional flags when receiving a compiled regex 0 days http://bugs.python.org/issue1661 rhettinger Modification HTMLParser.py 1 days http://bugs.python.org/issue1663 facundobatista re.match.func_code.co_filename returns "re.py" 1 days http://bugs.python.org/issue1665 thekorn integer subclass range behavior 1 days http://bugs.python.org/issue1666 loewis license() does not process keyboard input correctly 1 days http://bugs.python.org/issue1667 JosephArmbruster Threading.Condition.wait is non-iteruptable 0 days http://bugs.python.org/issue1670 gvanrossum "World" tool ported to py3k 0 days http://bugs.python.org/issue1671 quentin.gallet-gilles py3k, patch test_subprocess tempfile issue 0 days http://bugs.python.org/issue1672 gvanrossum patch test_pep277 fails 1 days http://bugs.python.org/issue1673 loewis description of startswith is confused 0 days http://bugs.python.org/issue1678 georg.brandl str.__iter__ and unicode.__iter__ 515 days http://bugs.python.org/issue1526367 rhettinger patch use LSB version information to detect a platform 449 days http://bugs.python.org/issue1565037 tiran patch SyntaxWarning for backquotes 343 days http://bugs.python.org/issue1631035 tiran patch Epoll wrapper 288 days http://bugs.python.org/issue1675118 tiran patch Top Issues Most Discussed (10) ______________________________ 25 test_re.py fails 7 days closed http://bugs.python.org/issue1609 15 [patch] epoll and kqueue wrappers for the select module 2 days open http://bugs.python.org/issue1657 12 Use shorter float repr when possible 11 days open http://bugs.python.org/issue1580 11 Float patch for inf and nan on Windows (and other platforms) 4 days closed http://bugs.python.org/issue1635 10 license() does not process keyboard input correctly 1 days closed http://bugs.python.org/issue1667 10 Implement PEP-3141 for Decimal 8 days open http://bugs.python.org/issue1623 9 re.match.func_code.co_filename returns "re.py" 1 days closed http://bugs.python.org/issue1665 9 Enhancements for mathmodule 4 days open http://bugs.python.org/issue1640 9 Py_Size() should be named Py_SIZE() 5 days closed http://bugs.python.org/issue1629 9 str.format() produces different output on different platforms ( 9 days open http://bugs.python.org/issue1600

1 0

epoll() and kqueue wrapper for the select module
by Christian Heimes 21 Dec '07

21 Dec '07

Linux Kernel 2.6+ and BSD (including Mac OS X) have two I/O event notification systems similar but superior to select() and poll(). From the manuals: kqueue, kevent -- kernel event notification mechanism The kqueue() system call provides a generic method of notifying the user when an event happens or a condition holds, based on the results of small pieces of kernel code termed filters. A kevent is identified by the (ident, filter) pair; there may only be one unique kevent per kqueue. epoll - I/O event notification facility epoll is a variant of poll(2) that can be used either as an edge-triggered or a level-triggered interface and scales well to large numbers of watched file descriptors. I've written wrappers for both mechanisms. Both wrappers are inspired from Twisted and select.poll()'s API. The interface is more Pythonic than the available wrappers and it reduced the burden on the user. The users don't have to deal with low level control file descriptors and the fd is closed automatically when the object is collected. epoll interface >>> ep = select.epoll(1) >>> ep.register(fd, select.EPOLL_IN | select.EPOLL_OUT) >>> ep.modify(fd, select.EPOLL_OUT) >>> events = ep.wait(1, 1000) >>> ep.unregister(fd) kqueue interface The kqueue interface is more low level than the epoll interface. It has too many options. >>> kq = select.kqueue() >>> ev = [select.kevent(fd, select.KQ_FILTER_WRITE, select.KQ_EV_ONESHOT | select.KQ_EV_ADD)] >>> kq.control(ev, 0, 0) >>> events = kq.control([], 1, None) I already talked to some Twisted guys and they really like it. A patch is available at http://bugs.python.org/issue1657. The code needs more unit tests and documentation updates. Christian

4 4

Possible bug related with Tkinter ?
by Quentin Gallet-Gilles 20 Dec '07

20 Dec '07

While testing the tkFileDialog, I encountered a strange error : ~/dev/trunk$ ./python Lib/lib-tk/tkFileDialog.py Traceback (most recent call last): File "Lib/lib-tk/tkFileDialog.py", line 202, in <module> openfilename=askopenfilename(filetypes=[("all files", "*")]) File "Lib/lib-tk/tkFileDialog.py", line 125, in askopenfilename return Open(**options).show() File "/home/quentin/dev/trunk/Lib/lib-tk/tkCommonDialog.py", line 48, in show s = w.tk.call(self.command, *w._options(self.options)) _tkinter.TclError: expected floating-point number but got "0.0" Investigating a little, I discovered this is a known issue for some applications like Pyraf and that the following workaround is effective : "env LC_NUMERIC=C ./python Lib/lib-tk/tkFileDialog.py". Looking further, this seems to resolve an atof issue and the fact that Python assumes a C locale while my Linux box actually uses fr_FR.UTF-8, but I have a hard time determining if that a Python issue, a TCL issue or something else. Has someone already encountered this ? Quentin

2 1

integer subclass range behavior
by Joseph Armbruster 19 Dec '07

19 Dec '07

All, I posted this up to comp.lang.python earlier today and asked a few questions around IRC. The general consensus appeared to be that this was a bug. Before opening up an issue on it, I wanted to run it by this list first (just in case) Here is a copy / paste from comp.lang.python: URL: http://groups.google.com/group/comp.lang.python/browse_frm/thread/801f227fc… Post: I was wondering what would happen, so I tried this out for the heck of it with: Python 3.0a2 (py3k:59572M, Dec 19 2007, 15:54:07) [MSC v.1500 32 bit (Intel)] on win32 class a(int): def __new__(cls,number): return int.__new__(cls,number) for x in range(0,a(5)): print(x) Which resulted in a: Traceback (most recent call last): File "<stdin>", line 1, in <module> File "a.py", line 5, in <module> for x in range(0,a(5)): SystemError: ..\Objects\longobject.c:400: bad argument to internal function [41030 refs] It looks like the rangeobject performs a FitsInLong test on each of the parameters to range, which uses the function _PyLong_FitsInLong(PyObject *vv) within longobject.c. In tern, this performs a typecheck: #define PyLong_CheckExact(op) (Py_TYPE(op) == &PyLong_Type) that fails. Interesting!

2 1