Mailman 3 November 2008 - Python-Dev

Taint Mode in Python 3.0 RC3
by Nicole King 28 Nov '08

28 Nov '08

Dear All, Apologies that web site was not working earlier. I believe that I've now fixed it. The patch can still be found at http://www.cats-muvva.net/software/Python-taint-diff-3.0rc3.tar.bz2. CatsMuvva

2 1

Re: [Python-Dev] Python for windows.
by Bugbee, Larry 28 Nov '08

28 Nov '08

Gerald, if there is an expectation some of your HP windows users would like to use OpenSSL with Python, there is this little matter of including applink.c in the build. All, and not to start flames, but I still do not understand why applink.c isn't included in python's main (conditionally) instead of expecting users, many of them novices, to do the build. ??? Larry [snip] Message: 2 Date: Wed, 26 Nov 2008 19:06:44 +0000 From: "Koenig, Gerald" <gerald.koenig(a)hp.com> Subject: [Python-Dev] Python for windows. To: "python-dev(a)python.org" <python-dev(a)python.org> Message-ID: <238A96A773B3934685A7269CC8A8D0423F7FBF71E9(a)GVW0436EXB.americas.hpqcorp. net> Content-Type: text/plain; charset="us-ascii" Hi all, I am working For Hewlett-Packard designing PC Consumer Desktop We have been including Python since over 10 years now on our systems. It is a wonderful language and very powerful. Now I am having a small issue and I was wondering how I can solve it. So I would like to know who should I contact to be able to work on that issue together ? The issue is about some requirement I need to have on our systems and even tools need to pass those requirement. Regards Gerald Koenig Software Builds Architect Hewlett-Packard Work Phone: +(1) 408 873 6202 ------------------------------ [snip]

6 11

socket.c, _rbufsize
by Kristján Valur Jónsson 28 Nov '08

28 Nov '08

I came across this in socket.c: # _rbufsize is the suggested recv buffer size. It is *strictly* # obeyed within readline() for recv calls. If it is larger than # default_bufsize it will be used for recv calls within read(). What I worry about is the readline() case. Is there a reason why we want to strictly obey it for that function? Note that in the documentation for _fileobject.read() it says: # Use max, disallow tiny reads in a loop as they are very inefficient. The same argument surely applies for readline(). The reason I am fretting about this is that httplib.py (and therefore xmlrpclib.py) specify bufsize=0 when createing their socket fileobjects, presumably to make sure that write() operations are not buffered but flushed immediately. But this has the side effect of setting the _rbufsize to 1, and so readline() calls become very slow. I suggest that readline() be made to use at least defaultbufsize, like read(). Any thoughts? Cheers, Kristján

2 1

Re: [Python-Dev] [Python-3000] 2.6.1 and 3.0
by "Martin v. Löwis" 28 Nov '08

28 Nov '08

> I always wondered why it was necessary to write msi.py in the first > place. Maintaining it is surely a big effort and requires understanding > of a dark library which a few people have (IMO it's a much higher effort > than setting up automated tests in a bunch of VM, which you said is "not > worth it"). > > There are plenty of MSI installer generator programs Originally it was written because none of the MSI generator programs were capable of packaging Python. In particular, none was capable of creating 64-bit packages (which were first needed to create the Itanium packages). > and Python's needs > do not seem so weird to require a custom MSI generator. Python's needs are fairly weird, so I'm very skeptical that any other generator is capable of doing what msi.py does (or, if it was capable of doing that, that it was then any simpler than msi.py). The critical part is that you need a powerful way to specify what files to package (having to select them in a UI is unacceptable, as the set of files constantly changes - the current generator can cope with many types of file additions without needing any change). > I'm sure the > Python Software Foundation would easily get a free license of one of the > good commercial MSI installer generators. Can you recommend a specific one? In addition, I'm also skeptical wrt. commercial setup tools. We had been using Wise for a while, and it was a management problem because the license was only available on a single machine - so it was difficult for anybody else to jump in and do a release. > In short: if msi.py and the fact it breaks is part of the issue here, > it's very easy to solve in my opinion. I'm very skeptical that this statement is actually true. Regards, Martin

7 16

Taint Mode in Python 3.0 RC3
by Nicole King 28 Nov '08

28 Nov '08

Dear All, I found I needed support for taint mode in python and have done some work to realise this. It's by no means complete at this time, but I'm floating this idea on this group to see how much interest there is. The implementation is pretty simple: - an extra field in PyObject to maintain the taint status - a couple of extra functions __gettaint__() that returns the taint status and __settaint__(value) that sets the taint value, returning the previous status - an additional command-line flag -a and environment variable PYTHONIGNORETAINT that suppress taint checking - a few macros defined in Objects/object.h to support taint management - a new built-in exception, PyExc_TaintError, for reporting operations on tainted objects You can pick up the diff at http://www.cats-muvva.net/software/Python-taint-diff-3.0rc3.tar.bz2 This diff is ONLY for 3.0RC3. Given that I have only a limited understanding of the internals of Python (but it's very clearly written), I'm sure there are some behaviours I've overlooked. I have done very little testing at this point, but, at least, everything compiles! Regards Nicole King (aka CatsMuvva)

1 0

building Tcl/Tk to deploy on other platforms?
by chris 27 Nov '08

27 Nov '08

I built Python 2.5.2 on RedHat3 and wrapped it up with some other stuff that was deployed on RedHat4. When trying to fire up Idle on RedHat4, there is an error that states a usable init.tcl cannot be found. Python is built on RedHat3 against Tcl/Tk 8.3, so even installing Tcl/Tk on RedHat4 would not work, as it is 8.4. I've noticed when Python is installed on Windows, all the necessary stuff is also installed in the Python25 directory. Is there a similar way to do this on linux? Thanks, -Chris

3 5

Module/Setup.dist maintainance
by Matthias Klose 27 Nov '08

27 Nov '08

I was experimenting with profiled builds and building more extensions as builtins instead of loadable modules, noticing that Module/Setup.dist is not kept updated. Currently only the section above the *shared* line is really used for the build, but everything else doesn't seem to be updated (extensions are missing or out of date). Is there another way to build extensions as builtins, or should this file kept be up to date? Matthias

2 1

run 2to3 generated scripts under python2.6 + unicode + extension support
by kai 26 Nov '08

26 Nov '08

there's an alpha-release interpreter based on cpython2.6 that has support for 2.6 extensions, & can automatically generate & import files using 2to3 (& pure python3.0 scripts as well). it consists of 3 files & is intended to coexist w/ an existing python2.6 installation http://pypi.python.org/pypi/py3to2 enclosed is its patch summary against Python-2.6 (most of it deals w/ backporting 3.0 opcodes). here's a test run of it (version 2008.11.23) importing most of Python2.6's standard library regenerated by 2to3: 2TO3 COMPATIBILITY TEST $ python setup.py dev --py2to3test ... tested 200 2to3 generated scripts from 2.6.py3to2 (r26:66714, Nov 25 2008, 22:10:03) [GCC 3.4.6 20060404 (Red Hat 3.4.6-10)] standard library 0 skipped: 23 couldn't import required modules: BaseHTTPServer CGIHTTPServer cgi cookielib copy dummy_threading HTMLParser httplib macurl2path mimetypes os pdb pydoc re robotparser sgmllib SimpleHTTPServer SimpleXMLRPCServer _strptime tempfile threading urllib2 urllib 6 were non-utf8 compliant scripts: base64 getopt heapq shlex smtpd tarfile 14 failed import due to other reasons: anydbm dbhash doctest fractions _LWPCookieJar _MozillaCookieJar pickle sets socket tabnanny UserList UserString whichdb xmlrpclib 158 passed import: _abcoll abc aifc ast asynchat asyncore atexit audiodev Bastion bdb binhex bisect calendar cgitb chunk cmd codecs codeop code collections colorsys commands compileall ConfigParser contextlib Cookie copy_reg cProfile csv decimal difflib dircache dis DocXMLRPCServer dumbdbm dummy_thread filecmp fileinput fnmatch formatter fpformat ftplib functools __future__ genericpath getpass gettext glob gzip hashlib hmac htmlentitydefs htmllib ihooks imaplib imghdr imputil inspect io keyword linecache locale macpath mailbox mailcap markupbase md5 mhlib mimetools MimeWriter mimify modulefinder multifile mutex netrc new nntplib ntpath nturl2path numbers opcode optparse os2emxpath __phello__.foo pickletools pipes pkgutil platform plistlib popen2 poplib posixfile posixpath pprint profile pstats pty pyclbr py_compile pydoc_topics Queue quopri random repr rexec rfc822 rlcompleter runpy sched sha shelve shutil site smtplib sndhdr SocketServer sre_compile sre_constants sre_parse sre ssl stat statvfs StringIO stringold stringprep string struct subprocess sunaudio sunau symbol symtable telnetlib textwrap this _threading_local timeit toaiff tokenize token traceback trace tty types unittest urlparse UserDict user uuid uu warnings wave weakref webbrowser xdrlib xmllib zipfile PYTHON2.6 COMPATIBILITY TEST $ python setup.py dev --maketest ... 324 tests OK. 36 tests skipped: test_aepack test_al test_applesingle test_bsddb185 test_bsddb3 test_cd test_cl test_codecmaps_cn test_codecmaps_hk test_codecmaps_jp test_codecmaps_kr test_codecmaps_tw test_curses test_dl test_gdbm test_gl test_imageop test_imgfile test_kqueue test_linuxaudiodev test_macos test_macostools test_normalization test_ossaudiodev test_pep277 test_py3kwarn test_scriptpackages test_socketserver test_startfile test_sunaudiodev test_timeout test_urllib2net test_urllibnet test_winreg test_winsound test_zipfile64 1 skip unexpected on linux2: test_gdbm completed 2.6 (r26:66714, Nov 17 2008, 13:35:14) [GCC 3.4.6 20060404 (Red Hat 3.4.6-10)] regression tests

1 0

Redirecting warnings.showwarning to logging
by Vinay Sajip 25 Nov '08

25 Nov '08

Brett Cannon has suggested [1] that the logging package should provide an implementation of warnings.showwarning which redirects to logging. Here are my first thoughts about how this might work: A new function, showwarning( message, category, filename, lineno[, file]) will be added to the logging package. To redirect all warnings to the logging system, it will only be necessary to do the following: warnings.showwarning = logging.showwarning The implementation of logging.showwarning will call formatwarning(message, category, filename, lineno) and will log the resulting string to a warnings logger named "stdlib.warnings" (or perhaps "std.warnings") with level logging.WARNING. The optional file argument to logging.showwarning is only for signature compatibility with warnings.showwarning and will be ignored; in order to configure logging of warnings to any particular destination, the logging configuration will need to add appropriate handlers to the warnings logger. The precise format of the logging message will be determined by the logging configuration in effect, i.e. any formatters configured for the handlers attached to the logger. Does this sound like a reasonable approach? Can someone please suggest any improvements, or let me know if I've missed anything? Regards, Vinay Sajip [1] http://bugs.python.org/issue4384

7 10

Summary of Python tracker Issues
by Python tracker 25 Nov '08

25 Nov '08

ACTIVITY SUMMARY (11/14/08 - 11/21/08) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 2194 open (+35) / 14007 closed (+18) / 16201 total (+53) Open issues with patches: 728 Average duration of open issues: 712 days. Median duration of open issues: 2043 days. Open Issues Breakdown open 2177 (+35) pending 17 ( +0) Issues Created Or Reopened (56) _______________________________ Tkinter binding involving Control-spacebar raises unicode error 11/18/08 http://bugs.python.org/issue1028 reopened ocean-city patch Byte/string inconsistencies between different dbm modules 11/21/08 http://bugs.python.org/issue3799 reopened brett.cannon patch, needs review type of UserList instance returns class instead of instance 11/14/08 CLOSED http://bugs.python.org/issue4326 created chafporte Patch: simplify complex constant assignment statements 11/14/08 http://bugs.python.org/issue4327 created novalis_dt patch "à" in u"foo" raises a misleading error 11/15/08 http://bugs.python.org/issue4328 created ezio.melotti base64 does not properly handle unicode strings 11/15/08 http://bugs.python.org/issue4329 created mbecker wsgiref.validate doesn't accept arguments to readline 11/16/08 CLOSED http://bugs.python.org/issue4330 created ianb Can't use _functools.partial() created function as method 11/16/08 http://bugs.python.org/issue4331 created ssadler asyncore.file_dispatcher does not use dup()'ed fd 11/17/08 CLOSED http://bugs.python.org/issue4332 created christianbecke patch Reworked Dialog.py 11/17/08 http://bugs.python.org/issue4333 created gpolo patch Mac Build Script is broken for 2.6 release 11/17/08 CLOSED http://bugs.python.org/issue4334 created ngift inspect.getsourcelines ignores last line in module 11/17/08 http://bugs.python.org/issue4335 created RafeSacks Fix performance issues in xmlrpclib 11/17/08 http://bugs.python.org/issue4336 created krisvale patch, patch, easy Iteration over a map object with list() 11/17/08 CLOSED http://bugs.python.org/issue4337 created jmfauth TypeError (bytes/str) in distutils command "upload" 11/17/08 CLOSED http://bugs.python.org/issue4338 created hagen patch Fix set-like dictview doc 11/17/08 CLOSED http://bugs.python.org/issue4339 created tjreedy xmlrpc.client - default 'SlowParser' not defined 11/17/08 http://bugs.python.org/issue4340 created mwatkins Update __hash__ doc 11/17/08 CLOSED http://bugs.python.org/issue4341 created tjreedy (Tkinter) Please backport these 11/18/08 http://bugs.python.org/issue4342 created gpolo New function in Tkinter.py: setup_master 11/18/08 http://bugs.python.org/issue4343 created gpolo patch crash upon launch 11/18/08 CLOSED http://bugs.python.org/issue4344 created source.mod Implement nb_nonzero for PyTclObject 11/18/08 http://bugs.python.org/issue4345 created gpolo patch PyObject_CallMethod changes the exception message already set by 11/18/08 http://bugs.python.org/issue4346 created gpolo patch Dependencies of graminit.h are not rebuilt when the file is rege 11/18/08 http://bugs.python.org/issue4347 created thomas.lee patch bytearray methods returning self 11/18/08 CLOSED http://bugs.python.org/issue4348 created DinoV patch, needs review sys.path includes extraneous junk 11/18/08 CLOSED http://bugs.python.org/issue4349 created exarkun patch, needs review Remove dead code from Tkinter.py 11/19/08 http://bugs.python.org/issue4350 created gpolo patch [PATCH] Better stacklevel for GzipFile.filename DeprecationWarni 11/19/08 http://bugs.python.org/issue4351 created pjenvey patch imp.find_module() fails with a UnicodeDecodeError when called wi 11/19/08 http://bugs.python.org/issue4352 created Jukka Aho Move description what a trace should should return to settrace f 11/19/08 CLOSED http://bugs.python.org/issue4353 created rocky distutils.command.register is broken 11/19/08 CLOSED http://bugs.python.org/issue4354 created hagen patch Error in docs of urllib.request and urllib.parse 11/19/08 http://bugs.python.org/issue4355 created hagen patch Add "key" argument to "bisect" module functions 11/19/08 CLOSED http://bugs.python.org/issue4356 created tebeka frozen?set operations create incorrectly initialized instances o 11/19/08 CLOSED http://bugs.python.org/issue4357 created alexhsamuel Segfault in stringobject.c 11/19/08 http://bugs.python.org/issue4358 created farshad at runtime, distutils uses buildtime files 11/19/08 http://bugs.python.org/issue4359 created a.badger SystemError when method has both super() & closure 11/20/08 CLOSED http://bugs.python.org/issue4360 created kaizhu patch Docstring for "Lib/string.py" is outdated 11/20/08 http://bugs.python.org/issue4361 created thp patch FileIO object in io module 11/20/08 CLOSED http://bugs.python.org/issue4362 reopened barry patch, needs review Make uuid module functions usable without ctypes 11/20/08 http://bugs.python.org/issue4363 created hdima patch error in multiprocessing docs - rawvalue 11/20/08 http://bugs.python.org/issue4364 created dursobr Add CRT version info in msvcrt module 11/20/08 http://bugs.python.org/issue4365 created cdavid patch cannot find -lpython2.5 when buinding Python 2.5.2 on FreeBSD 4. 11/20/08 http://bugs.python.org/issue4366 created akitada segmentation fault in ast_for_atom 11/20/08 http://bugs.python.org/issue4367 created ot patch, needs review A bug in ncurses.h still exists in FreeBSD 4.9 - 4.11 11/20/08 http://bugs.python.org/issue4368 created akitada patch Error building to a nonstandard prefix (with patch) 11/20/08 http://bugs.python.org/issue4369 created ot patch warning: unknown conversion type character `z' in format 11/20/08 http://bugs.python.org/issue4370 created akitada coerce gone---but not from docs 11/20/08 http://bugs.python.org/issue4371 created LambertDW __cmp__ removal not in What's New 11/20/08 CLOSED http://bugs.python.org/issue4372 created tjreedy Reference leaks in Python 3.0rc3 11/21/08 http://bugs.python.org/issue4373 created christian.heimes patch Pickle tests fail w/o _pickle extension 11/21/08 http://bugs.python.org/issue4374 created christian.heimes inspect.getsource doesn't work with PYTHONPATH and source compil 11/21/08 http://bugs.python.org/issue4375 created erickt Nested ctypes 'BigEndianStructure' fails 11/21/08 http://bugs.python.org/issue4376 created castironpi tokenize.detect_encoding() and Mac newline 11/21/08 http://bugs.python.org/issue4377 created haypo howto doc update 11/21/08 http://bugs.python.org/issue4378 created LambertDW Fix exception pickling: Move initial args assignment to BaseExce 11/18/08 http://bugs.python.org/issue1692335 reopened gvanrossum patch Issues Now Closed (40) ______________________ Problem with doctest and decorated functions 441 days http://bugs.python.org/issue1108 skip.montanaro conditional jump to a POP_TOP optimization 253 days http://bugs.python.org/issue2260 rhettinger patch NULL member in modules_by_index 131 days http://bugs.python.org/issue3327 loewis patch, easy test_cpickle crash on AMD64 Windows build 88 days http://bugs.python.org/issue3640 loewis patch, 64bit pressing HOME key in IDLE editor ends IDLE 81 days http://bugs.python.org/issue3679 tjreedy configure --with-threads on cygwin => crash on thread related te 58 days http://bugs.python.org/issue3947 ocean-city patch ignored exceptions in generators (regression?) 43 days http://bugs.python.org/issue4040 benjamin.peterson Document the effects of NotImplemented on == and != 43 days http://bugs.python.org/issue4087 marketdickinson Documenting set comparisons and operations 39 days http://bugs.python.org/issue4090 rhettinger patch name conflict in ScrolledCanvas.__init__() in Lib/turtle.py 36 days http://bugs.python.org/issue4116 loewis patch "__getattr__" can't be a descriptor 19 days http://bugs.python.org/issue4230 benjamin.peterson patch Python 2.6 installer crashes when selecting 'advanced' and cance 10 days http://bugs.python.org/issue4289 loewis email package with unicode subject/body 8 days http://bugs.python.org/issue4306 barry patch Unicode in distutils meta-data? 4 days http://bugs.python.org/issue4312 loewis IDLE segfault at exit 5 days http://bugs.python.org/issue4313 ocean-city Improper use of [] in configure.in leads to useless regexp in co 2 days http://bugs.python.org/issue4316 georg.brandl patch Buffer overflow in imageop module 5 days http://bugs.python.org/issue4317 amaury.forgeotdarc patch unintended syntax error with decorators, parenthesis, and dots? 1 days http://bugs.python.org/issue4321 georg.brandl locale documentation is inconsistent 1 days http://bugs.python.org/issue4324 georg.brandl type of UserList instance returns class instead of instance 3 days http://bugs.python.org/issue4326 georg.brandl wsgiref.validate doesn't accept arguments to readline 1 days http://bugs.python.org/issue4330 ianb asyncore.file_dispatcher does not use dup()'ed fd 3 days http://bugs.python.org/issue4332 josiahcarlson patch Mac Build Script is broken for 2.6 release 0 days http://bugs.python.org/issue4334 benjamin.peterson Iteration over a map object with list() 1 days http://bugs.python.org/issue4337 jmfauth TypeError (bytes/str) in distutils command "upload" 3 days http://bugs.python.org/issue4338 amaury.forgeotdarc patch Fix set-like dictview doc 0 days http://bugs.python.org/issue4339 benjamin.peterson Update __hash__ doc 0 days http://bugs.python.org/issue4341 benjamin.peterson crash upon launch 0 days http://bugs.python.org/issue4344 loewis bytearray methods returning self 1 days http://bugs.python.org/issue4348 benjamin.peterson patch, needs review sys.path includes extraneous junk 0 days http://bugs.python.org/issue4349 benjamin.peterson patch, needs review Move description what a trace should should return to settrace f 1 days http://bugs.python.org/issue4353 benjamin.peterson distutils.command.register is broken 1 days http://bugs.python.org/issue4354 loewis patch Add "key" argument to "bisect" module functions 1 days http://bugs.python.org/issue4356 marketdickinson frozen?set operations create incorrectly initialized instances o 0 days http://bugs.python.org/issue4357 amaury.forgeotdarc SystemError when method has both super() & closure 0 days http://bugs.python.org/issue4360 barry patch FileIO object in io module 0 days http://bugs.python.org/issue4362 benjamin.peterson patch, needs review __cmp__ removal not in What's New 1 days http://bugs.python.org/issue4372 haypo Using deiconify() hangs on exit 2646 days http://bugs.python.org/issue453489 amaury.forgeotdarc sys.stdout problems with pythonw.exe 1616 days http://bugs.python.org/issue973507 amaury.forgeotdarc A subclass of set doesn't always have __init__ called. 547 days http://bugs.python.org/issue1721812 rhettinger patch Top Issues Most Discussed (10) ______________________________ 15 datetime: define division timedelta/timedelta 208 days open http://bugs.python.org/issue2706 12 Tkinter binding involving Control-spacebar raises unicode error 4 days open http://bugs.python.org/issue1028 10 TypeError (bytes/str) in distutils command "upload" 3 days closed http://bugs.python.org/issue4338 10 type of UserList instance returns class instead of instance 3 days closed http://bugs.python.org/issue4326 10 missing update() in _Screen.setup() of Lib/turtle.py 39 days open http://bugs.python.org/issue4117 10 Byte/string inconsistencies between different dbm modules 1 days open http://bugs.python.org/issue3799 8 FileIO object in io module 0 days closed http://bugs.python.org/issue4362 8 bytearray methods returning self 1 days closed http://bugs.python.org/issue4348 7 Reference leaks in Python 3.0rc3 1 days open http://bugs.python.org/issue4373 7 SystemError when method has both super() & closure 0 days closed http://bugs.python.org/issue4360

5 7