Mailman 3 September 2008 - Python-Dev

2.6 doc searching issue?
by skip＠pobox.com Sept. 7, 2008

Sept. 7, 2008

>From this page: http://docs.python.org/dev/index.html I searched for "csv" and got just one hit: http://docs.python.org/dev/contents.html?highlight=csv Shouldn't it have at least matched the docs for the csv module itself, not just the table of contents? Thx, Skip

2 1

xmlrpc via proxy for bzr and bugzilla in 2.6
by techtonik Sept. 5, 2008

Sept. 5, 2008

With 2.6rc1 at the doors people are asking if xmlrpclib will be able to communicate through a proxy? It causes bzr and bugzilla tools to fail if used behind firewall, and there is no easy workaround for users. http://bugs.python.org/issue648658 -- --anatoly t.

2 1

site.py and the checkout builddir
by Benjamin Peterson Sept. 5, 2008

Sept. 5, 2008

In a checkout, site.py is currently responsible for adding the distutils extension module builddir to sys.path. Usually, this is unproblematic. However, when the initialization code needed by site (in this case the standard io streams and the builtin open) relies on C modules added from the builddir in site.py, it causes silent errors. The calls to initstdio and initsite were moved to having the site initialization first in r62778, so that _bytesio and _stringio could be used when io was loaded. Unfortunately, site.py uses open, but this error went undetected because stderr was not set up yet. (See issue #3279) That options as I see it are: 1. Switch the initialization order back to the original (io streams first) and compile _bytesio and _stringio directly into the Python binary. This is probably the easiest option. 2. Switch the initialization order back to the original and have getpath.c put the builddir on sys.path. This might be difficult because finding the distutils buildir seems to involve disutils.utils.get_platform(). (I'm not a disutils expert; can the location of the builddir be simplified?) Anyway, note that this doesn't affect Python which has been installed on a system because the dynlibs are already on sys.path. -- Cheers, Benjamin Peterson "There's no place like 127.0.0.1."

3 3

2.6b3 and 3.0b3 Windows installers
by LRN Sept. 5, 2008

Sept. 5, 2008

I was wondering, when new installers will be published? I made one on my own ( see http://lrn.1986.li/other/python-2.6.14127-x86.msi ), but i am not sure about it's correctness.

1 0

Summary of Python tracker Issues
by Python tracker Sept. 5, 2008

Sept. 5, 2008

ACTIVITY SUMMARY (08/29/08 - 09/05/08) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 2023 open (+35) / 13586 closed (+21) / 15609 total (+56) Open issues with patches: 642 Average duration of open issues: 710 days. Median duration of open issues: 1765 days. Open Issues Breakdown open 2009 (+35) pending 14 ( +0) Issues Created Or Reopened (57) _______________________________ Misleading names for multiprocessing "convenience" functions 09/01/08 CLOSED http://bugs.python.org/issue3589 reopened jnoller needs review import warning in multiprocessing 08/29/08 CLOSED http://bugs.python.org/issue3731 created pitrou bdist_msi gives a deprecation warning when run with Python 2.6 08/29/08 CLOSED http://bugs.python.org/issue3732 created lemburg patch, easy, needs review Adding bin and Scripts folder into PATH 08/29/08 CLOSED http://bugs.python.org/issue3733 created tarek subclassing complex 08/29/08 http://bugs.python.org/issue3734 created gumtree allow multiple threads to efficiently send the same requests to 08/29/08 http://bugs.python.org/issue3735 created DavidDecotigny super is a built-in type 08/29/08 http://bugs.python.org/issue3736 created tarek An error in Python Library Reference document 08/30/08 CLOSED http://bugs.python.org/issue3737 created zouzhile logging.Handler.close does something 08/30/08 CLOSED http://bugs.python.org/issue3738 created LambertDW unicode-internal encoder reports wrong length 08/30/08 http://bugs.python.org/issue3739 created doerwalter PEP 3121 --- module state is not nul-initalized as claimed in th 08/30/08 http://bugs.python.org/issue3740 created _doublep DISTUTILS_USE_SDK set causes msvc9compiler.py to raise an except 08/31/08 http://bugs.python.org/issue3741 created TBBle patch Parsing XML file with Unicode characters causes problem 08/31/08 http://bugs.python.org/issue3742 created jaylogan PY_FORMAT_SIZE_T is not for PyString_FromFormat 08/31/08 http://bugs.python.org/issue3743 created amaury.forgeotdarc patch, needs review make altinstall installs pydoc instead of pydoc3.0 09/01/08 http://bugs.python.org/issue3744 created kune _sha256 et al. encode to UTF-8 by default 09/01/08 http://bugs.python.org/issue3745 created hagen Sphinx producing duplicate id attributes, HTML fails validation. 09/01/08 http://bugs.python.org/issue3746 created gjhiggins Fix caching in ABCMeta.__subclasscheck__ 09/01/08 CLOSED http://bugs.python.org/issue3747 created ncoghlan patch, patch, needs review platform.architecture() prints bogus message on windows 09/01/08 CLOSED http://bugs.python.org/issue3748 created ocean-city patch incrementalencoder and incrementalencoder 09/01/08 CLOSED http://bugs.python.org/issue3749 created mft test_bsddb3 skipped -- cannot import name test_support 09/01/08 CLOSED http://bugs.python.org/issue3750 created pitrou str.rpartition fails silently with unicode argument 09/01/08 CLOSED http://bugs.python.org/issue3751 created forest_atq patch test_bsddb broken 09/01/08 CLOSED http://bugs.python.org/issue3752 created pitrou bytearray incompatible with y# 09/01/08 CLOSED http://bugs.python.org/issue3753 created Frostburn minimal cross-compilation support for configure 09/01/08 http://bugs.python.org/issue3754 created rpetrov patch Lists propagate through new instances of class if using append 09/02/08 CLOSED http://bugs.python.org/issue3755 created supernova_hq re.escape() does not work with bytes() 09/02/08 http://bugs.python.org/issue3756 created andrewmcnamara threading.local doesn't support cyclic garbage collecting 09/02/08 http://bugs.python.org/issue3757 created pitrou "make check" suggest a testing target under GNU coding standards 09/02/08 http://bugs.python.org/issue3758 created ralph.corderoy test_asyncore.py leaks handle 09/02/08 CLOSED http://bugs.python.org/issue3759 created ocean-city patch, easy PEP 3121 --- PyType_Copy is missing 09/02/08 http://bugs.python.org/issue3760 created _doublep urllib.request and urllib.response cannot handle HTTP1.1 chunked 09/02/08 http://bugs.python.org/issue3761 created chrisleow platform.architecture() fails if python is lanched via its symbo 09/03/08 CLOSED http://bugs.python.org/issue3762 created ocean-city patch, easy Python 3.0 beta 2 : json and urllib not working together? 09/03/08 http://bugs.python.org/issue3763 created swaroopch asyncore differences between 2.x and 3.x 09/03/08 http://bugs.python.org/issue3764 created giampaolo.rodola [patch] allow mmap take file offset as argument 09/03/08 http://bugs.python.org/issue3765 created chrisl socket.socket.recv broken (unbearably slow) 09/03/08 http://bugs.python.org/issue3766 created thorben tkColorChooser may fail if no color is selected 09/03/08 http://bugs.python.org/issue3767 created gpolo patch Move test_py3kwarn over to new catch_warnings API 09/03/08 CLOSED http://bugs.python.org/issue3768 created brett.cannon patch, patch, needs review Deprecate bsddb for removal in 3.0 09/03/08 CLOSED http://bugs.python.org/issue3769 created brett.cannon patch, patch, needs review test_multiprocessing fails on systems with HAVE_SEM_OPEN=0 09/04/08 http://bugs.python.org/issue3770 created djmdjm test_httpservers intermittent failure 09/04/08 http://bugs.python.org/issue3771 created djmdjm logging module fails with non-ascii data 09/04/08 CLOSED http://bugs.python.org/issue3772 created mhammond patch Check for errors when using PyTokenizer_FindEncoding() 09/04/08 CLOSED http://bugs.python.org/issue3773 created brett.cannon patch tkinter Menu.delete bug 09/04/08 http://bugs.python.org/issue3774 created skomoroh patch, easy, needs review Update RELNOTES file 09/04/08 http://bugs.python.org/issue3775 created barry deprecate bsddb/dbhash in 2.6 for removal in 3.0 09/04/08 http://bugs.python.org/issue3776 created brett.cannon patch, patch, needs review PyNumber_Long fails from Float 09/04/08 http://bugs.python.org/issue3777 created barry-scott python uninstaller leave registry entries 09/04/08 http://bugs.python.org/issue3778 created donovaly log into bugs.python.org requires cookies 09/04/08 CLOSED http://bugs.python.org/issue3779 created donovaly No way to write unit tests for warnings 09/04/08 CLOSED http://bugs.python.org/issue3780 created exarkun warnings.catch_warnings fails gracelessly when recording warning 09/04/08 http://bugs.python.org/issue3781 created exarkun patch, needs review os.write accepts unicode strings 09/04/08 http://bugs.python.org/issue3782 created pitrou dbm.sqlite proof of concept 09/04/08 http://bugs.python.org/issue3783 created skip.montanaro patch Incorrect compiler options used for cc of Sun Studio 12 09/05/08 http://bugs.python.org/issue3784 created mschmarck Can't build ctypes of Python 2.5.2 with Sun Studio 12 09/05/08 http://bugs.python.org/issue3785 created mschmarck _curses, _curses_panel & _multiprocessing can't be build in 2.6b 09/05/08 http://bugs.python.org/issue3786 created mschmarck Issues Now Closed (67) ______________________ LookupError: unknown encoding: X-MAC-JAPANESE 322 days http://bugs.python.org/issue1276 josm patch New SSL module doesn't seem to verify hostname against commonNam 269 days http://bugs.python.org/issue1589 heikki "RuntimeError: dictionary changed size during iteration" in Tkin 260 days http://bugs.python.org/issue1658 gpolo patch __eq__ / __hash__ check doesn't take inheritance into account 3 days http://bugs.python.org/issue2235 ncoghlan patch Update What's new in 2.6 172 days http://bugs.python.org/issue2305 facundobatista Clean up getargs.c and its formatting possibilities 170 days http://bugs.python.org/issue2322 barry xml.sax.parser() doesn't terminate when given a filename 160 days http://bugs.python.org/issue2501 benjamin.peterson patch Cannot use non-ascii letters in disutils if setuptools is used. 150 days http://bugs.python.org/issue2562 lemburg patch Update interface of weakref dictionaries 102 days http://bugs.python.org/issue2965 barry patch VS8 include dirs grow without bound 99 days http://bugs.python.org/issue2975 jkleckner patch Building a Win32 binary installer crashes 75 days http://bugs.python.org/issue3160 pitrou patch, needs review Deficiencies in multiprocessing/threading API 50 days http://bugs.python.org/issue3352 ncoghlan patch, needs review multiprocessing module is racy 45 days http://bugs.python.org/issue3419 jnoller patch, needs review In function call, keyword arguments could follow *args 35 days http://bugs.python.org/issue3473 amaury.forgeotdarc patch New Global Module Index glitch on WinXP 25 days http://bugs.python.org/issue3520 georg.brandl Glitch in eval() doc 14 days http://bugs.python.org/issue3569 georg.brandl Interpreter name: python vs. python-3.0 13 days http://bugs.python.org/issue3577 georg.brandl Misleading names for multiprocessing "convenience" functions 1 days http://bugs.python.org/issue3589 ncoghlan needs review sax.parser considers XML as text rather than bytes 16 days http://bugs.python.org/issue3590 benjamin.peterson PyTokenizer_FindEncoding() never succeeds 16 days http://bugs.python.org/issue3594 brett.cannon patch, needs review Move test.test_suport.catch_warning() to the 'warnings' module 13 days http://bugs.python.org/issue3602 brett.cannon patch test_multiprocessing failure (Unserializable message) 15 days http://bugs.python.org/issue3607 jnoller 2to3 refactoring 12 days http://bugs.python.org/issue3637 benjamin.peterson patch, needs review segfaults calling warnings.warn() with non-string message 11 days http://bugs.python.org/issue3639 brett.cannon patch segfault calling sys.excepthook with non-Exception argument 9 days http://bugs.python.org/issue3653 georg.brandl patch, needs review Reloading an extension module always leaks 10 days http://bugs.python.org/issue3667 benjamin.peterson patch, needs review "s*" argument parser marker leaks memory 5 days http://bugs.python.org/issue3668 pitrou patch, needs review bsddb module leaks memory 10 days http://bugs.python.org/issue3673 jcea patch, patch compilation --without-threads fails 7 days http://bugs.python.org/issue3683 benjamin.peterson patch, needs review Source tarball for Sphinx 0.4.3 missing 3 days http://bugs.python.org/issue3695 georg.brandl Error parsing arguments on OpenBSD <= 4.4 8 days http://bugs.python.org/issue3696 pitrou patch, needs review "Fatal Python error: Cannot recover from stack overflow" on Wind 7 days http://bugs.python.org/issue3697 pitrou patch, needs review open() on directory raises IOError with unhelpful message 5 days http://bugs.python.org/issue3703 benjamin.peterson patch, needs review help('finally') behaves bizarrely 3 days http://bugs.python.org/issue3707 georg.brandl patch, easy, needs review os.urandom(1.1): infinite loop 5 days http://bugs.python.org/issue3708 gregory.p.smith patch, easy memoryview leaks references 4 days http://bugs.python.org/issue3712 pitrou patch hashlib's docstring throws exception in pydoc 3 days http://bugs.python.org/issue3715 gregory.p.smith easy mistake in 3.4.2 Customizing attribute access 2 days http://bugs.python.org/issue3716 georg.brandl platform.py: _syscmd_file() can't handle target path with space 5 days http://bugs.python.org/issue3719 jfdp patch invalid literal for int() with base 16: '' 7 days http://bugs.python.org/issue3721 amaury.forgeotdarc Allow ',<whitespace>' delimiters in logging.config.fileConfig() 5 days http://bugs.python.org/issue3726 vsajip patch Update BaseHTTPServer docs 1 days http://bugs.python.org/issue3730 georg.brandl import warning in multiprocessing 3 days http://bugs.python.org/issue3731 pitrou bdist_msi gives a deprecation warning when run with Python 2.6 3 days http://bugs.python.org/issue3732 ocean-city patch, easy, needs review Adding bin and Scripts folder into PATH 4 days http://bugs.python.org/issue3733 amaury.forgeotdarc An error in Python Library Reference document 0 days http://bugs.python.org/issue3737 georg.brandl logging.Handler.close does something 2 days http://bugs.python.org/issue3738 vsajip Fix caching in ABCMeta.__subclasscheck__ 1 days http://bugs.python.org/issue3747 ncoghlan patch, patch, needs review platform.architecture() prints bogus message on windows 1 days http://bugs.python.org/issue3748 ocean-city patch incrementalencoder and incrementalencoder 0 days http://bugs.python.org/issue3749 georg.brandl test_bsddb3 skipped -- cannot import name test_support 0 days http://bugs.python.org/issue3750 jcea str.rpartition fails silently with unicode argument 0 days http://bugs.python.org/issue3751 amaury.forgeotdarc patch test_bsddb broken 2 days http://bugs.python.org/issue3752 jcea bytearray incompatible with y# 0 days http://bugs.python.org/issue3753 georg.brandl Lists propagate through new instances of class if using append 0 days http://bugs.python.org/issue3755 benjamin.peterson test_asyncore.py leaks handle 2 days http://bugs.python.org/issue3759 ocean-city patch, easy platform.architecture() fails if python is lanched via its symbo 1 days http://bugs.python.org/issue3762 ocean-city patch, easy Move test_py3kwarn over to new catch_warnings API 0 days http://bugs.python.org/issue3768 brett.cannon patch, patch, needs review Deprecate bsddb for removal in 3.0 2 days http://bugs.python.org/issue3769 barry patch, patch, needs review logging module fails with non-ascii data 0 days http://bugs.python.org/issue3772 vsajip patch Check for errors when using PyTokenizer_FindEncoding() 1 days http://bugs.python.org/issue3773 amaury.forgeotdarc patch log into bugs.python.org requires cookies 0 days http://bugs.python.org/issue3779 benjamin.peterson No way to write unit tests for warnings 0 days http://bugs.python.org/issue3780 brett.cannon socket-module SSL is broken 2412 days http://bugs.python.org/issue508944 janssen relocate cgi.parse_qs() into urlparse 2200 days http://bugs.python.org/issue600362 facundobatista patch New class special method lookup change 2106 days http://bugs.python.org/issue643841 ncoghlan patch SSLObject breaks read semantics 1086 days http://bugs.python.org/issue1291446 ellisj Top Issues Most Discussed (10) ______________________________ 17 Deprecate bsddb for removal in 3.0 2 days closed http://bugs.python.org/issue3769 17 segfault in for loop with evil iterator 7 days open http://bugs.python.org/issue3720 13 Deficiencies in multiprocessing/threading API 50 days closed http://bugs.python.org/issue3352 12 reference leaks in 3.0 12 days open http://bugs.python.org/issue3660 10 platform.py: _syscmd_file() can't handle target path with space 5 days closed http://bugs.python.org/issue3719 10 Misleading names for multiprocessing "convenience" functions 1 days closed http://bugs.python.org/issue3589 9 Check for errors when using PyTokenizer_FindEncoding() 1 days closed http://bugs.python.org/issue3773 8 dbm.sqlite proof of concept 1 days open http://bugs.python.org/issue3783 8 Precompute range length 133 days open http://bugs.python.org/issue2690 7 No way to write unit tests for warnings 0 days closed http://bugs.python.org/issue3780

1 0

Python performance through times
by Antoine Pitrou Sept. 5, 2008

Sept. 5, 2008

Here's an interesting blog post comparing Python performance of various versions from 2.2.3 upto the latest 3.0 beta. http://www.ogre.com/node/147 The fact that only Mandelbrot calculation (a hardly representative benchmark for a high-level dynamic language such as Python) has become significantly slower is rather a good sign IMO. cheers Antoine.

2 1

Bug in SimpleHTTPRequestHandler.send_head?
by Kim Gräsman Sept. 5, 2008

Sept. 5, 2008

Hi all, I'm new to this group and the Python language as such. I stumbled on it when I joined a project to build a rich network library for C++, which in turn uses Python and its CGI HTTP server implementation as part of its unit test suite. We're having a little trouble when serving a text file containing Windows line endings (CRLF) -- the resulting content contains Unix line endings only (LF). This breaks our tests, because we can't verify that the body, as parsed by our HTTP client, is the same as the source file we're serving through the Python HTTP server. I've isolated it to the SimpleHTTPRequestHandler.send_head method in SimpleHTTPServer.py: -- ctype = self.guess_type(path) if ctype.startswith('text/'): mode = 'r' else: mode = 'rb' try: f = open(path, mode) except IOError: self.send_error(404, "File not found") return None -- The f object is returned from this method, and used with shutil.copyfileobj to copy the contents to the output stream. This is easily fixed by omitting the content-type check entirely, and blindly using mode 'rb', and I think that makes sense, because the server should not be concerned with the contents of the body, so treating it as a binary stream seems right. This also fixes another issue, where the actual body size differs from what's specified in the Content-Length header, because CR characters are stripped when the body is served, but Content-Length contains the source file's binary size. I'm not sure which source control system you're using, so I won't try to provide a patch, but I believe the code should read: -- if os.path.isdir(path): if not self.path.endswith('/'): # redirect browser - doing basically what apache does self.send_response(301) self.send_header("Location", self.path + "/") self.end_headers() return None for index in "index.html", "index.htm": index = os.path.join(path, index) if os.path.exists(index): path = index break else: return self.list_directory(path) #patch: removed content-type check try: f = open(path, 'rb') #patch: always open in binary mode except IOError: self.send_error(404, "File not found") return None self.send_response(200) self.send_header("Content-type", self.guess_type(path)) #patch: content-type check here instead fs = os.fstat(f.fileno()) -- My changes marked with "#patch[...]". Grateful for any comments! Best wishes, - Kim

3 2

Can/should built-in functions get __get__?
by Terry Reedy Sept. 5, 2008

Sept. 5, 2008

One of the nice features of 3.0 is that differences between classes defined in C and Python (other than speed) are mostly erased or hidden from the view of a Python programmer. However, there are still sometimes surprising and quite visible differences between 'functions' written in C and Python. Can these be better unified also? In particular, built-in functions, in spite of of being labeled 'builtin_function_or_method', are not usable as methods because they lack the __get__ method needed to bind function to instance. [Q. Any reason to not shorten that to 'built-in function'?] So, as a c.l.p poster discovered, within a class statement, __hash__ = lambda x: id(x) # works, while the apparently cleaner __hash__ = id # raises TypeError: id() takes exactly one argument (0 given) [Irony: trivial lambda wrapping, lambda x: f(x) has been described here as useless and diseased, but is seems that casting 'built-in function' to 'function' is not so completely useless. ;-] In this case, __hash__ = object.__hash__ is available, as is object.__repr__, but this is not true in general for C functions. The difference between a C function and a C method wrapper is tantalizingly small: >>> i = set(dir(id)) >>> h = set(dir(object.__hash__)) >>> i-h {'__module__', '__self__'} >>> h-i {'__objclass__', '__get__'} Similarly, for >>> def f(): pass >>> ff = set(dir(f)) >>> ff - i {'__defaults__', '__annotations__', '__kwdefaults__', '__globals__', '__closure__', '__dict__', '__code__', '__get__'} the only un-obvious difference is __get__, So I cannot help but wonder: is this is essential? or could it be removed but has not yet? Could the object wrapper for C functions get a __get__ method so they become methods when accessed via a class just like Python functions do? Terry Jan Reedy

3 3

Re: [Python-Dev] 'warnings' module changes still breaking Twisted, still looking for a fix
by glyph＠divmod.com Sept. 4, 2008

Sept. 4, 2008

On 10:18 pm, musiccomposition(a)gmail.com wrote: >That's why catch_warning keeps track of the warnings filter too, so >you can call warnings.simplefilter("always") within the context >manager and the filter state will be restored. Thanks for the pointer - this is interesting. I misunderstood the way the warnings filter worked. It looks like this combination of features may in fact be all we need. It would be nice if application code could otherwise "officially" keep track of the warnings filter (my understanding is that 'filters', despite the public-looking name, is private, since it is absent from the documentation?) but that doesn't sound like a release blocker.

2 1

'warnings' module changes still breaking Twisted, still looking for a fix
by glyph＠divmod.com Sept. 4, 2008

Sept. 4, 2008

With the 2.6 final release impending, the Twisted community buildbot is still red, <http://bit.ly/zFymN>, but there only seems to be one real issue: the warn_explicit change. This seems like it could be a pretty minor bit of maintenance to clear up on our end, if Python provided the appropriate hook. The current solution we have in mind for this problem is to build our own warnings module <http://bit.ly/4F3Qr2>, but that is obviously inelegant. While we do want to experiment with our own features for deprecation, users of Twisted will (rightfully) expect our "assertWarns" to continue covering warnings produced by the Python 2.6 warnings system. The proposed solution to this problem seems to have been "warnings.catch_warnings()" <http://bugs.python.org/issue3602>, but it is insufficient for testing, since subsequent calls to "catch_warnings()" will not catch warnings suppressed by duplication suppression; without even getting into multiple tests testing the same code path, this breaks features like our 'trial' tool's "--until- failure" option, which runs a fixed group of tests repeatedly in an attempt to flush out buggy tests which have race conditions that cause them to fail intermittently. We thought we'd filed a ticket for this before, but searching around in the issue tracker hasn't come up with anything. JP Calderone has filed a new ticket for this problem: <http://bugs.python.org/issue3780> . Any chance this could be made into a release blocker? If this one issue were fixed, Python 2.6 would be the smallest disruption to Twisted since Python 2.0 :-).

3 3

patch for Cookie.py to add support for HttpOnly
by Matt Chisholm Sept. 4, 2008

Sept. 4, 2008

Eighteen months ago, Arvin Schnell contributed a really straightforward three-line patch to Cookie.py adding support for the HttpOnly flag on cookies: http://bugs.python.org/issue1638033 In the last eighteen months, HttpOnly has become a de-facto extension to the cookie standard. It is now supported by IE 7, Firefox 3, and Opera 9.5 (and there's a bug open against WebKit to support it): http://www.owasp.org/index.php/HTTPOnly Ruby, Perl, and PHP all support creating HttpOnly cookies now too. This article explains why HttpOnly is a good way to make cross-site scripting (XSS) attacks significantly more difficult: http://www.codinghorror.com/blog/archives/001167.htmllop Unfortunately this patch appears to have been ignored for the last year. The last thing I want is a delay in the release of 2.6/3.0, but Antoine Pitrou posted on the bug that it will have to wait for Python 2.7/3.1, because it is a feature request. If I'm not mistaken, that means no support for HttpOnly until sometime in 2010. Do we really have to wait two more years to apply a three-line patch which will bring Python in line with the industry state of the art and improve security for Python web applications? Is there a way that this could go in to 2.6.1/3.0.1? -matt

2 1

3rd-party dbms
by Oleg Broytmann Sept. 4, 2008

Sept. 4, 2008

Brett Cannon <brett(a)python.org> wrote: > for 3.1 there is nothing saying we can't change shelve and the > dbm package to allow 3rd-party code to register with the dbm package > such that bsddb can be used as needed behind the scenes. Many years ago I wrote toy hashes based on ZODB and MetaKit. Registering them with anydbm was easy: import anydbm anydbm._names.insert(len(anydbm._names)-1, ['ZODBhash', 'MKhash']) # Insert before dumbdbm More complex part was to make whichdb to recognize those hashes. I just monkey-patched whichdb. If I were doing this now I'd do something similar to atexit module - every hash module will register its own test function, and whichdb will call them in turn until it finds which db it is. Oleg. -- Oleg Broytmann http://phd.pp.ru/ phd(a)phd.pp.ru Programmers don't die, they just GOSUB without RETURN.

2 1

Re: [Python-Dev] Durus memory
by Binger David Sept. 4, 2008

Sept. 4, 2008

I'm sorry this post is a bit off-topic, but I think I should correct this. On Sep 4, 2008, at 11:54 AM, Oleg wrote: > Durus (and ZODB) has an index of all objects, the index is stored in > memory AFAIK - a real problem if one has millions of objects. Durus now has an option to store the index in the data file in a form that is usable directly from disk. With this option, the in-memory index is only for objects changed since the last pack. Durus works fine with millions of objects, as long as you don't have millions of rapidly-changing objects. I haven't used the Berkeley DB storage for Durus, but I'm pretty sure that the Durus/Python side of that would not use any in-memory index.

1 0

Re: [Python-Dev] C API for gc.enable() and gc.disable()
by Andrey Zhmoginov Sept. 4, 2008

Sept. 4, 2008

> > Would anyone mind if I did add a public C API for gc.disable() and > gc.enable()? I would like to use it as an optimization for the pickle > module (I found out that I get a good 2x speedup just by disabling the > GC while loading large pickles). Of course, I could simply import the > gc module and call the functions there, but that seems overkill to me. > I included the patch below for review. > I don't know if the following question is relevant, but it seems that many people here are familiar with Python cyclic garbage collector. I see Python [v2.5.2 (r252:60911, Jul 31 2008, 17:28:52)] crashing with Segment fault when I extend Python with a very simple module. This behavior is observed when I create a thousand of lists (it does not crash with 10-100) in the module with the garbage collector turned on. When I turn it off - everything is perfect. I suspect that it is my module, but if it is a Python bug ( _GC_Malloc? memory leak somewhere?), it may be worth reporting. The gdb "where" reply is the following: #0 0x080d8de9 in PyErr_Occurred () #1 0x080f508f in _PyObject_GC_Malloc () #2 0x080f5155 in _PyObject_GC_New () #3 0x08079c98 in PyList_New () #4 0xb7f53519 in draw_d_simple () from ./rt/rt_core.so #5 0xb7cf7833 in ffi_call_SYSV () from /usr/lib/python2.5/lib-dynload/_ctypes.so #6 0xb7cf766a in ffi_call () from /usr/lib/python2.5/lib-dynload/_ctypes.so #7 0xb7cf2534 in _CallProc () from /usr/lib/python2.5/lib-dynload/_ctypes.so #8 0xb7cec02a in ?? () from /usr/lib/python2.5/lib-dynload/_ctypes.so #9 0x0805cb97 in PyObject_Call () #10 0x080c7aa7 in PyEval_EvalFrameEx () #11 0x080c96e5 in PyEval_EvalFrameEx () #12 0x080cb1f7 in PyEval_EvalCodeEx () #13 0x080cb347 in PyEval_EvalCode () #14 0x080ea818 in PyRun_FileExFlags () #15 0x080eaab9 in PyRun_SimpleFileExFlags () #16 0x08059335 in Py_Main () #17 0x080587f2 in main () The crashing python code is: from ctypes import * import gc core = CDLL( "./tst.so" ) core.a.argtypes = [] core.a.restype = py_object #gc.disable() core.a() #gc.enable() And tst.cpp is: #include <Python.h> extern "C" { PyObject *a(); } PyObject *a() { int n = 1000; PyObject *item; for ( int i = 0; i < n; i++ ) item = PyList_New( 0 ); // Crashes here (somewhere in between). return item; } tst.cpp is compiled with: g++ -shared -Wl,-soname,tst.tmp.so -o tst.so tst.o g++ -I /usr/include/python2.5 -Wall -fPIC -o tst.o -c tst.cpp Thanks for your help! - Andrew.

2 1

Python 3.0b3 documentation typo
by Reed O'Brien Sept. 4, 2008

Sept. 4, 2008

I was reading through the Dictionary views section: http://docs.python.org/dev/3.0/library/stdtypes.html#dictionary-view-objects Unless I am mistaken; the intersection at the end of the example usage should be: >>> keys & {'eggs', 'bacon', 'salad'} {'bacon'} Cheers, ~ro

2 1

Re: [Python-Dev] [Python-3000] bsddb finished for 2.6/3.0 (and "<class 'BytesWarning'>: str() on a bytes instance")
by Barry Warsaw Sept. 4, 2008

Sept. 4, 2008

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sep 3, 2008, at 7:01 PM, Jesus Cea wrote: > Barry Warsaw wrote: >> and I know Brett agrees, so that's it. On IRC, I've just asked >> Benjamin >> to do the honors for 3.0 and Brett will add the deprecations for 2.6. > > I just committed the fix for bsddb testsuite in Python 3.0 branch: > http://www.python.org/dev/buildbot/3.0.stable/changes/2687 > > Can I do anything to revert this decision?. If not, what can I do to > be > reconsidered in 3.1?. Start raising some pitchforks. It looks like Raymond will join the march :). Really, this is about what's best for Python and pybsddb. In this article, Guido unambiguously states his opinion: http://mail.python.org/pipermail/python-dev/2008-July/081362.html "+1. In my recollection maintaining bsddb has been nothing but trouble right from the start when we were all sitting together at "Zope Corp North" in a rented office in McLean... We can remove it from 3.0. We can't really remove it from 2.6, but we can certainly start end-of-lifing it in 2.6." Jesus, let me stress that IMO this is not a reflection on your work at all. On the contrary, keeping it alive in 2.x and providing a really solid independent package for 3.0 is critical for its continued relevance to Python programmers. I completely agree with Guido that bsddb (not pybsddb) has been a headache since forever. For example, IIRC Sleepycat was notorious for changing the API in micro releases, though I don't know if that's still the case with the current maintainers. I personally believe that Python and pybsddb are both better off with their own maintenance lifecycles so I stand by my decision that pulling it out of 3.0 is the right thing to do. 3.1 is far enough away that any decision we make in 3.0 can be re-evaluated. - -Barry -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (Darwin) iQCVAwUBSL85BnEjvBPtnXfVAQLfkwQAtoagOP37uAwL1r2H7w73erTsWBYHf4VH KcTZsjeQ/mEvmaaJIG86ylAtpxmDmMF5x7OClR66bXXxf0oTnWV4KMC9rLdQW8R/ KpMIfuQw/501AQgFmcB0M6SQ6CYyJHU5K+K6X+ScOPHOJoG8usPK1pk8XFGOXBZK UGXCEHVvlrk= =7AOQ -----END PGP SIGNATURE-----

1 0

Further PEP 8 compliance issues in threading and multiprocessing
by Nick Coghlan Sept. 3, 2008

Sept. 3, 2008

I've been taking a close look at the API for multiprocessing and threading, and have discovered a somewhat strange pattern that occurs multiple times in both interfaces: factory functions with names that start with a capital letter so they look like they're actually a class. At first I thought it was a quirk of the multiprocessing implementation, but then I discovered that the threading module also does it for all of the synchronisation objects as well as threading.Timer, with examples like: def Event(*args, **kwds): return _Event(*args, **kwds) Is this just intended to discourage subclassing? If so, why give the misleading impression that these things can be subclassed by naming them as if they were classes? How should this be handled when it comes to the addition of PEP 8 compliant aliases? Add aliases for the factory functions that start with a lower case letter, but otherwise leave the structure of the modules unchanged? Or should the trivial functions like the one above be dropped and made direct aliases for the classes they are currently wrapping? Option 1 has the virtue of being perfectly backwards compatible in the threading case, while option 2 is a little riskier, so I'm inclined to go with option 1 (keeping the factory functions, but giving them non-class like names in the case of multiprocessing, or aliases in the case of threading). Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia --------------------------------------------------------------- http://www.boredomandlaziness.org

11 21

fileobj.read(float): warning or error?
by Victor Stinner Sept. 3, 2008

Sept. 3, 2008

Hi, Since Python 2.4 (maybe 2.2 or older), fileobj.read(4.2) displays an error and works as fileobj.read(4). >>> i=open('/etc/issue') >>> i.read(4.2) __main__:1: DeprecationWarning: integer argument expected, got float It should raises an error instead of a warning, it has no sense to read a partial byte :-) But that should breaks some applications? Well, the real problem is os.urandom(4.2) which goes to an unlimited loop: while len(bytes) < n: bytes += read(_urandomfd, n - len(bytes)) because read(0.2) works as read(0) :-/ Victor

11 23

Re: [Python-Dev] Add python.exe to PATH environment variable
by Curt Hagenlocher Sept. 3, 2008

Sept. 3, 2008

One of these days, I'm actually going to remember that I need to click "Reply All" when posting to this list... . Sorry for the duplicate, Greg. On Tue, Sep 2, 2008 at 6:45 PM, Greg Ewing <greg.ewing(a)canterbury.ac.nz> wrote: > > A better way would be to start a command process with > the Python directory added to PATH just for that > process. This is similar to what Visual Studio or the Windows SDK do to give you a command prompt with the PATH and other environmental variables setup "correctly" -- they add a shortcut to a batch file that's set to keep the command prompt open after the batch file runs. > How easy would that be to do on Windows? Do environment > variables get inherited by child processes the way > they do on Unix? Generally, yes. I think there's a catch in that there are ways to start processes that don't make them children of your process, but I don't remember why I think that. One other reason not to mess with the PATH -- at least by default -- is that the user may have multiple copies of Python installed. I know I have at least one machine with 2.4.5, 2.5.2, 2.6b2 and 3.0b2 installed -- and I don't want *any* of them in my path. -- Curt Hagenlocher curt(a)hagenlocher.org

2 1

2.6b3 Windows installers
by M.-A. Lemburg Sept. 2, 2008

Sept. 2, 2008

The download page doesn't list any Windows installer for 2.6b3: http://www.python.org/download/releases/2.6/ I suppose this is due to Martin building the installers and him not be available at the moment. Since Python on Windows will likely only get very few beta testers without a Windows installer build, I'd suggest to postpone the RC1 release that's planned for tomorrow to get more feedback for the Windows builds. -- Marc-Andre Lemburg eGenix.com Professional Python Services directly from the Source (#1, Sep 02 2008) >>> Python/Zope Consulting and Support ... http://www.egenix.com/ >>> mxODBC.Zope.Database.Adapter ... http://zope.egenix.com/ >>> mxODBC, mxDateTime, mxTextTools ... http://python.egenix.com/ ________________________________________________________________________ :::: Try mxODBC.Zope.DA for Windows,Linux,Solaris,MacOSX for free ! :::: eGenix.com Software, Skills and Services GmbH Pastor-Loeh-Str.48 D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg Registered at Amtsgericht Duesseldorf: HRB 46611

3 3

Re: [Python-Dev] Things to Know About Super
by average Sept. 2, 2008

Sept. 2, 2008

It seems that the frustration with super revolves around how Python currently conflates (as well as many users) two very different types of inheritance, both "is-a" and "has-a" (or compositional) inheritance. Unfortunately, Python assists this confusion because the language doesn't provide a distinct enough way to differentiate between them. For the former (i.e. is-a inheritance), users should not have to explicitly make a call to the super class (via super() or otherwise)--this should be automatic for every method held in common so as to guarantee the invariants of the simpler class. For this type of inheritance it makes more sense to be explicit about *bypassing* a call to the parent class--IF necessary (perhaps to take advantage of an optimization available only in the subclass)--rather than explicit about *making* one. This would remove many of the bugs, misuses, and frustrations with super(). No more ambiguity and confusion because the language now guarantees certain behavior. Super() would then be limited to cooperative mixin classes; for all others, explicit naming of the class would be required. But perhaps that there is some language abstraction that has yet to be fully invented that would tie it all together nicely. By the way, regarding your trait implementation, it may be worthwhile revisiting the discussion surrounding the Prothon language discussed a few years ago on comp.lang.python which got rid of classes and metaclasses and replaced them with prototypes. Regards, zipher

2 1

Proposal: add odict to collections
by Armin Ronacher Sept. 1, 2008

Sept. 1, 2008

Hi, I noticed lately that quite a few projects are implementing their own subclasses of `dict` that retain the order of the key/value pairs. However half of the implementations I came across are not implementing the whole dict interface which leads to weird bugs, also the performance of a Python implementation is not that great. To fight that problem I want to proposed a new class in "collections" called odict which is a dict that keeps the items sorted, similar to a PHP array. The interface would be fully compatible with dict and implemented as dict subclass. Updates to existing keys does not change the order of a key but new keys are inserted at the end. Additionally it would support slicing where a list of key, value tuples is returned and sort/reverse/index methods that work like their list equivalents. Index based lookup could work via odict.byindex(). An implementation of that exists as part of the ordereddict implementation which however goes beyond that and is pretty much a fork of the python dict[1]. Some reasons why ordered dicts are a useful feature: - in XML/HTML processing it's often desired to keep the attributes of an tag ordered during processing. So that input ordering is the same as the output ordering. - Form data transmitted via HTTP is usually ordered by the position of the input/textarea/select field in the HTML document. That information is currently lost in most Python web applications / frameworks. - Eaiser transition of code from Ruby/PHP which have sorted associative arrays / hashmaps. - Having an ordered dict in the standard library would allow other libraries support them. For example a PHP serializer could return odicts rather then dicts which drops the ordering information. XML libraries such as etree could add support for it when creating elements or return attribute dicts. Regards, Armin [1]: http://www.xs4all.nl/~anthon/Python/ordereddict/

28 52