Mailman 3 May 2009 - Python-Dev

special method lookup: how much do we care?
by Benjamin Peterson May 14, 2009

May 14, 2009

A while ago, Guido declared that all special method lookups on new-style classes bypass __getattr__ and __getattribute__. This almost completely consistent now, and I've been working on patching up a few incorrect cases. I've know hit __enter__ and __exit__. The compiler generates LOAD_ATTR instructions for these, so it uses the normal lookup. The only way I can see to fix this is add a new opcode which uses _PyObject_LookupSpecial, but I don't think we really care this much. Opinions? -- Regards, Benjamin

9 18

How to build Python 2.6.2 on HP-UX Itanium with thread support?
by henning.vonbargen＠arcor.de May 13, 2009

May 13, 2009

How to build Python 2.6.2 on HP-UX Itanium with thread support? Note: I know that the first address to post this question is comp.lang.python, but I posted this question a week ago on comp.lang.python (http://groups.google.com/group/comp.lang.python/browse_thread/thread/c7006a…) and unfortunately, I didn't receive any answers. According to Patch 1225212, at least Peter Kropf was able to get Python running with threading support on this platform, though AFAIK he was not using GCC. But I guess it should be possible with GCC as well. Is anyone able to confirm that Python (built with GCC) does or does not work with multi-threading on HP-UX Itanium? Is HP-UX Itanium a supported platform at all? BTW: A search for "supported platforms" at www.python.org does not help! And if it does work, which steps need to be taken to build it, e.g. other libraries/packages, environment variables, configure options, manual modifications? Henning

4 4

Shorter release schedule?
by Antoine Pitrou May 13, 2009

May 13, 2009

Hello, Just food for thought here, but seeing how 3.1 is going to be a real featureful schedule despite being released shortly after 3.0, wouldn't it make sense to tighten future release planning a little? I was thinking something like doing a major release every 12 months (rather than 18 to 24 months as has been heuristically the case lately). This could also imply switching to some kind of loosely time-based release system. If I'm wildly off-base, you can either flame me, ignore me, or assign me annoying release blockers involving memoryviews and weird character encodings :-) Regards Antoine.

12 14

Re: [Python-Dev] Shorter release schedule?
by Bugbee, Larry May 13, 2009

May 13, 2009

>From the perspective of this application developer and prototyper... In general, releases should be more frequent when the language is less mature and perhaps lacking. With maturity one seeks stability and less frequency. Python is, for the most part, a mature language. I submit the issue is less a question of frequency, but more a question of the number and value of each of the new features. Too many new features added to a mature language begs the question of simplicity vs complexity. One of Python's original goals, if I recall correctly, was to keep life simple, to have executable psuedocode, be easy to learn and re-learn, and be able to quickly read and grok your code 6-12 months later. Ease of maintenance is a huge advantage of Python. From an application developer's perspective, too many confusing features and the language becomes more and more like C++ and APL. I submit Python is now at the point where new features must not be added just because they are cool, but because they indeed add significant value *without* compromising simplicity and the suite of "easy to" benefits. The alternative is to rethink the long-term goals for the language. That could have large unintended consequences. Larry

1 0

py3k, cgi, email, and form-data
by Robert Brewer May 12, 2009

May 12, 2009

There's a major change in functionality in the cgi module between Python 2 and Python 3 which I've just run across: the behavior of FieldStorage.read_multi, specifically when an HTTP app accepts a file upload within a multipart/form-data payload. In Python 2, each part would be read in sequence within its own FieldStorage instance. This allowed file uploads to be shunted to a TemporaryFile (via make_file) as needed: klass = self.FieldStorageClass or self.__class__ part = klass(self.fp, {}, ib, environ, keep_blank_values, strict_parsing) # Throw first part away while not part.done: headers = rfc822.Message(self.fp) part = klass(self.fp, headers, ib, environ, keep_blank_values, strict_parsing) self.list.append(part) In Python 3 (svn revision 72466), the whole request body is read into memory first via fp.read(), and then broken into separate parts in a second step: klass = self.FieldStorageClass or self.__class__ parser = email.parser.FeedParser() # Create bogus content-type header for proper multipart parsing parser.feed('Content-Type: %s; boundary=%s\r\n\r\n' % (self.type, ib)) parser.feed(self.fp.read()) full_msg = parser.close() # Get subparts msgs = full_msg.get_payload() for msg in msgs: fp = StringIO(msg.get_payload()) part = klass(fp, msg, ib, environ, keep_blank_values, strict_parsing) self.list.append(part) This makes the cgi module in Python 3 somewhat crippled for handling multipart/form-data file uploads of any significant size (and since the client is the one determining the size, opens a server up for an unexpected Denial of Service vector). I *think* the FeedParser is designed to accept incremental writes, but I haven't yet found a way to do any kind of incremental reads from it in order to shunt the fp.read out to a tempfile again. I'm secretly hoping Barry has a one-liner fix for this. ;) Robert Brewer fumanchu(a)aminus.org

3 3

CVE-2008-5983 "untrusted python modules search path"
by Antoine Pitrou May 12, 2009

May 12, 2009

Hello, I don't think it has already posted to the list, apologies if it has. Some Linux tools and vendors have been hit by an alleged "security hole" where an embedded Python interpreter will prepend the current working directory to sys.path as soon as PySys_SetArgv() is called by the embedding application. This means, for example, that a Python file in the working directory can break plugins or extensions written for that application if the Python file happens to shadow another module. Regardless of whether this is a security hole or not, it certainly can make things disturbingly surprising when the situation arises. In the bug report (http://bugs.python.org/issue5753), I suggested we add a new function PySys_SetArgvEx() which would take an additional parameter telling whether to touch sys.path or not (in the same spirit as Py_InitializeEx() providing a more flexible API than Py_Initialize()). On the other hand, I don't think we can change the default behaviour of PySys_SetArgv(), since there are probably tools and applications relying on it (the obvious use case which comes to my mind is a third-party interactive interpreter). Any opinions? Regards Antoine.

2 1

Switchover: mail.python.org
by Aahz May 12, 2009

May 12, 2009

On Monday 2009-05-11, mail.python.org will be switched to another machine starting roughly at 14:00 UTC. This should be invisible (expected downtime is less than ten minutes). -- Aahz (aahz(a)pythoncraft.com) <*> http://www.pythoncraft.com/ "It is easier to optimize correct code than to correct optimized code." --Bill Harlan

3 3

using help function in Py3k
by s|s May 12, 2009

May 12, 2009

Hello, I Ran Python 3.0 for the first time. I used help() function and wrote "modules hash". It issues an error. Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/ss/eproj/xapian/INST//lib/python3.0/site.py", line 427, in __call__ return pydoc.help(*args, **kwds) File "/home/ss/eproj/xapian/INST//lib/python3.0/pydoc.py", line 1675, in __call__ self.interact() File "/home/ss/eproj/xapian/INST//lib/python3.0/pydoc.py", line 1693, in interact self.help(request) File "/home/ss/eproj/xapian/INST//lib/python3.0/pydoc.py", line 1711, in help self.listmodules(request.split()[1]) File "/home/ss/eproj/xapian/INST//lib/python3.0/pydoc.py", line 1799, in listmodules apropos(key) File "/home/ss/eproj/xapian/INST//lib/python3.0/pydoc.py", line 1913, in apropos ModuleScanner().run(callback, key, onerror=onerror) File "/home/ss/eproj/xapian/INST//lib/python3.0/pydoc.py", line 1875, in run source = loader.get_source(modname) File "/home/ss/eproj/xapian/INST/lib/python3.0/pkgutil.py", line 293, in get_source self.source = self.file.read() File "/home/ss/eproj/xapian/INST//lib/python3.0/io.py", line 1720, in read decoder = self._decoder or self._get_decoder() File "/home/ss/eproj/xapian/INST//lib/python3.0/io.py", line 1506, in _get_decoder make_decoder = codecs.getincrementaldecoder(self._encoding) File "/home/ss/eproj/xapian/INST//lib/python3.0/codecs.py", line 960, in getincrementaldecoder decoder = lookup(encoding).incrementaldecoder LookupError: unknown encoding: uft-8 The reason for errors is test/ directory which has got tests for python parser are installed in Lib directory. I propose that these files should be installed by default in some other directory. Preferably in /share or /share/doc part of the tree. regards -- ~preet~

3 3

albatross backup
by "Martin v. Löwis" May 11, 2009

May 11, 2009

Hi Sean, Can you please setup backup for albatross? I gave sudo permissions to the "jafo" user, which has the key jafo(a)guin.tummy.com authorized. I think the policy now is that root logins to albatross are not allowed. So what might work is this: Create an rsyncbackup user, and give it sudo permission to run rsync (any command line arguments). Put your backup pubkey into rsyncbackup's authorized_keys. Could that actually work? albatross admins: would that be an acceptable setup? As for volumes to backup: I think /srv needs regular backup. Not sure about any of the others (and neither sure what your current strategy is wrt. volumes on the other machines). Compared to /srv, everything else is peanuts, anyway. Regards, Martin P.S. I have removed ~root/.ssh/authorized_keys. It only contained my key, and root logins are disallowed, anyway. P.P.S. You can stop doing regular backups to bag. I think we should keep the machine one for a little while, then turn it off and keep it around for a further while, and then return it to XS4ALL; making a complete dump before returning it.

2 2

py3k, cgi, and form-data
by Robert Brewer May 11, 2009

May 11, 2009

There's a major change in functionality in the cgi module between Python 2 and Python 3 which I've just run across: the behavior of FieldStorage.read_multi, specifically when an HTTP app accepts a file upload within a multipart/form-data payload. In Python 2, each part would be read in sequence within its own FieldStorage instance. This allowed file uploads to be shunted to a TemporaryFile (via make_file) as needed: klass = self.FieldStorageClass or self.__class__ part = klass(self.fp, {}, ib, environ, keep_blank_values, strict_parsing) # Throw first part away while not part.done: headers = rfc822.Message(self.fp) part = klass(self.fp, headers, ib, environ, keep_blank_values, strict_parsing) self.list.append(part) In Python 3 (svn revision 72466), the whole request body is read into memory first via fp.read(), and then broken into separate parts in a second step: klass = self.FieldStorageClass or self.__class__ parser = email.parser.FeedParser() # Create bogus content-type header for proper multipart parsing parser.feed('Content-Type: %s; boundary=%s\r\n\r\n' % (self.type, ib)) parser.feed(self.fp.read()) full_msg = parser.close() # Get subparts msgs = full_msg.get_payload() for msg in msgs: fp = StringIO(msg.get_payload()) part = klass(fp, msg, ib, environ, keep_blank_values, strict_parsing) self.list.append(part) This makes the cgi module in Python 3 somewhat crippled for handling multipart/form-data file uploads of any significant size (and since the client is the one determining the size, opens a server up for an unexpected Denial of Service vector). I *think* the FeedParser is designed to accept incremental writes, but I haven't yet found a way to do any kind of incremental reads from it in order to shunt the fp.read out to a tempfile again. I'm secretly hoping Barry has a one-liner fix for this. ;) Robert Brewer fumanchu(a)aminus.org

1 0

Proposed: drop unnecessary "context" pointer from PyGetSetDef
by Larry Hastings May 8, 2009

May 8, 2009

I should have brought this up to python-dev before--sorry for being so slow. It's already in the tracker for a couple of days: http://bugs.python.org/issue5880 The idea: PyGetSetDef has this "void *closure" field that acts like a context pointer. You stick it in the PyGetSetDef, and it gets passed back to you when your getter or setter is called. It's a reasonable API design, but in practice you almost never need it. Meanwhile, it clutters up CPython, particularly typeobject.c; there are all these function calls that end with ", NULL);", just to satisfy the getter/setter prototype internally. Most of the time, the "closure" parameter is not only unused, it is skipped. PyGetSetDef definitions generally skip it, and often getter and setter implementations omit it. The "closure" was only actually *used* once in CPython, a silly use in Objects/longobject.c where it was abused as an integer value. And yes, I said "was": inspired by this discussion, Mark Dickinson removed this use in r72202 (trunk) and r72203 (py3k). So the "closure" field is now 100% unused in the python and py3k trunks. Mr. Dickinson also located an extension using the "closure" pointer, pyephem, which... *also* uses it to store an integer. Indeed, I have yet to see a use where someone stores a pointer in "closure". Anyone who needed functionality like this could roll it themselves with stub functions: PyObject *my_getter_with_context(PyObject *self, void *context) { /* ... */ } PyObject *my_getter_A(PyObject *self) { return my_getter_with_context(self, "A"); } PyObject *my_getter_B(PyObject *self) { return my_getter_with_context(self, "B"); } /* etc. */ (Although it'd make my example more realistic if "context" were an int!) So: you don't need it, it clutters up our code (particularly typeobject.c), and it adds overhead. The only good reason to keep it is backwards compatibility, which I admit is a fine reason. Whaddya think? To be honest I'd be surprised if you guys went for this. But I thought it was worth suggesting. /larry/

7 14

Easy way to detect filesystem case-sensitivity?
by Brett Cannon May 8, 2009

May 8, 2009

[my python-dev sabbatical is still in effect, so make sure I am at least cc'ed on any replies to this email] I cannot be the only person who has a need to run tests conditionally based on whether the file system is case-sensitive or not, so I feel like I am re-inventing the wheel for issue 5442 to handle OS X with a case-sensitive filesystem. Is there a boolean somewhere that I can simply check or get to know whether the filesystem is case-sensitive? -Brett

7 7

Summary of Python tracker Issues
by Python tracker May 8, 2009

May 8, 2009

ACTIVITY SUMMARY (05/01/09 - 05/08/09) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 2188 open (+45) / 15604 closed (+30) / 17792 total (+75) Open issues with patches: 848 Average duration of open issues: 646 days. Median duration of open issues: 396 days. Open Issues Breakdown open 2153 (+45) pending 34 ( +0) Issues Created Or Reopened (75) _______________________________ socketmodule.c on HPUX ia64 without _XOPEN_SOURCE_EXTENDED comp 05/01/09 http://bugs.python.org/issue5895 created ntai timeit documentation 05/01/09 http://bugs.python.org/issue5896 created hrfeels No library reference tree in chm help file 05/01/09 CLOSED http://bugs.python.org/issue5897 created suraj Hang in Popen.wait() when another process has been created 05/01/09 http://bugs.python.org/issue5898 created farialima test_capi crashes when called more than once 05/01/09 CLOSED http://bugs.python.org/issue5899 created pitrou Ensure RUNPATH is added to extension modules with RPATH if GNU l 05/01/09 http://bugs.python.org/issue5900 created flub patch missing meta-info in documentation pdf 05/02/09 http://bugs.python.org/issue5901 created ZeD Stricter codec names 05/02/09 http://bugs.python.org/issue5902 created ezio.melotti strftime fails in non UTF-8 locale 05/02/09 http://bugs.python.org/issue5903 created barry-scott strftime docs do not explain locale affect on result string 05/02/09 http://bugs.python.org/issue5904 created barry-scott strptime fails in non-UTF locale 05/02/09 http://bugs.python.org/issue5905 created pitrou Risk of confusion in multiprocessing module - daemonic processes 05/02/09 http://bugs.python.org/issue5906 created pakal repr of time.struct_time type does not eval 05/02/09 http://bugs.python.org/issue5907 created jwm I need to import the module in the same thread 05/02/09 http://bugs.python.org/issue5908 created tyoc Segfault in typeobject.c 05/02/09 CLOSED http://bugs.python.org/issue5909 created gbritton kqueue for more than one event is broken. 05/02/09 http://bugs.python.org/issue5910 created Erik Gorset patch built-in compile() should take encoding option. 05/03/09 http://bugs.python.org/issue5911 created naoki import deadlocks when using fork 05/03/09 http://bugs.python.org/issue5912 created abaron On Windows os.listdir('') -> cwd and os.listdir(u'') -> C:\ 05/03/09 CLOSED http://bugs.python.org/issue5913 created ezio.melotti patch Add PyOS_string_to_double function to C API 05/03/09 CLOSED http://bugs.python.org/issue5914 created marketdickinson patch PEP 383 implementation 05/03/09 CLOSED http://bugs.python.org/issue5915 created loewis patch Wrong function referenced in documentation of socket.inet_aton 05/03/09 CLOSED http://bugs.python.org/issue5916 created phihag patch Reference platform-independent alternative in socket.inet_ntop d 05/03/09 CLOSED http://bugs.python.org/issue5917 created phihag patch test_parser crashes when run after some other tests 05/04/09 http://bugs.python.org/issue5918 created pitrou patch pygettext documentation 05/04/09 CLOSED http://bugs.python.org/issue5919 created efrerich Confusing float formatting for empty presentation type. 05/04/09 CLOSED http://bugs.python.org/issue5920 created marketdickinson patch PEP 362 can be marked as finished? 05/04/09 CLOSED http://bugs.python.org/issue5921 created stutzbach Multi-with patch 05/04/09 http://bugs.python.org/issue5922 created georg.brandl patch turtle.py update: 1.0 --> 1.1 05/04/09 CLOSED http://bugs.python.org/issue5923 created gregorlingl patch When setting complete PYTHONPATH on Python 3.x, paths in the PYT 05/04/09 http://bugs.python.org/issue5924 created fabioz Odd formatting differences of keywords in reference 05/04/09 CLOSED http://bugs.python.org/issue5925 created MLModel bdist_msi - add support for minimum Python version for pure Pyth 05/04/09 http://bugs.python.org/issue5926 created atuining Typo in library on xmlrpc 05/04/09 CLOSED http://bugs.python.org/issue5927 created JonathansCorner.com Missing space after period in xmlrpc library documentation 05/04/09 CLOSED http://bugs.python.org/issue5928 created JonathansCorner.com warnings in unicodeobject.c 05/04/09 CLOSED http://bugs.python.org/issue5929 created pitrou patch Transient error in multiprocessing 05/04/09 http://bugs.python.org/issue5930 created pitrou Python runtime name hardcoded in wsgiref.simple_server 05/04/09 http://bugs.python.org/issue5931 created thijs _json: _convertPyInt_AsSsize_t() never raise any error 05/05/09 CLOSED http://bugs.python.org/issue5932 created haypo patch fix gcc -Wextra warnings (compare signed/unsigned) 05/05/09 http://bugs.python.org/issue5933 created haypo patch fix gcc warnings: explicit type conversion for uid/gid in posix 05/05/09 http://bugs.python.org/issue5934 created haypo patch Better documentation of use of BROWSER environment variable 05/05/09 http://bugs.python.org/issue5935 created Eddie E Add MSI suport for uninstalling individual versions 05/05/09 http://bugs.python.org/issue5936 created bethard Problems with dbm documentation 05/05/09 http://bugs.python.org/issue5937 created MLModel Noddy examples haven't been updated to match PEP 3123 05/05/09 CLOSED http://bugs.python.org/issue5938 created larry Ensure that PyCapsule_GetPointer calls in ctypes handle errors a 05/05/09 http://bugs.python.org/issue5939 created larry Wrong type check in check_library_list 05/05/09 CLOSED http://bugs.python.org/issue5940 created cdavid customize_compiler broken 05/05/09 CLOSED http://bugs.python.org/issue5941 created cdavid patch Ambiguity in dbm.open flag documentation 05/05/09 http://bugs.python.org/issue5942 created MLModel Bus error in test_posix on Mac OS 05/05/09 CLOSED http://bugs.python.org/issue5943 created eric.smith patch test_os failure on OS X, probably related to PEP 383 05/05/09 CLOSED http://bugs.python.org/issue5944 created marketdickinson patch PyMapping_Check returns 1 for lists 05/05/09 http://bugs.python.org/issue5945 created jmillikin Fix spelling error in Capsule docs 05/05/09 CLOSED http://bugs.python.org/issue5946 created larry patch Deprecate CObject 05/05/09 CLOSED http://bugs.python.org/issue5947 created larry patch setlocale regression 05/06/09 CLOSED http://bugs.python.org/issue5948 created Kerfred IMAP4_SSL spin because of SSLSocket.suppress_ragged_eofs 05/06/09 http://bugs.python.org/issue5949 created kevinwatters zimport doesn't work with zipfile containing comments 05/06/09 http://bugs.python.org/issue5950 created dsamersoff email.message : get_payload args's documentation is confusing 05/06/09 http://bugs.python.org/issue5951 created trolldbois AttributeError exception in urllib.urlopen 05/07/09 CLOSED http://bugs.python.org/issue5952 created sprigogin Add to "whats new": range(n) != range(n) 05/07/09 http://bugs.python.org/issue5953 created MLModel PyFrame_GetLineNumber 05/07/09 http://bugs.python.org/issue5954 created jyasskin patch, needs review aifc: close() does not close the underlying file 05/07/09 CLOSED http://bugs.python.org/issue5955 reopened amaury.forgeotdarc test_distutils fails for Python 3.1b1 on MacOS X 05/07/09 http://bugs.python.org/issue5956 created MrJean1 Possible mistake regarding writeback in documentation of shelve. 05/07/09 http://bugs.python.org/issue5957 created MLModel Typo in documentation of shelve.sync 05/07/09 CLOSED http://bugs.python.org/issue5958 created MLModel PyCode_NewEmpty 05/07/09 http://bugs.python.org/issue5959 created jyasskin patch, needs review Windows Installer Error 1722 when opting for compilation at inst 05/07/09 http://bugs.python.org/issue5960 created keldonin Missing labelside option for Tix option menu (fix included) 05/07/09 http://bugs.python.org/issue5961 created caryr Ambiguity about the semantics of sys.exit() and os._exit() in mu 05/07/09 http://bugs.python.org/issue5962 created pakal Doc error: integer precision in formats 05/07/09 CLOSED http://bugs.python.org/issue5963 created tjreedy WeakSet cmp methods 05/08/09 http://bugs.python.org/issue5964 created schuppenies Format Specs: doc 's' and implicit conversions 05/08/09 http://bugs.python.org/issue5965 created tjreedy unnecessary hardlink 05/08/09 http://bugs.python.org/issue5966 created exe PyList_GetSlice does not indicate negative ranges dont work as i 05/08/09 http://bugs.python.org/issue5967 created ideasman42 patch Generator expression bug? 05/08/09 CLOSED http://bugs.python.org/issue5968 created svenrahmann setup build with Platform SDK, finding vcvarsall.bat 05/08/09 http://bugs.python.org/issue5969 created MarcMarc Issues Now Closed (80) ______________________ str.format() wrongly formats complex() numbers (Py30a2) 510 days http://bugs.python.org/issue1588 marketdickinson patch shutil.copyfile blocks indefinitely on named pipes 337 days http://bugs.python.org/issue3002 pitrou patch FD leak in urllib2 328 days http://bugs.python.org/issue3066 gregory.p.smith IDLE opens window too low on Windows 303 days http://bugs.python.org/issue3286 gpolo Option to not-exit on test 290 days http://bugs.python.org/issue3379 michael.foord patch Ill-formed surrogates not treated as errors during encoding/deco 251 days http://bugs.python.org/issue3672 benjamin.peterson patch unicode-internal encoder reports wrong length 249 days http://bugs.python.org/issue3739 haypo patch Add Google's ipaddr.py to the stdlib 220 days http://bugs.python.org/issue3959 gregory.p.smith merge json library with latest simplejson 2.0.x 46 days http://bugs.python.org/issue4136 benjamin.peterson patch ctypes fails to build on mipsel-linux-gnu (detects mips instead 172 days http://bugs.python.org/issue4305 theller patch [PATCH] Better stacklevel for GzipFile.filename DeprecationWarni 170 days http://bugs.python.org/issue4351 pjenvey patch UTF7 encoding of slash (character 47) is incorrect 160 days http://bugs.python.org/issue4425 haypo UTF7 decoding is far too strict 160 days http://bugs.python.org/issue4426 pitrou patch, needs review Patch for better thread support in hashlib 128 days http://bugs.python.org/issue4751 gregory.p.smith patch Curses Unicode Support 129 days http://bugs.python.org/issue4787 asmodai find_library can return directories instead of files 118 days http://bugs.python.org/issue4875 theller unpickling does not intern attribute names 95 days http://bugs.python.org/issue5084 pitrou patch Invalid UTF-8 ("%s") length in PyUnicode_FromFormatV() 94 days http://bugs.python.org/issue5108 haypo patch pdb feature request: Ability to skip standard lib modules and ot 91 days http://bugs.python.org/issue5142 georg.brandl patch bdist_msi generates version number for pure Python packages 75 days http://bugs.python.org/issue5311 bethard patch Multicast example mcast.py is outdated and ugly 66 days http://bugs.python.org/issue5379 gregory.p.smith patch msvcrt bytes cleanup 59 days http://bugs.python.org/issue5410 benjamin.peterson patch Create alternative CObject API that is safe and clean 35 days http://bugs.python.org/issue5630 benjamin.peterson patch test__locale fails with RADIXCHAR on Windows 34 days http://bugs.python.org/issue5643 benjamin.peterson patch cleanUp stack for unittest 29 days http://bugs.python.org/issue5679 yaneurabeya patch test_zipfile fails under Windows 30 days http://bugs.python.org/issue5692 pitrou patch os.getpwent returns unsigned 32bit value, os.setuid refuses it 28 days http://bugs.python.org/issue5705 gregory.p.smith 64bit msi.py still tries to copy non-existent test/README 28 days http://bugs.python.org/issue5721 loewis patch 2.6.2c1 fails to pass test_cmath on Solaris10 26 days http://bugs.python.org/issue5724 marketdickinson patch ld_so_aix does exit successfully even in case of failure 22 days http://bugs.python.org/issue5726 pitrou patch Support telling TestResult objects a test run has finished 23 days http://bugs.python.org/issue5728 michael.foord patch Change ntpath functions to implicitly support UNC paths 16 days http://bugs.python.org/issue5799 eric.smith patch, needs review IDLE/Win Installer: drop -n switch for 2.7/3.1; install 3.1 as i 11 days http://bugs.python.org/issue5847 benjamin.peterson Full example for emulating a container type 6 days http://bugs.python.org/issue5850 yaneurabeya Make complex repr and str more like float repr and str 5 days http://bugs.python.org/issue5858 marketdickinson test_urllib fails on windows 8 days http://bugs.python.org/issue5861 orsenthil Remove extraneous backwards-compatibility attributes from some m 5 days http://bugs.python.org/issue5881 benjamin.peterson patch detach() implementation 2 days http://bugs.python.org/issue5883 benjamin.peterson patch mmap.write_byte out of bounds - no error, position gets screwed 6 days http://bugs.python.org/issue5887 bmearns Extra comma in enum - fails on AIX 1 days http://bugs.python.org/issue5889 georg.brandl Subclassing property doesn't preserve the auto __doc__ behavior 4 days http://bugs.python.org/issue5890 r.david.murray patch, needs review Add support to pydoc to output .rst restructured text 0 days http://bugs.python.org/issue5893 georg.brandl No library reference tree in chm help file 0 days http://bugs.python.org/issue5897 georg.brandl test_capi crashes when called more than once 4 days http://bugs.python.org/issue5899 benjamin.peterson Segfault in typeobject.c 5 days http://bugs.python.org/issue5909 amaury.forgeotdarc On Windows os.listdir('') -> cwd and os.listdir(u'') -> C:\ 1 days http://bugs.python.org/issue5913 ezio.melotti patch Add PyOS_string_to_double function to C API 0 days http://bugs.python.org/issue5914 marketdickinson patch PEP 383 implementation 1 days http://bugs.python.org/issue5915 loewis patch Wrong function referenced in documentation of socket.inet_aton 1 days http://bugs.python.org/issue5916 georg.brandl patch Reference platform-independent alternative in socket.inet_ntop d 1 days http://bugs.python.org/issue5917 georg.brandl patch pygettext documentation 1 days http://bugs.python.org/issue5919 georg.brandl Confusing float formatting for empty presentation type. 1 days http://bugs.python.org/issue5920 eric.smith patch PEP 362 can be marked as finished? 0 days http://bugs.python.org/issue5921 georg.brandl turtle.py update: 1.0 --> 1.1 1 days http://bugs.python.org/issue5923 georg.brandl patch Odd formatting differences of keywords in reference 0 days http://bugs.python.org/issue5925 georg.brandl Typo in library on xmlrpc 0 days http://bugs.python.org/issue5927 georg.brandl Missing space after period in xmlrpc library documentation 0 days http://bugs.python.org/issue5928 georg.brandl warnings in unicodeobject.c 1 days http://bugs.python.org/issue5929 georg.brandl patch _json: _convertPyInt_AsSsize_t() never raise any error 0 days http://bugs.python.org/issue5932 georg.brandl patch Noddy examples haven't been updated to match PEP 3123 0 days http://bugs.python.org/issue5938 larry Wrong type check in check_library_list 1 days http://bugs.python.org/issue5940 tarek customize_compiler broken 3 days http://bugs.python.org/issue5941 tarek patch Bus error in test_posix on Mac OS 0 days http://bugs.python.org/issue5943 loewis patch test_os failure on OS X, probably related to PEP 383 0 days http://bugs.python.org/issue5944 marketdickinson patch Fix spelling error in Capsule docs 0 days http://bugs.python.org/issue5946 georg.brandl patch Deprecate CObject 0 days http://bugs.python.org/issue5947 georg.brandl patch setlocale regression 0 days http://bugs.python.org/issue5948 georg.brandl AttributeError exception in urllib.urlopen 1 days http://bugs.python.org/issue5952 amaury.forgeotdarc aifc: close() does not close the underlying file 1 days http://bugs.python.org/issue5955 georg.brandl Typo in documentation of shelve.sync 1 days http://bugs.python.org/issue5958 MLModel Doc error: integer precision in formats 1 days http://bugs.python.org/issue5963 eric.smith Generator expression bug? 0 days http://bugs.python.org/issue5968 r.david.murray urllib doesn't correct server returned urls 1875 days http://bugs.python.org/issue918368 orsenthil patch linecache.py::updatecache strips directory info from files 1629 days http://bugs.python.org/issue1068477 georg.brandl http_error_302() crashes with 'HTTP/1.1 400 Bad Request 1528 days http://bugs.python.org/issue1153027 orsenthil easy PEP 349: allow str() to return unicode 1350 days http://bugs.python.org/issue1266570 haypo patch linecache module returns wrong results 1313 days http://bugs.python.org/issue1309567 georg.brandl patch locale.getpreferredencoding() dies when setlocale fails 1158 days http://bugs.python.org/issue1443504 asmodai patch mailbox.Maildir re-reads directory too often 881 days http://bugs.python.org/issue1607951 akuchling patch linecache package handling 659 days http://bugs.python.org/issue1754483 georg.brandl patch Top Issues Most Discussed (10) ______________________________ 20 CVE-2008-5983 python: untrusted python modules search path 24 days open http://bugs.python.org/issue5753 19 test_asynchat fails on Mac OSX 18 days open http://bugs.python.org/issue5798 18 locale.getpreferredencoding() dies when setlocale fails 1158 days closed http://bugs.python.org/issue1443504 17 Change ntpath functions to implicitly support UNC paths 16 days closed http://bugs.python.org/issue5799 13 bdist_msi generates version number for pure Python packages 75 days closed http://bugs.python.org/issue5311 10 turtle.py update: 1.0 --> 1.1 1 days closed http://bugs.python.org/issue5923 9 test_os failure on OS X, probably related to PEP 383 0 days closed http://bugs.python.org/issue5944 9 customize_compiler broken 3 days closed http://bugs.python.org/issue5941 9 Add Google's ipaddr.py to the stdlib 220 days closed http://bugs.python.org/issue3959 9 Ill-formed surrogates not treated as errors during encoding/dec 251 days closed http://bugs.python.org/issue3672

1 0

feature request 5804
by Kristján Valur Jónsson May 8, 2009

May 8, 2009

Hello there. I have sumitted the following patch: Add an 'offset' argument to zlib.decompress http://bugs.python.org/issue5804 I'd be interested on getting some more feedback on it. Kristján

1 0

PEP 383 update: utf8b is now the error handler
by "Martin v. Löwis" May 8, 2009

May 8, 2009

With issue 3672 resolved, it is now unnecessary to introduce an utf-8b codec, since the utf-8 codec will properly report errors for all byte sequences invalid in UTF-8, including lone surrogates. Therefore, utf-8b can be implemented solely through the error handler. Glenn Linderman suggested that the name "python-escape" is not very descriptive, so I've changed the name to "utf8b". I've updated the PEP accordingly. Regards, Martin

18 98

py3k build broken
by Eric Smith May 8, 2009

May 8, 2009

Tarek: With you ARFLAGS change, I now get the following error on a 32 bit Fedora 6 box. I've done "make distclean" and "./configure": $ make ... gcc -pthread -fno-strict-aliasing -g -Wall -Wstrict-prototypes -I. -IInclude -I./Include -DPy_BUILD_CORE -I./Modules/_io -c ./Modules/_io/textio.c -o Modules/textio.o gcc -pthread -fno-strict-aliasing -g -Wall -Wstrict-prototypes -I. -IInclude -I./Include -DPy_BUILD_CORE -I./Modules/_io -c ./Modules/_io/stringio.c -o Modules/stringio.o gcc -pthread -fno-strict-aliasing -g -Wall -Wstrict-prototypes -I. -IInclude -I./Include -DPy_BUILD_CORE -c ./Modules/zipimport.c -o Modules/zipimport.o ./Modules/zipimport.c: In function ‘get_module_code’: ./Modules/zipimport.c:1132: warning: format ‘%c’ expects type ‘int’, but argument 3 has type ‘long int’ gcc -pthread -fno-strict-aliasing -g -Wall -Wstrict-prototypes -I. -IInclude -I./Include -DPy_BUILD_CORE -c ./Modules/symtablemodule.c -o Modules/symtablemodule.o gcc -pthread -fno-strict-aliasing -g -Wall -Wstrict-prototypes -I. -IInclude -I./Include -DPy_BUILD_CORE -c ./Modules/xxsubtype.c -o Modules/xxsubtype.o gcc -pthread -c -fno-strict-aliasing -g -Wall -Wstrict-prototypes -I. -IInclude -I./Include -DPy_BUILD_CORE -DSVNVERSION=\"`LC_ALL=C svnversion .`\" -o Modules/getbuildinfo.o ./Modules/getbuildinfo.c rm -f libpython3.1.a ar @ARFLAGS@ libpython3.1.a Modules/getbuildinfo.o ar: illegal option -- @ Usage: ar [emulation options] [-]{dmpqrstx}[abcfilNoPsSuvV] [member-name] [count] archive-file file... ar -M [<mri-script] commands: d - delete file(s) from the archive m[ab] - move file(s) in the archive p - print file(s) found in the archive q[f] - quick append file(s) to the archive r[ab][f][u] - replace existing or insert new file(s) into the archive t - display contents of archive x[o] - extract file(s) from the archive command specific modifiers: [a] - put file(s) after [member-name] [b] - put file(s) before [member-name] (same as [i]) [N] - use instance [count] of name [f] - truncate inserted file names [P] - use full path names when matching [o] - preserve original dates [u] - only replace files that are newer than current archive contents generic modifiers: [c] - do not warn if the library had to be created [s] - create an archive index (cf. ranlib) [S] - do not build a symbol table [v] - be verbose [V] - display the version number @<file> - read options from <file> emulation options: No emulation specific options ar: supported targets: elf32-i386 a.out-i386-linux efi-app-ia32 elf32-little elf32-big srec symbolsrec tekhex binary ihex trad-core make: *** [libpython3.1.a] Error 1

3 5

Adding a "sysconfig" module in the stdlib
by Tarek Ziadé May 7, 2009

May 7, 2009

Hello, I am trying to refactor distutils.log in order to use logging but I have been bugged by the fact that site.py uses distutils.util.get_platform() in "addbuilddir". The problem is the order of imports at initialization time : importing "logging" into distutils will make the initialization/build fail because site.py wil break when trying to import "logging", then "time". Anyways, So why site.py looks into distutils ? because distutils has a few functions to get some info about the platform and about the Makefile and some other header files like pyconfig.h etc. But I don't think it's the best place for this, and I have a proposal : let's create a dedicated "sysconfig" module in the standard library that will provide all the (refactored) functions located in distutils.sysconfig (but not customize_compiler) and disutils.util.get_platform. This module can be used by site.py, by distutils, and others, and will focus on this role. Regards Tarek -- Tarek Ziadé | http://ziade.org

3 2

typo in 8.1.3.1. Format Specification Mini-Language?
by Neal Becker May 7, 2009

May 7, 2009

"format_spec ::= [[fill]align][sign][#][0][width][.precision][type]" "The precision is ignored for integer values." In [36]: '%3x' % 10 Out[36]: ' a' In [37]: '%.3x' % 10 Out[37]: '00a' Apparently, precision is _not_ ignored?

3 4

Re: [Python-Dev] Help on issue 5941
by Tarek Ziadé May 7, 2009

May 7, 2009

On Thu, May 7, 2009 at 1:37 PM, David Cournapeau <cournape(a)gmail.com> wrote: > On Thu, May 7, 2009 at 7:07 PM, Tarek Ziadé <ziade.tarek(a)gmail.com> wrote: >> On Thu, May 7, 2009 at 11:50 AM, David Cournapeau <cournape(a)gmail.com> wrote: >>> Then, in the customize_compiler function, set archiver to $AR + >>> $ARFLAGS. IOW, just copying the logic used for e.g. ldshared, >>> >>> I can prepare a patch if you want, >> >> I am ok on Distutils side, but I wouldn't mind some help on the >> makefile/configure side > > Ok, I ended up making a patch for everything. I tested it on Linux, > where it fixed the issue while keeping the customization (both AR and > ARFLAGS can be customized through environment variables). > > numpy now builds under python 2.7, > > cheers, > > David > ok thanks David, I'll complete your patch with the test I have written for this issue and commit it so it's included in 2.7/3.1. Notice that from the beginning, the unixcompiler class options are never used if the option has been customized in distutils.sysconfig and present in the Makefile, so we need to clean this behavior as well at some point, and document the customization features. By the way, do you happen to have a buildbot or something that builds numpy ? If not it'll be very interesting: I wouldn't mind having one numpy track running on the Python trunk and receiving mails if something is broken. Regards Tarek -- Tarek Ziadé | http://ziade.org

2 2

Help on issue 5941
by Tarek Ziadé May 7, 2009

May 7, 2009

Hello, I need some help on http://bugs.python.org/issue5941 The bug is quite simple: the Distutils unixcompiler used to set the archiver command to "ar -rc". For quite a while now, this behavior has changed in order to be able to customize the compiler behavior from the environment. That introduced a regression because the mechanism in Distutils that looks for the AR variable in the environment also looks into the Makefile of Python. (in the Makefile then is os.environ) And as a matter of fact, AR is set to "ar" in there, so the -cr option is not set anymore. So my question is : should I make a change into the Makefile by adding for example a variable called AR_OPTIONS then build the ar command with AR + AR_OPTIONS *or* that doesn't make sense and I just need to change the behavior so it doesn't look for AR into the Makefile. (just in os.environ) Thanks Tarek -- Tarek Ziadé | http://ziade.org

2 2

[RELEASED] Python 3.1 beta 1
by Benjamin Peterson May 6, 2009

May 6, 2009

On behalf of the Python development team, I'm thrilled to announce the first and only beta release of Python 3.1. Python 3.1 focuses on the stabilization and optimization of features and changes Python 3.0 introduced. For example, the new I/O system has been rewritten in C for speed. File system APIs that use unicode strings now handle paths with undecodable bytes in them. [1] Other features include an ordered dictionary implementation and support for ttk Tile in Tkinter. For a more extensive list of changes in 3.1, see http://doc.python.org/dev/py3k/whatsnew/3.1.html or Misc/NEWS in the Python distribution. Please note that this is a beta release, and as such is not suitable for production environments. We continue to strive for a high degree of quality, but there are still some known problems and the feature sets have not been finalized. This beta is being released to solicit feedback and hopefully discover bugs, as well as allowing you to determine how changes in 3.1 might impact you. If you find things broken or incorrect, please submit a bug report at http://bugs.python.org For more information and downloadable distributions, see the Python 3.1 website: http://www.python.org/download/releases/3.1/ See PEP 375 for release schedule details: http://www.python.org/dev/peps/pep-0375/ Enjoy, -- Benjamin Benjamin Peterson benjamin at python.org Release Manager (on behalf of the entire python-dev team and 3.1's contributors)

1 0

test - please ignore
by Benjamin Peterson May 6, 2009

May 6, 2009

Some of my messages appear not to have gotten through. -- Regards, Benjamin

1 0

Proposed: add support for UNC paths to all functions in ntpath
by Larry Hastings May 6, 2009

May 6, 2009

I've written a patch for Python 3.1 that changes os.path so it handles UNC paths on Windows: http://bugs.python.org/issue5799 In a Windows path string, a UNC path functions *exactly* like a drive letter. This patch means that the Python path split/join functions treats them as if they were. For instance: >>> splitdrive("A:\\FOO\\BAR.TXT") ("A:", "\\FOO\\BAR.TXT") With this patch applied: >>> splitdrive("\\\\HOSTNAME\\SHARE\\FOO\\BAR.TXT") ("\\\\HOSTNAME\\SHARE", "\\FOO\\BAR.TXT") This methodology only breaks down in one place: there is no "default directory" for a UNC share point. E.g. you can say >>> os.chdir("c:") or >>> os.chdir("c:foo\\bar") but you can't say >>> os.chdir("\\\\hostname\\share") But this is irrelevant to the patch. Here's what my patch changes: * Modify join, split, splitdrive, and ismount to add explicit support for UNC paths. (The other functions pick up support from these four.) * Simplify isabs and normpath, now that they don't need to be delicate about UNC paths. * Modify existing unit tests and add new ones. * Document the changes to the API. * Deprecate splitunc, with a warning and a documentation remark. This patch adds one subtle change I hadn't expected. If you call split() with a drive letter followed by a trailing slash, it returns the trailing slash as part of the "head" returned. E.g. >>> os.path.split("\\") ("\\", "") >>> os.path.split("A:\\") ("A:\\", "") This is mentioned in the documentation, as follows: Trailing slashes are stripped from head unless it is the root (one or more slashes only). For some reason, when os.path.split was called with a UNC path with only a trailing slash, it stripped the trailing slash: >>> os.path.split("\\\\hostname\\share\\") ("\\\\hostname\\share", "") My patch changes this behavior; you would now see: >>> os.path.split("\\\\hostname\\share\\") ("\\\\hostname\\share\\", "") I think it's an improvement--this is more consistent. Note that this does *not* break the documented requirement that os.path.join(os.path.split(path)) == path; that continues to work fine. In the interests of full disclosure: I submitted a patch providing this exact behavior just over ten years ago. GvR accepted it into Python 1.5.2b2 (marked "*EXPERIMENTAL*") and removed it from 1.5.2c1. You can read GvR's commentary upon removing it; see comments in Misc/HISTORY <http://svn.python.org/view/python/trunk/Misc/HISTORY> dated "Tue Apr 6 19:38:18 1999". If memory serves correctly, the problems cited were only on Cygwin. At the time Cygwin used "ntpath", and it supported "//a/foo" as an alias for "A:\\FOO". You can see how this would cause Cygwin problems. In the intervening decade, two highly relevant things have happened: * Python no longer uses ntpath for os.path on Cygwin. Instead it uses posixpath. * Cygwin removed the "//a/foo" drive letter hack. In fact, I believe it now support UNC paths. Therefore this patch will have no effect on Cygwin users. What do you think? /larry/

6 8

[RELEASED] Python 3.1 beta 1
by Benjamin Peterson May 6, 2009

May 6, 2009

On behalf of the Python development team, I'm thrilled to announce the first and only beta release of Python 3.1. Python 3.1 focuses on the stabilization and optimization of features and changes Python 3.0 introduced. For example, the new I/O system has been rewritten in C for speed. File system APIs that use unicode strings now handle paths with undecodable bytes in them. [1] Other features include an ordered dictionary implementation and support for ttk Tile in Tkinter. For a more extensive list of changes in 3.1, see http://doc.python.org/dev/py3k/whatsnew/3.1.html or Misc/NEWS in the Python distribution. Please note that this is a beta release, and as such is not suitable for production environments. We continue to strive for a high degree of quality, but there are still some known problems and the feature sets have not been finalized. This beta is being released to solicit feedback and hopefully discover bugs, as well as allowing you to determine how changes in 3.1 might impact you. If you find things broken or incorrect, please submit a bug report at http://bugs.python.org For more information and downloadable distributions, see the Python 3.1 website: http://www.python.org/download/releases/3.1/ See PEP 375 for release schedule details: http://www.python.org/dev/peps/pep-0375/ Enjoy, -- Benjamin Benjamin Peterson benjamin at python.org Release Manager (on behalf of the entire python-dev team and 3.1's contributors)

1 0

Undocumented change / bug in Python3's PyMapping_Check
by John Millikin May 6, 2009

May 6, 2009

In Python 2, PyMapping_Check will return 0 for list objects. In Python 3, it returns 1. Obviously, this makes it rather difficult to differentiate between mappings and other sized iterables. In addition, it differs from the behavior of the ``collections.Mapping`` ABC -- isinstance([], collections.Mapping) returns False. I believe the new behavior is erroneous, but would like to confirm that before filing a bug. The behavior can be seen from a C extension, or if you're lazy, using ctypes: Python 2.6.2 (release26-maint, Apr 19 2009, 01:56:41) [GCC 4.3.3] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import ctypes >>> ctypes.CDLL('libpython2.6.so').PyMapping_Check(ctypes.py_object([])) 0 Python 3.0.1+ (r301:69556, Apr 15 2009, 15:59:22) [GCC 4.3.3] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import ctypes >>> ctypes.CDLL('libpython3.0.so').PyMapping_Check(ctypes.py_object([])) 1

2 1