Mailman 3 September 2007 - Python-Dev

Re: [Python-Dev] Removing the GIL (Me, not you!)
by Justin Tulloss Sept. 15, 2007

Sept. 15, 2007

Your idea can be combined with the maxint/2 initial refcount for > non-disposable objects, which should about eliminate thread-count updates > for them. > -- > I don't really like the maxint/2 idea because it requires us to differentiate between globals and everything else. Plus, it's a hack. I'd like a more elegant solution if possible. Justin

5 4

base64 -- should b64encode introduce line breaks?
by Bill Janssen Sept. 14, 2007

Sept. 14, 2007

I see that base64.b64encode and base64.standard_b64encode no longer introduce line breaks into the output strings, as base64.encodestring does. Shouldn't there be an option on one of them to do this? Bill

2 6

Re: [Python-Dev] Removing the GIL (Me, not you!)
by Jean-Paul Calderone Sept. 14, 2007

Sept. 14, 2007

On Fri, 14 Sep 2007 17:43:39 -0400, James Y Knight <foom(a)fuhm.net> wrote: > >On Sep 14, 2007, at 3:30 PM, Jean-Paul Calderone wrote: >>On Fri, 14 Sep 2007 14:13:47 -0500, Justin Tulloss <tulloss2(a)uiuc.edu> >>wrote: >>>Your idea can be combined with the maxint/2 initial refcount for >>>>non-disposable objects, which should about eliminate thread-count >>>>updates >>>>for them. >>>>-- >>> >>>I don't really like the maxint/2 idea because it requires us to >>>differentiate between globals and everything else. Plus, it's a hack. I'd >>>like a more elegant solution if possible. >> >>It's not really a solution either. If your program runs for a couple >>minutes and then exits, maybe it won't trigger some catastrophic behavior >>from this hack, but if you have a long running process then you're almost >>certain to be screwed over by this (it wouldn't even have to be *very* >>long running - a month or two could do it on a 32bit platform). > >Not true: the refcount becoming 0 only calls a dealloc function.. For >objects which are not deletable, the dealloc function should simply set the >refcount back to maxint/2. Done. > So, eg, replace the Py_FatalError in none_dealloc with an assignment to ob_refcnt? Good point, sounds like it could work (I'm pretty sure you know more about deallocation in CPython than I :). Jean-Paul

2 1

import file extensions
by tomer filiba Sept. 14, 2007

Sept. 14, 2007

a quick question: i'm working on a pythonic build system, where the build scripts are plain python files. but i want to differentiate them from normal python files (.py) by a different suffix (say .pyy), but then i can't import them. so i'm wondering, is there a quick way to just add another extension to import mechanism? or do i have to write a fully fledged import hook? -tomer

4 4

SSL and asyncore update (and SSL_shutdown)
by Bill Janssen Sept. 14, 2007

Sept. 14, 2007

I've now got an HTTPS server (more importantly, one built on asyncore and SocketServer and BaseHTTPServer), running in the test suite. Also, I think that, for the moment, I'm going to take ssl.ssl_shutdown() out of the library. The state machine implemented at the GoogleSprint really only does the client side of SSL_shutdown(); it will take a bit more work for the server side. I'll check this in this weekend, and update the 2.3-compatible package. Bill

1 0

Summary of Tracker Issues
by Tracker Sept. 14, 2007

Sept. 14, 2007

ACTIVITY SUMMARY (09/07/07 - 09/14/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1274 open (+24) / 11372 closed (+11) / 12646 total (+35) Average duration of open issues: 672 days. Median duration of open issues: 640 days. Open Issues Breakdown open 1270 (+24) pending 4 ( +0) Issues Created Or Reopened (35) _______________________________ OpenSSL detection broken for Python 3.0a1 09/07/07 CLOSED http://bugs.python.org/issue1129 created pythonmeister Idle - Save (buffer) - closes IDLE and does not save file (Windo 09/08/07 http://bugs.python.org/issue1130 created infixum Reference Manual: "for statement" links to "break statement" 09/08/07 http://bugs.python.org/issue1131 created Martoon compile error in poplib.py 09/08/07 CLOSED http://bugs.python.org/issue1132 created andre python3.0-config raises SyntaxError 09/09/07 CLOSED http://bugs.python.org/issue1133 created complex Parsing a simple script eats all of your memory 09/09/07 http://bugs.python.org/issue1134 created complex xview/yview of Tix.Grid is broken 09/09/07 http://bugs.python.org/issue1135 created ocean-city Bdb documentation 09/09/07 CLOSED http://bugs.python.org/issue1136 created arklad pyexpat patch for changing buffer_size 09/09/07 http://bugs.python.org/issue1137 created AchimGaedke Fixer needed for __future__ imports 09/09/07 http://bugs.python.org/issue1138 created collinwinter PyFile_Encoding should be PyFile_SetEncoding 09/10/07 CLOSED http://bugs.python.org/issue1139 created gagenellina re.sub returns str when processing empty unicode string 09/10/07 http://bugs.python.org/issue1140 created beda reading large files 09/10/07 http://bugs.python.org/issue1141 created Richard.Christen(a)unice.fr code sample showing errors reading large files with py 2.5/3.0 09/10/07 http://bugs.python.org/issue1142 created Richard.Christen(a)unice.fr Update to latest ElementTree in Python 2.6 09/11/07 http://bugs.python.org/issue1143 created effbot parsermodule validation out of sync with Grammar 09/11/07 http://bugs.python.org/issue1144 created dbinger Allow str.join to join non-string types (as per PEP 3100) 09/11/07 http://bugs.python.org/issue1145 created thomas.lee TextWrap vs words 1-character shorter than the width 09/11/07 http://bugs.python.org/issue1146 created sam string exceptions inconsistently deprecated/disabled 09/11/07 CLOSED http://bugs.python.org/issue1147 created exarkun TypeError on join - httplib mixing str and bytes 09/11/07 CLOSED http://bugs.python.org/issue1148 created eopadoan fdopen does not work as expected 09/11/07 http://bugs.python.org/issue1149 created luis(a)luispedro.org Rename PyBUF_WRITEABLE to PyBUF_WRITABLE 09/11/07 http://bugs.python.org/issue1150 created gvanrossum "TypeError: expected string, bytes found" instead of KeyboardInt 09/11/07 http://bugs.python.org/issue1151 created eopadoan Bug in documentation for SimpleXMLRPCServer 09/12/07 CLOSED http://bugs.python.org/issue1152 created FrankMillman help(pickle) fails: unorderable types: type() < type() 09/12/07 CLOSED http://bugs.python.org/issue1153 created Qrczak Carbon.CF memory leak 09/12/07 CLOSED http://bugs.python.org/issue1154 created hhas Carbon.CF memory management problem 09/12/07 http://bugs.python.org/issue1155 created hhas Suggested change to _exit function description in os module docu 09/12/07 http://bugs.python.org/issue1156 created jtonsing test_urllib2net fails on test_ftp 09/12/07 http://bugs.python.org/issue1157 created gvanrossum %f format for datetime objects 09/13/07 http://bugs.python.org/issue1158 created skip.montanaro os.getenv() not updated after external module uses C putenv() 09/13/07 http://bugs.python.org/issue1159 created robert.ancell Medium size regexp crashes python 09/13/07 http://bugs.python.org/issue1160 created ostkamp Garbled chars in offending line of SyntaxError traceback 09/13/07 http://bugs.python.org/issue1161 created eopadoan Python doesn't compile on Microsoft Visual Studio 2008 "Orcas" B 09/13/07 CLOSED http://bugs.python.org/issue1162 created swaroopch Patch to make py3k/Lib/test/test_thread.py use unittest 09/13/07 http://bugs.python.org/issue1163 created JonoDiCarlo Issues Now Closed (33) ______________________ Backport ABC to 2.6 16 days http://bugs.python.org/issue1026 baranguren [py3k] pdb does not work in python 3000 16 days http://bugs.python.org/issue1038 georg.brandl test_cmd_line starts python without -E 13 days http://bugs.python.org/issue1056 ncoghlan ssl.py shouldn't change class names from 2.6 to 3.x 11 days http://bugs.python.org/issue1065 janssen TypeError in poplib.py 7 days http://bugs.python.org/issue1094 gvanrossum make install failed 4 days http://bugs.python.org/issue1095 georg.brandl Deeply recursive repr segfault 7 days http://bugs.python.org/issue1096 brett.cannon 2to3, lambda with non-tuple argument inside parenthesis 4 days http://bugs.python.org/issue1107 collinwinter "make altinstall" installs pydoc, idle, smtpd.py with broken sh 6 days http://bugs.python.org/issue1120 georg.brandl Document inspect.getfullargspec() 6 days http://bugs.python.org/issue1121 georg.brandl PyTuple_Size and PyTuple_GET_SIZE return type documentation inc 6 days http://bugs.python.org/issue1122 georg.brandl bytes.split shold have same interface as str.split, or differen 4 days http://bugs.python.org/issue1125 gvanrossum OpenSSL detection broken for Python 3.0a1 0 days http://bugs.python.org/issue1129 georg.brandl compile error in poplib.py 1 days http://bugs.python.org/issue1132 georg.brandl python3.0-config raises SyntaxError 0 days http://bugs.python.org/issue1133 loewis Bdb documentation 3 days http://bugs.python.org/issue1136 georg.brandl PyFile_Encoding should be PyFile_SetEncoding 3 days http://bugs.python.org/issue1139 georg.brandl string exceptions inconsistently deprecated/disabled 0 days http://bugs.python.org/issue1147 brett.cannon TypeError on join - httplib mixing str and bytes 1 days http://bugs.python.org/issue1148 gvanrossum Bug in documentation for SimpleXMLRPCServer 1 days http://bugs.python.org/issue1152 georg.brandl help(pickle) fails: unorderable types: type() < type() 0 days http://bugs.python.org/issue1153 georg.brandl Carbon.CF memory leak 0 days http://bugs.python.org/issue1154 georg.brandl Python doesn't compile on Microsoft Visual Studio 2008 "Orcas" 1 days http://bugs.python.org/issue1162 georg.brandl time mod's timezone doesn't honor TZ var 2114 days http://bugs.python.org/issue487331 brett.cannon asyncore file wrapper & os.error 1988 days http://bugs.python.org/issue539444 brett.cannon support for server side transactions in _ssl 1498 days http://bugs.python.org/issue783188 loewis class property fset not working 842 days http://bugs.python.org/issue1207379 georg.brandl Traceback error when compiling Regex 537 days http://bugs.python.org/issue1456280 brett.cannon NNTPS support in nntplib 402 days http://bugs.python.org/issue1535659 janssen SSL "issuer" and "server" names cannot be parsed 321 days http://bugs.python.org/issue1583946 janssen Suggest a textlist() method for ElementTree 291 days http://bugs.python.org/issue1602189 effbot socket.error exceptions not subclass of StandardError 138 days http://bugs.python.org/issue1706815 gregory.p.smith Binding <Control-space> fails 26 days http://bugs.python.org/issue1774736 loewis Top Issues Most Discussed (10) ______________________________ 11 re.sub returns str when processing empty unicode string 4 days open http://bugs.python.org/issue1140 9 os.getenv() not updated after external module uses C putenv() 1 days open http://bugs.python.org/issue1159 8 code sample showing errors reading large files with py 2.5/3.0 4 days open http://bugs.python.org/issue1142 8 reading large files 4 days open http://bugs.python.org/issue1141 6 Allow str.join to join non-string types (as per PEP 3100) 3 days open http://bugs.python.org/issue1145 5 %f format for datetime objects 2 days open http://bugs.python.org/issue1158 5 Parsing a simple script eats all of your memory 6 days open http://bugs.python.org/issue1134 5 bytes.split shold have same interface as str.split, or differen 4 days closed http://bugs.python.org/issue1125 4 logging: delay_fh option and configuration kwargs 44 days open http://bugs.python.org/issue1765140 4 Python SEGFAULT on tuple.__repr__ and str() 176 days pending http://bugs.python.org/issue1686386

1 0

Re: [Python-Dev] Windows package for new SSL package?
by Paul Moore Sept. 13, 2007

Sept. 13, 2007

On 13/09/2007, Bill Janssen <janssen(a)parc.com> wrote: > > I could build some Windows installers if you want, but I'd need to > > download and install some extra versions of Python, so you'd have to > > tell me which you want doing (and I can't offer to commit to doing > > this on a regular basis...) > > Thanks, but let's wait till this settles down a bit (say, a week > passes without me saying anything about it :-). Then I'll definitely > want both VS and mingw versions to upload to the Cheeseshop. But > it's not quite ready yet. OK, ignore my other message then (except as an indication that I can build them when you're ready :-)). You don't need VS and mingw binary installers, though - the mingw ones will work for any Python (ignoring specialised custom builds, and anyone doing one of them is probably capable of building the ssl module!). Paul.

2 1

Re: [Python-Dev] Windows package for new SSL package?
by Paul Moore Sept. 13, 2007

Sept. 13, 2007

On 13/09/2007, Bill Janssen <janssen(a)parc.com> wrote: > > Anyway, philosophy aside, I'll try to make some time in the next few > > days to get a working setup.py for the SSL package using mingw. > > Hopefully, Bill will then integrate this and we'll have mingw as a > > supported option. > > I'll be happy to do that! OK, the following patch to setup.py works for mingw32. You need to set 2 variables - 1. The location where you installed gnuwin32 2. Whether you want a static or dynamic build I've checked both versions on Python 2.5.1 and they pass all tests. Static build is 670k, dynamic is 26k (but depends on the openssl DLLs libssl32.dll and libeay32.dll). Ideally, these should be settable via command line options or something. Also, it would be nice to detect the use of MSVC and do something equivalent (but presumably somewhat different), but I don't know how to detect the type of compiler the user has selected :-( Anyway, I hope it's useful. If nothing else, it offers a way for people to build the module with free software on Windows. I could build some Windows installers if you want, but I'd need to download and install some extra versions of Python, so you'd have to tell me which you want doing (and I can't offer to commit to doing this on a regular basis...) Paul.

2 1

Re: [Python-Dev] frozenset C API?
by Christopher Armstrong Sept. 13, 2007

Sept. 13, 2007

On 9/5/07, Bill Janssen <janssen(a)parc.com> wrote: > > It's actually easier to do all or nothing. I'm tempted to just report > > 'critical' extensions. > > Simpler to provide them all, though I should note that the purpose of > the information provided here is mainly for authorization/accounting > purposes, not for "other" use of the certificate. If that's desired, > they should pull the binary form of the certificate (there's an > interface for that), and use M2Crypto or PyOpenSSL to decode it in > general. This certificate has already been validated; the issue is > how to get critical information to the app so it can make > authorization decisions (like subjectAltName when the subject field is > empty). Reporting non-critical extensions like "extended key usage" > is nifty, but seems pointless. RFC 2818 """If a subjectAltName extension of type dNSName is present, that MUST be used as the identity. Otherwise, the (most specific) Common Name field in the Subject field of the certificate MUST be used. Although the use of the Common Name is existing practice, it is deprecated and Certification Authorities are encouraged to use the dNSName instead. """ This is from an explanation of how to do hostname verification when doing HTTPS requests. HTTPS clients MUST do this in order to be compliant. Is an HTTPS client not in your list of use cases? """In general, HTTP/TLS requests are generated by dereferencing a URI. As a consequence, the hostname for the server is known to the client. If the hostname is available, the client MUST check it against the server's identity as presented in the server's Certificate message, in order to prevent man-in-the-middle attacks.""" I really don't understand why you would not expose all data in the certificate. It seems totally obvious. The data is there for a reason. I want the subjectAltName. Probably other people want other stuff. Why cripple it? Please include it all. -- Christopher Armstrong International Man of Twistery http://radix.twistedmatrix.com/ http://twistedmatrix.com/ http://canonical.com/

5 16

Windows package for new SSL package?
by Bill Janssen Sept. 13, 2007

Sept. 13, 2007

I can't figure out how to build a Windows package for ssl-1.1.tar.gz, and probably don't have the tools to do it anyway. I presume that both a Windows machine and Visual Studio (because there's a C extension) is required? Anyone out there who's interested in the challenge? It's at http://www.parc.com/janssen/transient/ssl-1.1.tar.gz. Incidentally, there's no documentation in the package; instead, just use the development documentation at http://docs.python.org/dev/library/ssl.html. Bill

4 13