Mailman 3 January 2014 - Python-Dev

test.support.check_warnings
by Ethan Furman 12 Jan '14

12 Jan '14

The docs say this [1]: ========================================================== test.support.check_warnings(*filters, quiet=True) A convenience wrapper for warnings.catch_warnings() that makes it easier to test that a warning was correctly raised. It is approximately equivalent to calling warnings.catch_warnings(record=True) with warnings.simplefilter() set to always and with the option to automatically validate the results that are recorded. check_warnings accepts 2-tuples of the form ("message regexp", WarningCategory) as positional arguments. If one or more filters are provided, or if the optional keyword argument quiet is False, it checks to make sure the warnings are as expected: each specified filter must match at least one of the warnings raised by the enclosed code or the test fails, and if any warnings are raised that do not match any of the specified filters the test fails. To disable the first of these checks, set quiet to True. ========================================================== What I want is to make sure that DeprecationWarnings are being raised: ========================================================== with support.check_warnings( ("automatic int conversions have been deprecated", DeprecationWarning), quiet=False, ): exec("'%x' % pi") exec("'%x' % 3.14") exec("'%X' % 2.11") exec("'%o' % 1.79") exec("'%c' % pi") ========================================================== But if I throw in something that doesn't raise a deprecation warning, the test still passes: ========================================================== exec("'%d' % 3") ========================================================== Am I doing something wrong? -- ~Ethan~

3 4

Re: [Python-Dev] [Python-checkins] cpython (3.3): Issue #19092 - Raise a correct exception when cgi.FieldStorage is given an
by Nick Coghlan 12 Jan '14

12 Jan '14

On 12 January 2014 16:22, senthil.kumaran <python-checkins(a)python.org> wrote: > summary: > Issue #19092 - Raise a correct exception when cgi.FieldStorage is given an > invalid file-obj. Also use __bool__ to determine the bool of the FieldStorage > object. > Library > ------- > > +- Issue #19097: Raise the correct Exception when cgi.FieldStorage is given an > + Invalid fileobj. You may want to tweak the tracker so the comment ends up on the appropriate issue (#19092 is something else entirely) Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

2 1

byteformat() proposal: please critique
by Terry Reedy 12 Jan '14

12 Jan '14

The following function interpolates bytes, bytearrays, and formatted strings, the latter two auto-converted to bytes, into a bytes (or auto-converted bytearray) format. This function automates much of what some people have recommended for combining ascii text and binary blogs. The test passes on 2.7.6 as well as 3.3.3, though a 2.7-only version would be simpler. =============== # bf.py -- Terry Jan Reedy, 2014 Jan 11 "Define byteformat(): a bytes version of str.format as a function." import re def byteformat(form, obs): '''Return bytes-formated objects interpolated into bytes format. The bytes or bytearray format has two types of replacement fields. b'{}' and b'{:}': The object can be any raw bytes or bytearray object. b'{:<format_spec>}: The object can by any object ob that can be string-formated with <format_spec>. Bytearray are converted to bytes. The text encoding is the default (encoding="utf-8", errors="strict"). Users should be explicitly encode to bytes for any other encoding. The struct module can by used to produce bytes, such as binary-formated integers, that are not encoded text. Test passes on both 2.7.6 and 3.3.3. ''' if isinstance(form, bytearray): form = bytes(form) fields = re.split(b'{:?([^}]*)}', form) # print(fields) if len(fields) != 2*len(obs)+1: raise ValueError('Number of replacement fields not same as len(obs)') j = 1 # index into fields for ob in obs: if isinstance(ob, bytearray): ob = bytes(ob) field = fields[j] fields[j] = format(ob, field.decode()).encode() if field else ob j += 2 return b''.join(fields) # test code bformat = b"bytes: {}; bytearray: {:}; unicode: {:s}; int: {:5d}; float: {:7.2f}; end" objects = (b'abc', bytearray(b'def'), u'ghi', 123, 12.3) result = byteformat(bformat, objects) result2 = byteformat(bytearray(bformat), objects) strings = (ob.decode() if isinstance(ob, (bytes, bytearray)) else ob for ob in objects) expect = bformat.decode().format(*strings).encode() #print(result) #print(result2) print(expect) assert result == result2 == expect ===== This has been edited from what I posted to issue 3982 to expand the docstrings and to work the same with both bytes and bytearrays on both 2.7 and 3.3. When I posted before, I though of it merely as a proof-of-concept prototype. After reading the seemingly endless discussion of possible variations of byte formatting with % and .format, I now present it as a real, concrete, proposal. There are, of course, details that could be tweaked. The encoding uses the default, which on 3.x is (encoding='utf-8', errors='strict'). This could be changed to an explicit encoding='ascii'. If that were done, the encoding could be made a parameter that defaults to 'ascii'. The joiner could be defined as type(form)() so the output type matches the input form type. I did not do that because it complicates the test. The coercion of interpolated bytearray objects to bytes is needed for 2.7 because in 2.7, str/bytes.join raises TypeError for bytearrays in the input sequence. A 3.x-only version could drop this. One objection to the function is that it is neither % or .format. To me, this is an advantage in that a new function will not be expected to exactly match the % or .format behavior in either 2.x or 3.x. It eliminates the 'matching the old' arguments so we can focus on what actual functionality is needed. There is no need to convert true binary bytes to text with either latin-1 or surrogates. There is no need to add anything to bytes. The code above uses the built-in facilities that we already have, which to me should be the first thing to try, not the last. One new feature that does not match old behavior is that {} and {:} are changed (in 3.x) to indicate bytes whereas {:s} continues to indicate (in 3.x) unicode text. ({:s} might be changed to mean unicode for 2.7 also, but I did not explore that idea.) Similarly, a new function is free to borrow only the format_spec part of replace of replacement fields and use format(ob, format_spec) to format each object. Anyone who needs the full power of str.format is free to use it explicitly. I think format_specs cover most of what people have asked for. For future releases, the function could go in the string module. It could otherwise be added to existing or future 2&3 porting packages. -- Terry Jan Reedy

4 3

Important background for PEP 460: Py 2/3 text model differences
by Nick Coghlan 11 Jan '14

11 Jan '14

The PEP 460 discussion threads made it clear that some of the participants that weren't around for the earlier parts of the Python 3 transition were struggling with the fundamental conceptual differences between the Python 2 and Python 3 text models. Since other folks (including Armin Ronacher) have also struggled with that distinction, I added a new question and answer to my Python 3 Q&A: http://python-notes.curiousefficiency.org/en/latest/python3/questions_and_a… Cheers, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

1 0

Summary of Python tracker Issues
by Python tracker 11 Jan '14

11 Jan '14

ACTIVITY SUMMARY (2014-01-03 - 2014-01-10) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4409 (+61) closed 27580 (+42) total 31989 (+103) Open issues with patches: 1993 Issues opened (87) ================== #15027: Faster UTF-32 encoding http://bugs.python.org/issue15027 reopened by serhiy.storchaka #20115: NUL bytes in commented lines http://bugs.python.org/issue20115 opened by arigo #20116: urlparse.parse_qs should take argument for query separator http://bugs.python.org/issue20116 opened by ruben.orduz #20117: subprocess on Windows: wrong return code with shell=True http://bugs.python.org/issue20117 opened by gvanrossum #20118: test_imaplib test_linetoolong fails on 2.7 in SSL test on some http://bugs.python.org/issue20118 opened by r.david.murray #20119: pdb c(ont(inue)) optional one-time-only breakpoint (like perl http://bugs.python.org/issue20119 opened by nlevitt(a)gmail.com #20120: Percent-signs (%) in .pypirc should not be interpolated http://bugs.python.org/issue20120 opened by tlevine #20121: quopri_codec newline handling http://bugs.python.org/issue20121 opened by fredstober #20122: Move CallTips tests to idle_tests http://bugs.python.org/issue20122 opened by serhiy.storchaka #20123: pydoc.synopsis fails to load binary modules http://bugs.python.org/issue20123 opened by eric.snow #20124: The documentation for the atTime parameter of TimedRotatimeFil http://bugs.python.org/issue20124 opened by r.david.murray #20125: We need a good replacement for direct use of load_module(), po http://bugs.python.org/issue20125 opened by eric.snow #20126: sched doesn't handle events added after scheduler starts http://bugs.python.org/issue20126 opened by lotus(a)blossomhillranch.com #20127: Race condition in test_threaded_import.task()? http://bugs.python.org/issue20127 opened by eric.snow #20128: Re-enable test_modules_search_builtin() in test_pydoc http://bugs.python.org/issue20128 opened by eric.snow #20131: warnings module offers no documented, programmatic way to rese http://bugs.python.org/issue20131 opened by inducer #20132: Many incremental codecs don’t handle fragmented data http://bugs.python.org/issue20132 opened by vadmium #20133: Derby: Convert the audioop module to use Argument Clinic http://bugs.python.org/issue20133 opened by serhiy.storchaka #20135: mutate list http://bugs.python.org/issue20135 opened by m123orning #20136: Logging: StreamHandler does not use OS line separator. http://bugs.python.org/issue20136 opened by alibotean #20137: Logging: RotatingFileHandler computes string length instead of http://bugs.python.org/issue20137 opened by alibotean #20138: wsgiref on Python 3.x incorrectly implements URL handling caus http://bugs.python.org/issue20138 opened by aronacher #20139: Python installer does not install a "pip" command (just "pip3" http://bugs.python.org/issue20139 opened by pmoore #20140: UnicodeDecodeError in ntpath.py when home dir contains non-asc http://bugs.python.org/issue20140 opened by Jarek.Śmiejczak #20145: unittest.assert*Regex functions should verify that expected_re http://bugs.python.org/issue20145 opened by the.mulhern #20146: UserDict module docs link is obsolete http://bugs.python.org/issue20146 opened by drunax #20147: multiprocessing.Queue.get() raises queue.Empty exception if ev http://bugs.python.org/issue20147 opened by torsten #20148: Derby: Convert the _sre module to use Argument Clinic http://bugs.python.org/issue20148 opened by serhiy.storchaka #20150: API change in string formatting with :s option should be docum http://bugs.python.org/issue20150 opened by Thomas.Robitaille #20151: Derby: Convert the binascii module to use Argument Clinic http://bugs.python.org/issue20151 opened by serhiy.storchaka #20152: Derby #15: Convert 50 sites to Argument Clinic across 9 files http://bugs.python.org/issue20152 opened by brett.cannon #20153: New-in-3.4 weakref finalizer doc section is already out of dat http://bugs.python.org/issue20153 opened by r.david.murray #20154: Deadlock in asyncio.StreamReader.readexactly() http://bugs.python.org/issue20154 opened by gvanrossum #20155: Regression test test_httpservers fails, hangs on Windows http://bugs.python.org/issue20155 opened by jeff.allen #20156: bz2.BZ2File.read() does not treat growing input file properly http://bugs.python.org/issue20156 opened by Joshua.Chia #20159: Derby #7: Convert 51 sites to Argument Clinic across 3 files - http://bugs.python.org/issue20159 opened by serhiy.storchaka #20160: broken ctypes calling convention on MSVC / 64-bit Windows (lar http://bugs.python.org/issue20160 opened by mark.dickinson #20162: Test test_hash_distribution fails on RHEL 6.5 / ppc64 http://bugs.python.org/issue20162 opened by zaytsev #20163: ValueError: time data does not match format http://bugs.python.org/issue20163 opened by dellair.jie #20164: Undocumented KeyError from os.path.expanduser http://bugs.python.org/issue20164 opened by acdha #20165: unittest TestResult wasSuccessful returns True when there are http://bugs.python.org/issue20165 opened by gregory.p.smith #20166: window x64 c-extensions not works on python3.4.0b2 http://bugs.python.org/issue20166 opened by jarod #20167: Exception on IDLE closing http://bugs.python.org/issue20167 opened by serhiy.storchaka #20168: Derby: Convert the _tkinter module to use Argument Clinic http://bugs.python.org/issue20168 opened by serhiy.storchaka #20169: random module doc page has broken links http://bugs.python.org/issue20169 opened by roysmith #20170: Derby #1: Convert 137 sites to Argument Clinic in Modules/posi http://bugs.python.org/issue20170 opened by larry #20171: Derby #2: Convert 115 sites to Argument Clinic in Modules/_cur http://bugs.python.org/issue20171 opened by larry #20172: Derby #3: Convert 67 sites to Argument Clinic across 4 files ( http://bugs.python.org/issue20172 opened by larry #20173: Derby #4: Convert 53 sites to Argument Clinic across 5 files http://bugs.python.org/issue20173 opened by larry #20174: Derby #5: Convert 50 sites to Argument Clinic across 3 files http://bugs.python.org/issue20174 opened by larry #20175: Derby #6: Convert 50 sites to Argument Clinic across 8 files http://bugs.python.org/issue20175 opened by larry #20177: Derby #8: Convert 28 sites to Argument Clinic across 2 files http://bugs.python.org/issue20177 opened by larry #20178: Derby #9: Convert 52 sites to Argument Clinic across 11 files http://bugs.python.org/issue20178 opened by larry #20179: Derby #10: Convert 50 sites to Argument Clinic across 4 files http://bugs.python.org/issue20179 opened by larry #20180: Derby #11: Convert 50 sites to Argument Clinic across 9 files http://bugs.python.org/issue20180 opened by larry #20181: Derby #12: Convert 50 sites to Argument Clinic across 4 files http://bugs.python.org/issue20181 opened by larry #20182: Derby #13: Convert 50 sites to Argument Clinic across 5 files http://bugs.python.org/issue20182 opened by larry #20183: Derby #14: Convert 41 sites to Argument Clinic across 5 files http://bugs.python.org/issue20183 opened by larry #20184: Derby #16: Convert 50 sites to Argument Clinic across 9 files http://bugs.python.org/issue20184 opened by larry #20185: Derby #17: Convert 50 sites to Argument Clinic across 14 files http://bugs.python.org/issue20185 opened by larry #20186: Derby #18: Convert 31 sites to Argument Clinic across 23 files http://bugs.python.org/issue20186 opened by larry #20187: The Great Argument Clinic Conversion Derby Meta-Issue http://bugs.python.org/issue20187 opened by larry #20188: ALPN support for TLS http://bugs.python.org/issue20188 opened by mnot #20189: inspect.Signature doesn't recognize all builtin types http://bugs.python.org/issue20189 opened by larry #20191: resource.prlimit(int, int, str) crashs http://bugs.python.org/issue20191 opened by haypo #20192: pprint chokes on set containing frozenset http://bugs.python.org/issue20192 opened by jbylund #20193: Derby: Convert the zlib, _bz2 and _lzma modules to use Argumen http://bugs.python.org/issue20193 opened by serhiy.storchaka #20194: Add :deprecated: marker to formatter module docs http://bugs.python.org/issue20194 opened by brett.cannon #20195: Add :deprecated: marker to imp docs http://bugs.python.org/issue20195 opened by brett.cannon #20196: Argument Clinic generates invalid code for optional parameter http://bugs.python.org/issue20196 opened by serhiy.storchaka #20197: Support WebP image format detection in imghdr module http://bugs.python.org/issue20197 opened by akhenakh #20198: xml.etree.ElementTree.ElementTree.write attribute sorting http://bugs.python.org/issue20198 opened by bagratte #20199: status of module_for_loader and utils._module_to_load http://bugs.python.org/issue20199 opened by r.david.murray #20201: Argument Clinic: rwbuffer support broken http://bugs.python.org/issue20201 opened by rmsr #20202: ArgumentClinic howto: document change in Py_buffer lifecycle m http://bugs.python.org/issue20202 opened by rmsr #20204: pydocs fails for some C implemented classes http://bugs.python.org/issue20204 opened by serhiy.storchaka #20205: inspect.getsource(), P302 loader and '<..>' filenames http://bugs.python.org/issue20205 opened by stefan.mueller #20206: email quoted-printable encoding issue http://bugs.python.org/issue20206 opened by timar #20208: Clarify some things in porting HOWTO http://bugs.python.org/issue20208 opened by brett.cannon #20209: Deprecate PROTOCOL_SSLv2 http://bugs.python.org/issue20209 opened by pitrou #20210: Provide configure options to enable/disable Python modules and http://bugs.python.org/issue20210 opened by thomas-petazzoni #20211: setup.py: do not add invalid header locations http://bugs.python.org/issue20211 opened by thomas-petazzoni #20212: distutils: fix build_ext check to find whether we're building http://bugs.python.org/issue20212 opened by thomas-petazzoni #20213: Change the install location of _sysconfigdata.py http://bugs.python.org/issue20213 opened by thomas-petazzoni #20214: Argument Clinic rollup fixes http://bugs.python.org/issue20214 opened by larry #20215: Python2.7 socketserver can not listen IPv6 address http://bugs.python.org/issue20215 opened by dazhaoyu #20216: Misleading docs for sha1, sha256, sha512, md5 modules http://bugs.python.org/issue20216 opened by vajrasky Most recent 15 issues with no replies (15) ========================================== #20214: Argument Clinic rollup fixes http://bugs.python.org/issue20214 #20213: Change the install location of _sysconfigdata.py http://bugs.python.org/issue20213 #20212: distutils: fix build_ext check to find whether we're building http://bugs.python.org/issue20212 #20211: setup.py: do not add invalid header locations http://bugs.python.org/issue20211 #20210: Provide configure options to enable/disable Python modules and http://bugs.python.org/issue20210 #20204: pydocs fails for some C implemented classes http://bugs.python.org/issue20204 #20197: Support WebP image format detection in imghdr module http://bugs.python.org/issue20197 #20195: Add :deprecated: marker to imp docs http://bugs.python.org/issue20195 #20194: Add :deprecated: marker to formatter module docs http://bugs.python.org/issue20194 #20188: ALPN support for TLS http://bugs.python.org/issue20188 #20186: Derby #18: Convert 31 sites to Argument Clinic across 23 files http://bugs.python.org/issue20186 #20185: Derby #17: Convert 50 sites to Argument Clinic across 14 files http://bugs.python.org/issue20185 #20184: Derby #16: Convert 50 sites to Argument Clinic across 9 files http://bugs.python.org/issue20184 #20182: Derby #13: Convert 50 sites to Argument Clinic across 5 files http://bugs.python.org/issue20182 #20181: Derby #12: Convert 50 sites to Argument Clinic across 4 files http://bugs.python.org/issue20181 Most recent 15 issues waiting for review (15) ============================================= #20216: Misleading docs for sha1, sha256, sha512, md5 modules http://bugs.python.org/issue20216 #20214: Argument Clinic rollup fixes http://bugs.python.org/issue20214 #20213: Change the install location of _sysconfigdata.py http://bugs.python.org/issue20213 #20212: distutils: fix build_ext check to find whether we're building http://bugs.python.org/issue20212 #20211: setup.py: do not add invalid header locations http://bugs.python.org/issue20211 #20210: Provide configure options to enable/disable Python modules and http://bugs.python.org/issue20210 #20208: Clarify some things in porting HOWTO http://bugs.python.org/issue20208 #20204: pydocs fails for some C implemented classes http://bugs.python.org/issue20204 #20201: Argument Clinic: rwbuffer support broken http://bugs.python.org/issue20201 #20197: Support WebP image format detection in imghdr module http://bugs.python.org/issue20197 #20196: Argument Clinic generates invalid code for optional parameter http://bugs.python.org/issue20196 #20193: Derby: Convert the zlib, _bz2 and _lzma modules to use Argumen http://bugs.python.org/issue20193 #20174: Derby #5: Convert 50 sites to Argument Clinic across 3 files http://bugs.python.org/issue20174 #20173: Derby #4: Convert 53 sites to Argument Clinic across 5 files http://bugs.python.org/issue20173 #20172: Derby #3: Convert 67 sites to Argument Clinic across 4 files ( http://bugs.python.org/issue20172 Top 10 most discussed issues (10) ================================= #20162: Test test_hash_distribution fails on RHEL 6.5 / ppc64 http://bugs.python.org/issue20162 18 msgs #20123: pydoc.synopsis fails to load binary modules http://bugs.python.org/issue20123 17 msgs #20209: Deprecate PROTOCOL_SSLv2 http://bugs.python.org/issue20209 16 msgs #19995: %c, %o, %x, %X accept non-integer values instead of raising an http://bugs.python.org/issue19995 13 msgs #20173: Derby #4: Convert 53 sites to Argument Clinic across 5 files http://bugs.python.org/issue20173 13 msgs #10388: spwd returning different value depending on privileges http://bugs.python.org/issue10388 8 msgs #20172: Derby #3: Convert 67 sites to Argument Clinic across 4 files ( http://bugs.python.org/issue20172 8 msgs #20193: Derby: Convert the zlib, _bz2 and _lzma modules to use Argumen http://bugs.python.org/issue20193 8 msgs #1322: platform.dist() has unpredictable result under Linux http://bugs.python.org/issue1322 7 msgs #18960: First line can be executed twice http://bugs.python.org/issue18960 7 msgs Issues closed (40) ================== #5131: pprint doesn't know how to print a defaultdict http://bugs.python.org/issue5131 closed by ncoghlan #13107: Text width in optparse.py can become negative http://bugs.python.org/issue13107 closed by serhiy.storchaka #13115: tp_as_{number,sequence,mapping} can't be set using PyType_From http://bugs.python.org/issue13115 closed by loewis #16039: imaplib: unlimited readline() from connection http://bugs.python.org/issue16039 closed by r.david.murray #17390: display python version on idle title bar http://bugs.python.org/issue17390 closed by bagratte #18515: zipfile._ZipDecryptor generates wasteful crc32 table on import http://bugs.python.org/issue18515 closed by serhiy.storchaka #19081: zipimport behaves badly when the zip file changes while the pr http://bugs.python.org/issue19081 closed by gregory.p.smith #19526: Review additions to the stable ABI of Python 3.4 http://bugs.python.org/issue19526 closed by loewis #19538: Changed function prototypes in the PEP 384 stable ABI http://bugs.python.org/issue19538 closed by loewis #19659: Document Argument Clinic http://bugs.python.org/issue19659 closed by larry #19703: Update pydoc to PEP 451 http://bugs.python.org/issue19703 closed by eric.snow #19708: Check pkgutil for anything missing for PEP 451 http://bugs.python.org/issue19708 closed by eric.snow #19713: Deprecate various things in importlib thanks to PEP 451 http://bugs.python.org/issue19713 closed by eric.snow #19719: add importlib.abc.SpecLoader and SpecFinder http://bugs.python.org/issue19719 closed by brett.cannon #19723: Argument Clinic should add markers for humans http://bugs.python.org/issue19723 closed by larry #19732: python fails to build when configured with --with-system-libmp http://bugs.python.org/issue19732 closed by skrah #19927: Path-based loaders lack a meaningful __eq__() implementation. http://bugs.python.org/issue19927 closed by eric.snow #19965: Non-atomic generation of Include/Python-ast.h and Python/Pytho http://bugs.python.org/issue19965 closed by serhiy.storchaka #19976: Argument Clinic: generate second arg for METH_NOARGS http://bugs.python.org/issue19976 closed by larry #20078: zipfile - ZipExtFile.read goes into 100% CPU infinite loop on http://bugs.python.org/issue20078 closed by serhiy.storchaka #20096: Mention modernize and future in Python 2/3 porting HOWTO http://bugs.python.org/issue20096 closed by brett.cannon #20113: os.readv() and os.writev() don't raise an OSError on readv()/w http://bugs.python.org/issue20113 closed by haypo #20129: 3.4 on windows 7 can't import IntEnum http://bugs.python.org/issue20129 closed by BreamoreBoy #20130: asyncio: implement a synchronous executor if concurrent.future http://bugs.python.org/issue20130 closed by haypo #20134: typo: s/coping/copying/ http://bugs.python.org/issue20134 closed by benjamin.peterson #20141: Argument Clinic: broken support for 'O!' http://bugs.python.org/issue20141 closed by larry #20142: Argument Clinic: Py_buffer parameters are not initialized http://bugs.python.org/issue20142 closed by larry #20143: Argument Clinic: negative line numbers http://bugs.python.org/issue20143 closed by larry #20144: Argument Clinic doesn't support named constants as default val http://bugs.python.org/issue20144 closed by larry #20149: 'with instance' references class's __enter__ attribute rather http://bugs.python.org/issue20149 closed by r.david.murray #20157: Argument Clinic generates wrong keyword parameter name for "de http://bugs.python.org/issue20157 closed by larry #20158: Argument Clinic: add --clean option http://bugs.python.org/issue20158 closed by larry #20161: inspect.signature fails on some functions which use Argument C http://bugs.python.org/issue20161 closed by larry #20176: Derby #7: Convert 51 sites to Argument Clinic across 3 files http://bugs.python.org/issue20176 closed by larry #20190: dict() in dict(foo='bar').keys() raises http://bugs.python.org/issue20190 closed by haypo #20200: Argument Clinic howto: custom self_converter example broken http://bugs.python.org/issue20200 closed by python-dev #20203: ArgumentClinic: support middle optional argument http://bugs.python.org/issue20203 closed by larry #20207: Disable SSLv2 in Python 2.x http://bugs.python.org/issue20207 closed by pitrou #20217: Build failure in posixmodule.c with SCHED_SPORADIC available http://bugs.python.org/issue20217 closed by python-dev #1065986: Fix pydoc crashing on unicode strings http://bugs.python.org/issue1065986 closed by r.david.murray

1 0

Re: [Python-Dev] [Python-checkins] peps: PEP 460: add .format_map()
by Eric V. Smith 10 Jan '14

10 Jan '14

I'm not sure how format_map helps in porting from 2 to 3, since it doesn't exist in any version of 2. Although that said, it's no doubt a useful feature, just not useful in code that supports both 2 and 3 with a single code base or when porting to 3. Eric. On 1/9/2014 4:02 PM, antoine.pitrou wrote: > http://hg.python.org/peps/rev/8947cdc6b22e > changeset: 5341:8947cdc6b22e > user: Antoine Pitrou <solipsis(a)pitrou.net> > date: Thu Jan 09 22:02:01 2014 +0100 > summary: > PEP 460: add .format_map() > > files: > pep-0460.txt | 6 +++++- > 1 files changed, 5 insertions(+), 1 deletions(-) > > > diff --git a/pep-0460.txt b/pep-0460.txt > --- a/pep-0460.txt > +++ b/pep-0460.txt > @@ -24,12 +24,16 @@ > similar in syntax to ``str.format()`` (accepting positional as well as > keyword arguments). > > +* ``bytes.format_map(...)`` and ``bytearray.format_map(...)`` for an > + API similar to ``str.format_map(...)``, with the same formatting > + syntax and semantics as ``bytes.format()`` and ``bytearray.format()``. > + > > Rationale > ========= > > In Python 2, ``str % args`` and ``str.format(args)`` allow the formatting > -and interpolation of bytes strings. This feature has commonly been used > +and interpolation of bytestrings. This feature has commonly been used > for the assembling of protocol messages when protocols are known to use > a fixed encoding. > > > > > _______________________________________________ > Python-checkins mailing list > Python-checkins(a)python.org > https://mail.python.org/mailman/listinfo/python-checkins >

2 2

[RELEASED] Python 3.4.0b2
by Larry Hastings 09 Jan '14

09 Jan '14

On behalf of the Python development team, I'm pleased to announce the second beta release of Python 3.4. This is a preview release, and its use is not recommended for production settings. Python 3.4 includes a range of improvements of the 3.x series, including hundreds of small improvements and bug fixes. Major new features and changes in the 3.4 release series include: * PEP 428, a "pathlib" module providing object-oriented filesystem paths * PEP 435, a standardized "enum" module * PEP 436, a build enhancement that will help generate introspection information for builtins * PEP 442, improved semantics for object finalization * PEP 443, adding single-dispatch generic functions to the standard library * PEP 445, a new C API for implementing custom memory allocators * PEP 446, changing file descriptors to not be inherited by default in subprocesses * PEP 450, a new "statistics" module * PEP 451, standardizing module metadata for Python's module import system * PEP 453, a bundled installer for the *pip* package manager * PEP 454, a new "tracemalloc" module for tracing Python memory allocations * PEP 456, a new hash algorithm for Python strings and binary data * PEP 3154, a new and improved protocol for pickled objects * PEP 3156, a new "asyncio" module, a new framework for asynchronous I/O Python 3.4 is now in "feature freeze", meaning that no new features will be added. The final release is projected for late February 2014. To download Python 3.4.0b2 visit: http://www.python.org/download/releases/3.4.0/ Please consider trying Python 3.4.0b2 with your code and reporting any new issues you notice to: http://bugs.python.org/ Enjoy! -- Larry Hastings, Release Manager larry at hastings.org (on behalf of the entire python-dev team and 3.4's contributors)

14 24

The Great Argument Clinic Conversion Derby is now open!
by Larry Hastings 08 Jan '14

08 Jan '14

I'm trying to get a huge chunk of work done on Python 3.4 in the next, oh, week-and-a-half, and I could use your help. I'm trying to convert a whole bunch of call sites in Python to use "Argument Clinic", a new build utility for Python that makes argument parsing code much easier to write. But I don't think I can do it all myself. To learn more about what Argument Clinic is, and get a sense for what the work will be like, please read the howto in the documentation: http://docs.python.org/dev/howto/clinic.html How can you help? I've split up the files in the Python source tree between about two dozen issues on the issue tracker, each having roughly 50 call sites in them to examine*. You can find the issues by searching for the word "Derby". This URL should do the trick: http://bugs.python.org/issue?%40search_text=Derby&ignore=file%3Acontent&tit… To participate, find an issue that isn't assigned to anyone and assign it to yourself. (As far as I can tell there's no way to search for issues owned by "nobody", so you'll have to hunt around.) Once you own an issue, open up those files, search for "PyArg_ParseTuple(args" and "PyArg_ParseTupleAndKeywords(args", and start converting! In case you have questions / find bugs / need help, I'll be highly available on IRC in #python-dev during the derby, as well as responding to email and changes on the issue tracker. I'm very willing to review patches. Help! //arry/ * The original plan was, one file per issue on the tracker. But there are 129 files, and I was informed that people would come to my house and make my life unpleasant if I created 129 issues on the tracker. Please forgive me for the mildly-random way the files got bundled together.

2 1

General Q&A regarding Python 3, adoption etc.
by Nick Coghlan 07 Jan '14

07 Jan '14

For anyone that isn't already aware, I wrote a Q & A about Python 3 last year (in response to an article about how we should have fixed the GIL instead of Unicode), and I've updated it extensively over the past several days due to Alex's misunderstanding of the objectives for Python 3.4 as well as Armin's latest piece on the increased difficulties in writing wire protocol handling code. The two main additions I currently have planned are a question specifically about the state of the WSGI protocol (it works, but it an error prone way), as well as one on what I'd like to see as the next steps in encouraging Python 3 adoption now that we're within 18 months of the planned date for 2.7 to enter security fix only mode (which involve encouraging community workshops to switch to teaching Python 3.4 initially, with Python 2.7 as an optional follow up, helping Ubuntu & Fedora with their transitions to Py3 by default, bringing 3.5 closer to parity with Python 2 for wire protocol development, and, on the Red Hat/Fedora side, helping to encourage the adoption of software collections as a mechanism for decoupling the runtime for Python applications from the system Python on RHEL 6 and its derivatives. I thought I mentioned it on this list last year when I first wrote it, but some messages I've seen recently suggest many folks haven't seen it before. Cheers, Nick.

5 7

Proposed: The Great Argument Clinic Conversion Derby
by Larry Hastings 07 Jan '14

07 Jan '14

Let me start with a summary of the current status of Argument Clinic. It's checked in, it seems to be working fine. As of Friday I've checked in some reasonably complete documentation as a howto: http://docs.python.org/3.4/howto/clinic.html At last, here in beta 2, Argument Clinic is ready for prime time. What about adoption? That's where Argument Clinic has stalled. By my estimate, there are about six hundred places that could be converted to work with Argument Clinic in CPython; as of this writing only a dozen or two have actually been converted. Now, properly converting a function to work with Argument Clinic does not change its behavior. Internally, the code performing argument parsing should be nigh-identical; it should call the same PyArg_Parse function, with the same arguments, and the implementation should perform the same work as a result. The only externally observable change should be that inspect.signature() now produces a valid signature for the builtin; in all other respects Python should be unchanged. No documentation should have to change, no tests should need to be modified, and absolutely no code should be broken as a result. Converting a function to use Argument Clinic should be a blissfully low-risk procedure, and produce a pleasant, easier-to-maintain result. You see where I'm going with this. I am now, reluctantly, proposing that once 3.4.0b2 ships (should be later today), we the Python core development community roll up our collective sleeves and attempt to convert all the builtins to work with Argument Clinic. I call this "The Great Argument Clinic Conversion Derby". The rules of the derby: * The derby stops when RC 1 gets tagged, which should be January 18th. * I'll create issues on the issue tracker for converting each C file. * Participants will take ownership of an issue for a particular file, and have a couple of days to submit a patch. If an issue languishes I reserve the right to reassign it. * I pledge to be highly available and responsive during the derby. * I volunteer to convert posixmodule.c, which is about 60 functions (and therefore 10% of the workload). * I volunteer to review patches until my eyes bleed. I'd prefer to review every single conversion, though it's possible that isn't feasible, not sure. (Though I will have a /lot/ of time I can devote to this.) * I'll create a leader board where contributors are ranked by how many functions they've converted, if people want it, in an endeavor to spark interest and provide some bragging rights. Upsides: * Every builtins we convert is one more builtin with introspection information. It'd be nice to have that in 3.4. * Easier maintenance going forward. Downsides: * Someone could improperly convert a function, which could change the builtin's semantics and break code, and nobody notices and we ship the breakage in 3.4.0 final. I've discussed this with a number of other core developers; so far I've only gotten positive responses. Otherwise I wouldn't propose such madness. (Making changes to 600 different places in the Python tree? What am I thinking?) Keep in mind, this isn't "now or never"; the choice is between "convert now for 3.4" and "wait until after 3.4 final, then convert everything, and it'll ship in 3.5". We'll have this sooner or later--the question is, sooner? or later? What say you? +1? -1e100? Anxiously yours, /arry

10 12