Mailman 3 August 2014 - Python-Dev

Cleaning up surrogate escaped strings (was Bytes path related questions for Guido)
by Nick Coghlan Aug. 30, 2014

Aug. 30, 2014

On 26 Aug 2014 21:34, "MRAB" <python(a)mrabarnett.plus.com> wrote: > > On 2014-08-26 03:11, Stephen J. Turnbull wrote: >> >> Nick Coghlan writes: >> >> > "purge_surrogate_escapes" was the other term that occurred to me. >> >> "purge" suggests removal, not replacement. That may be useful too. >> >> neutralize_surrogate_escapes(s, remove=False, replacement='\uFFFD') >> > How about: > > replace_surrogate_escapes(s, replacement='\uFFFD') > > If you want them removed, just pass an empty string as the replacement. The current proposal on the issue tracker is to instead take advantage of the existing error handlers: def convert_surrogateescape(data, errors='replace'): return data.encode('utf-8', 'surrogateescape').decode('utf-8', errors) That code is short, but semantically dense - it took a few iterations to come up with that version. (Added bonus: once you're alerted to the possibility, it's trivial to write your own version for existing Python 3 versions. The standard name just makes it easier to look up when you come across it in a piece of code, and provides the option of optimising it later if it ever seems worth the extra work) I also filed a separate RFE to make backslashreplace usable on input, since that allows the option of separating the replacement operation from the encoding operation. Cheers, Nick.

5 9

Summary of Python tracker Issues
by Python tracker Aug. 29, 2014

Aug. 29, 2014

ACTIVITY SUMMARY (2014-08-22 - 2014-08-29) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4638 (+17) closed 29431 (+32) total 34069 (+49) Open issues with patches: 2193 Issues opened (41) ================== #17095: Modules/Setup *shared* support broken http://bugs.python.org/issue17095 reopened by haypo #22200: Remove distutils checks for Python version http://bugs.python.org/issue22200 reopened by Arfrever #22232: str.splitlines splitting on non-\r\n characters http://bugs.python.org/issue22232 reopened by terry.reedy #22252: ssl blocking IO errors http://bugs.python.org/issue22252 opened by h.venev #22253: ConfigParser does not handle files without sections http://bugs.python.org/issue22253 opened by kernc #22255: Multiprocessing freeze_support raises RuntimeError http://bugs.python.org/issue22255 opened by Michael.McAuliffe #22256: pyvenv should display a progress indicator while creating an e http://bugs.python.org/issue22256 opened by ncoghlan #22257: PEP 432: Redesign the interpreter startup sequence http://bugs.python.org/issue22257 opened by ncoghlan #22258: set_inheritable(): ioctl(FIOCLEX) is available but fails with http://bugs.python.org/issue22258 opened by igor.pashev #22260: Rearrange tkinter tests, use test discovery http://bugs.python.org/issue22260 opened by zach.ware #22261: Document how to use Concurrent Build when using MsBuild http://bugs.python.org/issue22261 opened by sbspider #22263: Add a resource for CLI tests http://bugs.python.org/issue22263 opened by serhiy.storchaka #22264: Add wsgiref.util helpers for dealing with "WSGI strings" http://bugs.python.org/issue22264 opened by ncoghlan #22268: mrohasattr and mrogetattr http://bugs.python.org/issue22268 opened by Gregory.Salvan #22269: Resolve distutils option conflicts with priorities http://bugs.python.org/issue22269 opened by minrk #22270: cache version selection for documentation http://bugs.python.org/issue22270 opened by thejj #22271: Deprecate PyUnicode_AsUnicode(): emit a DeprecationWarning http://bugs.python.org/issue22271 opened by haypo #22273: abort when passing certain structs by value using ctypes http://bugs.python.org/issue22273 opened by weeble #22274: subprocess.Popen(stderr=STDOUT) fails to redirect subprocess s http://bugs.python.org/issue22274 opened by akira #22275: asyncio: enhance documentation of OS support http://bugs.python.org/issue22275 opened by haypo #22276: pathlib glob issues http://bugs.python.org/issue22276 opened by joca.bt #22277: webbrowser.py add parameters to suppress output on stdout and http://bugs.python.org/issue22277 opened by CristianCantoro #22278: urljoin duplicate slashes http://bugs.python.org/issue22278 opened by demian.brecht #22279: read() vs read1() in asyncio.StreamReader documentation http://bugs.python.org/issue22279 opened by oconnor663 #22281: ProcessPoolExecutor/ThreadPoolExecutor should provide introspe http://bugs.python.org/issue22281 opened by dan.oreilly #22282: ipaddress module accepts octal formatted IPv4 addresses in IPv http://bugs.python.org/issue22282 opened by xZise #22283: "AMD64 FreeBSD 9.0 3.x" fails to build the _decimal module: #e http://bugs.python.org/issue22283 opened by haypo #22284: decimal module contains less symbols when the _decimal module http://bugs.python.org/issue22284 opened by haypo #22285: The Modules/ directory should not be added to sys.path http://bugs.python.org/issue22285 opened by haypo #22286: Allow backslashreplace error handler to be used on input http://bugs.python.org/issue22286 opened by ncoghlan #22289: support.transient_internet() doesn't catch timeout on FTP test http://bugs.python.org/issue22289 opened by haypo #22290: "AMD64 OpenIndiana 3.x" buildbot: assertion failed in PyObject http://bugs.python.org/issue22290 opened by haypo #22292: pickle whichmodule RuntimeError http://bugs.python.org/issue22292 opened by attilio.dinisio #22293: unittest.mock: use slots in MagicMock to reduce memory footpri http://bugs.python.org/issue22293 opened by james-w #22294: 2to3 consuming_calls: len, min, max, zip, map, reduce, filter http://bugs.python.org/issue22294 opened by eddygeek #22295: Clarify available commands for package installation http://bugs.python.org/issue22295 opened by ncoghlan #22296: cookielib uses time.time(), making incorrect checks of expirat http://bugs.python.org/issue22296 opened by regu0004 #22297: 2.7 json encoding broken for enums http://bugs.python.org/issue22297 opened by eddygeek #22298: Lib/warnings.py _show_warning does not protect against being c http://bugs.python.org/issue22298 opened by Julius.Lehmann-Richter #22299: resolve() on Windows makes some pathological paths unusable http://bugs.python.org/issue22299 opened by Kevin.Norris #22300: PEP 446 What's New Updates for 2.7.9 http://bugs.python.org/issue22300 opened by ncoghlan Most recent 15 issues with no replies (15) ========================================== #22300: PEP 446 What's New Updates for 2.7.9 http://bugs.python.org/issue22300 #22298: Lib/warnings.py _show_warning does not protect against being c http://bugs.python.org/issue22298 #22297: 2.7 json encoding broken for enums http://bugs.python.org/issue22297 #22296: cookielib uses time.time(), making incorrect checks of expirat http://bugs.python.org/issue22296 #22294: 2to3 consuming_calls: len, min, max, zip, map, reduce, filter http://bugs.python.org/issue22294 #22289: support.transient_internet() doesn't catch timeout on FTP test http://bugs.python.org/issue22289 #22286: Allow backslashreplace error handler to be used on input http://bugs.python.org/issue22286 #22278: urljoin duplicate slashes http://bugs.python.org/issue22278 #22275: asyncio: enhance documentation of OS support http://bugs.python.org/issue22275 #22271: Deprecate PyUnicode_AsUnicode(): emit a DeprecationWarning http://bugs.python.org/issue22271 #22268: mrohasattr and mrogetattr http://bugs.python.org/issue22268 #22255: Multiprocessing freeze_support raises RuntimeError http://bugs.python.org/issue22255 #22251: Various markup errors in documentation http://bugs.python.org/issue22251 #22249: Possibly incorrect example is given for socket.getaddrinfo() http://bugs.python.org/issue22249 #22246: add strptime(s, '%s') http://bugs.python.org/issue22246 Most recent 15 issues waiting for review (15) ============================================= #22300: PEP 446 What's New Updates for 2.7.9 http://bugs.python.org/issue22300 #22294: 2to3 consuming_calls: len, min, max, zip, map, reduce, filter http://bugs.python.org/issue22294 #22292: pickle whichmodule RuntimeError http://bugs.python.org/issue22292 #22289: support.transient_internet() doesn't catch timeout on FTP test http://bugs.python.org/issue22289 #22285: The Modules/ directory should not be added to sys.path http://bugs.python.org/issue22285 #22282: ipaddress module accepts octal formatted IPv4 addresses in IPv http://bugs.python.org/issue22282 #22281: ProcessPoolExecutor/ThreadPoolExecutor should provide introspe http://bugs.python.org/issue22281 #22278: urljoin duplicate slashes http://bugs.python.org/issue22278 #22277: webbrowser.py add parameters to suppress output on stdout and http://bugs.python.org/issue22277 #22275: asyncio: enhance documentation of OS support http://bugs.python.org/issue22275 #22274: subprocess.Popen(stderr=STDOUT) fails to redirect subprocess s http://bugs.python.org/issue22274 #22269: Resolve distutils option conflicts with priorities http://bugs.python.org/issue22269 #22268: mrohasattr and mrogetattr http://bugs.python.org/issue22268 #22261: Document how to use Concurrent Build when using MsBuild http://bugs.python.org/issue22261 #22260: Rearrange tkinter tests, use test discovery http://bugs.python.org/issue22260 Top 10 most discussed issues (10) ================================= #18814: Add tools for "cleaning" surrogate escaped strings http://bugs.python.org/issue18814 15 msgs #22232: str.splitlines splitting on non-\r\n characters http://bugs.python.org/issue22232 13 msgs #22264: Add wsgiref.util helpers for dealing with "WSGI strings" http://bugs.python.org/issue22264 10 msgs #22194: access to cdecimal / libmpdec API http://bugs.python.org/issue22194 9 msgs #22277: webbrowser.py add parameters to suppress output on stdout and http://bugs.python.org/issue22277 9 msgs #22240: argparse support for "python -m module" in help http://bugs.python.org/issue22240 8 msgs #22261: Document how to use Concurrent Build when using MsBuild http://bugs.python.org/issue22261 8 msgs #22279: read() vs read1() in asyncio.StreamReader documentation http://bugs.python.org/issue22279 7 msgs #22285: The Modules/ directory should not be added to sys.path http://bugs.python.org/issue22285 7 msgs #21720: "TypeError: Item in ``from list'' not a string" message http://bugs.python.org/issue21720 6 msgs Issues closed (31) ================== #2527: Pass a namespace to timeit http://bugs.python.org/issue2527 closed by pitrou #6550: asyncore incorrect failure when connection is refused and usin http://bugs.python.org/issue6550 closed by haypo #11267: asyncore does not check for POLLERR and POLLHUP if neither rea http://bugs.python.org/issue11267 closed by haypo #16808: inspect.stack() should return list of named tuples http://bugs.python.org/issue16808 closed by pitrou #18530: posixpath.ismount performs extra lstat calls http://bugs.python.org/issue18530 closed by alex #19447: py_compile.compile raises if a file has bad encoding http://bugs.python.org/issue19447 closed by berker.peksag #20745: test_statistics fails in refleak mode http://bugs.python.org/issue20745 closed by zach.ware #20996: Backport TLS 1.1 and 1.2 support for ssl_version http://bugs.python.org/issue20996 closed by alex #21305: PEP 466: update os.urandom http://bugs.python.org/issue21305 closed by python-dev #22034: posixpath.join() and bytearray http://bugs.python.org/issue22034 closed by serhiy.storchaka #22042: signal.set_wakeup_fd(fd): raise an exception if the fd is in b http://bugs.python.org/issue22042 closed by haypo #22059: incorrect type conversion from str to bytes in asynchat module http://bugs.python.org/issue22059 closed by r.david.murray #22090: Decimal and float formatting treat '%' differently for infinit http://bugs.python.org/issue22090 closed by skrah #22182: distutils.file_util.move_file unpacks wrongly an exception http://bugs.python.org/issue22182 closed by berker.peksag #22199: 2.7 sysconfig._get_makefile_filename should be sysconfig.get_m http://bugs.python.org/issue22199 closed by ned.deily #22236: Do not use _default_root in Tkinter tests http://bugs.python.org/issue22236 closed by serhiy.storchaka #22239: asyncio: nested event loop http://bugs.python.org/issue22239 closed by gvanrossum #22243: Documentation on try statement incorrectly implies target of e http://bugs.python.org/issue22243 closed by terry.reedy #22244: load_verify_locations fails to handle unicode paths on Python http://bugs.python.org/issue22244 closed by python-dev #22250: unittest lowercase methods http://bugs.python.org/issue22250 closed by ezio.melotti #22254: match object generated by re.finditer cannot call groups() on http://bugs.python.org/issue22254 closed by leiju #22259: fdopen of directory causes segmentation fault http://bugs.python.org/issue22259 closed by python-dev #22262: Python External Libraries are stored in directory above where http://bugs.python.org/issue22262 closed by zach.ware #22265: fix reliance on refcounting in test_itertools http://bugs.python.org/issue22265 closed by python-dev #22266: fix reliance on refcounting in tarfile.gzopen http://bugs.python.org/issue22266 closed by python-dev #22267: fix reliance on refcounting in test_weakref http://bugs.python.org/issue22267 closed by python-dev #22272: sqlite3 memory leaks in cursor.execute http://bugs.python.org/issue22272 closed by haypo #22280: _decimal: successful import despite build failure http://bugs.python.org/issue22280 closed by skrah #22287: Use clock_gettime() in pytime.c http://bugs.python.org/issue22287 closed by haypo #22288: Incorrect Call grammar in documentation http://bugs.python.org/issue22288 closed by mjpieters #22291: Typo in docs - Lib/random http://bugs.python.org/issue22291 closed by r.david.murray

1 0

Bytes path related questions for Guido
by Nick Coghlan Aug. 29, 2014

Aug. 29, 2014

At Guido's request, splitting out two specific questions from Serhiy's thread where I believe we could do with an explicit "yes or no" from him. 1. Should we accept patches adding support for the direct use of bytes paths in lower level filesystem manipulation APIs? (i.e. everything that isn't pathlib) This was Serhiy's original question (due to some open issues [1,2]). I think the answer is yes, as we already do in some cases, and the "pathlib doesn't support binary paths" design decision is a high level platform independent API vs low level potentially platform dependent API one rather than being about disallowing the use of bytes paths in general. [1] http://bugs.python.org/issue19997 [2] http://bugs.python.org/issue20797 2. Should we add some additional helpers to the string module for dealing with surrogate escaped bytes and other techniques for smuggling arbitrary binary data as text? My proposal [3] is to add: * string.escaped_surrogates (constant with the 128 escaped code points) * string.clean(s): replaces surrogates with '\ufffd' or another specified code point * string.redecode(s, encoding): encodes a string back to bytes and then decodes it again using the specified encoding (the old encoding defaults to 'latin-1' to match the assumptions in WSGI) "s != string.clean(s)" would then serve as a check for "does this string contain any surrogate escaped bytes?" [3] http://bugs.python.org/issue18814#msg225791 Regards, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

8 17

Windows Unicode console support [Was: Bytes path support]
by Paul Moore Aug. 28, 2014

Aug. 28, 2014

On 24 August 2014 04:27, Nick Coghlan <ncoghlan(a)gmail.com> wrote: > One of those areas is the fact that we still use the old 8-bit APIs to > interact with the Windows console. Those are just as broken in a > multilingual world as the other Windows 8-bit APIs, so Drekin came up > with a project to expose the Windows console as a UTF-16-LE stream > that uses the 16-bit APIs instead: > https://pypi.python.org/pypi/win_unicode_console > > I personally hope we'll be able to get the issues Drekin references > there resolved for Python 3.5 - if other folks hope for the same > thing, then one of the best ways to help that happen is to try out the > win_unicode_console module and provide feedback on what does and > doesn't work. This looks very cool, and I plan on giving it a try. But I don't see any issues mentioned there (unless you mean the fact that it's not possible to hook into Python's interactive interpreter directly, but I don't see how that could be fixed in an external module). There's no open issues on the project's github tracker. I'd love to see this go into 3.5, so any more specific suggestions as to what would be needed to move it forwards would be great. Paul

2 3

Bytes path support
by Serhiy Storchaka Aug. 28, 2014

Aug. 28, 2014

Builting open(), io classes, os and os.path functions and some other functions in the stdlib support bytes paths as well as str paths. But many functions doesn't. There are requests about adding this support ([1], [2]) in some modules. It is easy (just call os.fsdecode() on argument) but I'm not sure it is worth to do. Pathlib doesn't support bytes path and it looks intentional. What is general policy about support of bytes path in the stdlib? [1] http://bugs.python.org/issue19997 [2] http://bugs.python.org/issue20797

26 107

pip enhancement
by Neal Becker Aug. 27, 2014

Aug. 27, 2014

On systems where os-level packaging is available (e.g., fedora linux), it is not unusual to want a newer python package installed than available from the vendor. pip install --user can be used for this. But then there is the danger that these pip installed packages are not maintained. At least, pip should have the ability to alert the user to potential updates, pip update could list which packages need updating, and offer to perform the update. I think this would go a long way to helping with this problem. -- -- Those who don't understand recursion are doomed to repeat it

4 7

Fwd: Accepting PEP 440: Version Identification and Dependency Specification
by Nick Coghlan Aug. 26, 2014

Aug. 26, 2014

Antoine pointed out that it would still be a good idea to forward packaging PEP acceptance announcements to python-dev, even when the actual acceptance happens on distutils-sig. That makes sense to me, so here's last week's notice of the acceptance of PEP 440, the implementation independent versioning standard derived from pkg_resources, PEP 386, and ideas from both Linux distributions and other open source language communities. Regards, Nick. ---------- Forwarded message ---------- From: Nick Coghlan <ncoghlan(a)gmail.com> Date: 22 August 2014 22:34 Subject: Accepting PEP 440: Version Identification and Dependency Specification To: DistUtils mailing list <distutils-sig(a)python.org> I just pushed Donald's final round of edits in response to the feedback on the last PEP 440 thread, and as such I'm happy to announce that I am accepting PEP 440 as the recommended approach to identifying versions and specifying dependencies when distributing Python software. The PEP is available in the usual place at http://www.python.org/dev/peps/pep-0440/ It's been a long road to get to an implementation independent versioning standard that has a feasible migration path from the current pkg_resources defined de facto standard, and I'd like to thank a few folks: * Donald Stufft for his extensive work on PEP 440 itself, especially the proof of concept integration into pip * Vinay Sajip for his efforts in validating earlier versions of the PEP * Tarek Ziadé for starting us down the road to an implementation independent versioning standard with the initial creation of PEP 386 back in June 2009, more than five years ago! Regards, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

1 0

Summary of Python tracker Issues
by Python tracker Aug. 22, 2014

Aug. 22, 2014

ACTIVITY SUMMARY (2014-08-15 - 2014-08-22) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4621 (+19) closed 29399 (+28) total 34020 (+47) Open issues with patches: 2179 Issues opened (41) ================== #22207: Test for integer overflow on Py_ssize_t: explicitly cast to si http://bugs.python.org/issue22207 opened by haypo #22208: tarfile can't add in memory files (reopened) http://bugs.python.org/issue22208 opened by markgrandi #22209: Idle: add better access to extension information http://bugs.python.org/issue22209 opened by terry.reedy #22210: pdb-run-restarting-a-pdb-session http://bugs.python.org/issue22210 opened by zhengxiexie #22211: Remove VMS specific code in expat.h & xmlrole.h http://bugs.python.org/issue22211 opened by John.Malmberg #22212: zipfile.py fails if zlib.so module fails to build. http://bugs.python.org/issue22212 opened by John.Malmberg #22213: pyvenv style virtual environments unusable in an embedded syst http://bugs.python.org/issue22213 opened by grahamd #22214: Tkinter: Don't stringify callbacks arguments http://bugs.python.org/issue22214 opened by serhiy.storchaka #22215: "embedded NUL character" exceptions http://bugs.python.org/issue22215 opened by serhiy.storchaka #22216: smtplip STARTTLS fails at second attampt due to unsufficiant q http://bugs.python.org/issue22216 opened by zvyn #22217: Reprs for zipfile classes http://bugs.python.org/issue22217 opened by serhiy.storchaka #22218: Fix more compiler warnings "comparison between signed and unsi http://bugs.python.org/issue22218 opened by haypo #22219: python -mzipfile fails to add empty folders to created zip http://bugs.python.org/issue22219 opened by Antony.Lee #22220: Ttk extensions test failure http://bugs.python.org/issue22220 opened by serhiy.storchaka #22221: ast.literal_eval confused by coding declarations http://bugs.python.org/issue22221 opened by jorgenschaefer #22222: dtoa.c: remove custom memory allocator http://bugs.python.org/issue22222 opened by haypo #22223: argparse not including '--' arguments in previous optional REM http://bugs.python.org/issue22223 opened by Jurko.Gospodnetić #22225: Add SQLite support to http.cookiejar http://bugs.python.org/issue22225 opened by demian.brecht #22226: Refactor dict result handling in Tkinter http://bugs.python.org/issue22226 opened by serhiy.storchaka #22227: Simplify tarfile iterator http://bugs.python.org/issue22227 opened by serhiy.storchaka #22228: Adapt bash readline operate-and-get-next function http://bugs.python.org/issue22228 opened by lelit #22229: wsgiref doesn't appear to ever set REMOTE_HOST in the environ http://bugs.python.org/issue22229 opened by alex #22231: httplib: unicode url will cause an ascii codec error when comb http://bugs.python.org/issue22231 opened by Bob.Chen #22232: str.splitlines splitting on none-\r\n characters http://bugs.python.org/issue22232 opened by scharron #22233: http.client splits headers on none-\r\n characters http://bugs.python.org/issue22233 opened by scharron #22234: urllib.parse.urlparse accepts any falsy value as an url http://bugs.python.org/issue22234 opened by Ztane #22235: httplib: TypeError with file() object in ssl.py http://bugs.python.org/issue22235 opened by erob #22236: Do not use _default_root in Tkinter tests http://bugs.python.org/issue22236 opened by serhiy.storchaka #22237: sorted() docs should state that the sort is stable http://bugs.python.org/issue22237 opened by Wilfred.Hughes #22239: asyncio: nested event loop http://bugs.python.org/issue22239 opened by djarb #22240: argparse support for "python -m module" in help http://bugs.python.org/issue22240 opened by tebeka #22241: strftime/strptime round trip fails even for UTC datetime objec http://bugs.python.org/issue22241 opened by akira #22242: Doc fix in the Import section in language reference. http://bugs.python.org/issue22242 opened by jon.poler #22243: Documentation on try statement incorrectly implies target of e http://bugs.python.org/issue22243 opened by mwilliamson #22244: load_verify_locations fails to handle unicode paths on Python http://bugs.python.org/issue22244 opened by alex #22246: add strptime(s, '%s') http://bugs.python.org/issue22246 opened by akira #22247: More incomplete module.__all__ lists http://bugs.python.org/issue22247 opened by vadmium #22248: urllib.request.urlopen raises exception when 30X-redirect url http://bugs.python.org/issue22248 opened by tomasgroth #22249: Possibly incorrect example is given for socket.getaddrinfo() http://bugs.python.org/issue22249 opened by Alexander.Patrakov #22250: unittest lowercase methods http://bugs.python.org/issue22250 opened by simonzack #22251: Various markup errors in documentation http://bugs.python.org/issue22251 opened by berker.peksag Most recent 15 issues with no replies (15) ========================================== #22251: Various markup errors in documentation http://bugs.python.org/issue22251 #22250: unittest lowercase methods http://bugs.python.org/issue22250 #22249: Possibly incorrect example is given for socket.getaddrinfo() http://bugs.python.org/issue22249 #22246: add strptime(s, '%s') http://bugs.python.org/issue22246 #22244: load_verify_locations fails to handle unicode paths on Python http://bugs.python.org/issue22244 #22242: Doc fix in the Import section in language reference. http://bugs.python.org/issue22242 #22239: asyncio: nested event loop http://bugs.python.org/issue22239 #22234: urllib.parse.urlparse accepts any falsy value as an url http://bugs.python.org/issue22234 #22231: httplib: unicode url will cause an ascii codec error when comb http://bugs.python.org/issue22231 #22229: wsgiref doesn't appear to ever set REMOTE_HOST in the environ http://bugs.python.org/issue22229 #22227: Simplify tarfile iterator http://bugs.python.org/issue22227 #22225: Add SQLite support to http.cookiejar http://bugs.python.org/issue22225 #22216: smtplip STARTTLS fails at second attampt due to unsufficiant q http://bugs.python.org/issue22216 #22212: zipfile.py fails if zlib.so module fails to build. http://bugs.python.org/issue22212 #22211: Remove VMS specific code in expat.h & xmlrole.h http://bugs.python.org/issue22211 Most recent 15 issues waiting for review (15) ============================================= #22251: Various markup errors in documentation http://bugs.python.org/issue22251 #22246: add strptime(s, '%s') http://bugs.python.org/issue22246 #22242: Doc fix in the Import section in language reference. http://bugs.python.org/issue22242 #22240: argparse support for "python -m module" in help http://bugs.python.org/issue22240 #22236: Do not use _default_root in Tkinter tests http://bugs.python.org/issue22236 #22228: Adapt bash readline operate-and-get-next function http://bugs.python.org/issue22228 #22227: Simplify tarfile iterator http://bugs.python.org/issue22227 #22226: Refactor dict result handling in Tkinter http://bugs.python.org/issue22226 #22222: dtoa.c: remove custom memory allocator http://bugs.python.org/issue22222 #22219: python -mzipfile fails to add empty folders to created zip http://bugs.python.org/issue22219 #22218: Fix more compiler warnings "comparison between signed and unsi http://bugs.python.org/issue22218 #22217: Reprs for zipfile classes http://bugs.python.org/issue22217 #22216: smtplip STARTTLS fails at second attampt due to unsufficiant q http://bugs.python.org/issue22216 #22215: "embedded NUL character" exceptions http://bugs.python.org/issue22215 #22214: Tkinter: Don't stringify callbacks arguments http://bugs.python.org/issue22214 Top 10 most discussed issues (10) ================================= #17535: IDLE: Add an option to show line numbers along the left side o http://bugs.python.org/issue17535 9 msgs #22208: tarfile can't add in memory files (reopened) http://bugs.python.org/issue22208 8 msgs #2527: Pass a namespace to timeit http://bugs.python.org/issue2527 6 msgs #22195: Make it easy to replace print() calls with logging calls http://bugs.python.org/issue22195 6 msgs #22241: strftime/strptime round trip fails even for UTC datetime objec http://bugs.python.org/issue22241 6 msgs #22194: access to cdecimal / libmpdec API http://bugs.python.org/issue22194 5 msgs #22198: Odd floor-division corner case http://bugs.python.org/issue22198 5 msgs #22218: Fix more compiler warnings "comparison between signed and unsi http://bugs.python.org/issue22218 5 msgs #20152: Derby #15: Convert 50 sites to Argument Clinic across 9 files http://bugs.python.org/issue20152 4 msgs #20184: Derby #16: Convert 50 sites to Argument Clinic across 9 files http://bugs.python.org/issue20184 4 msgs Issues closed (27) ================== #7283: test_site failure when .local/lib/pythonX.Y/site-packages hasn http://bugs.python.org/issue7283 closed by ned.deily #15696: Correct __sizeof__ support for mmap http://bugs.python.org/issue15696 closed by serhiy.storchaka #16599: unittest: Access test result from tearDown http://bugs.python.org/issue16599 closed by Claudiu.Popa #19628: maxlevels -1 on compileall for unlimited recursion http://bugs.python.org/issue19628 closed by python-dev #19714: Add tests for importlib.machinery.WindowsRegistryFinder http://bugs.python.org/issue19714 closed by brett.cannon #19997: imghdr.what doesn't accept bytes paths http://bugs.python.org/issue19997 closed by serhiy.storchaka #20797: zipfile.extractall should accept bytes path as parameter http://bugs.python.org/issue20797 closed by serhiy.storchaka #21308: PEP 466: backport ssl changes http://bugs.python.org/issue21308 closed by python-dev #21389: The repr of BoundMethod objects sometimes incorrectly identifi http://bugs.python.org/issue21389 closed by python-dev #21549: Add the members parameter for TarFile.list() http://bugs.python.org/issue21549 closed by serhiy.storchaka #22016: Add a new 'surrogatereplace' output only error handler http://bugs.python.org/issue22016 closed by ncoghlan #22068: tkinter: avoid reference loops with Variables and Fonts http://bugs.python.org/issue22068 closed by serhiy.storchaka #22118: urljoin fails with messy relative URLs http://bugs.python.org/issue22118 closed by pitrou #22150: deprecated-removed directive is broken in Sphinx 1.2.2 http://bugs.python.org/issue22150 closed by berker.peksag #22156: Fix compiler warnings "comparison between signed and unsigned http://bugs.python.org/issue22156 closed by haypo #22157: _ctypes on ppc64: libffi/src/powerpc/linux64.o: ABI version 1 http://bugs.python.org/issue22157 closed by doko #22165: Empty response from http.server when directory listing contain http://bugs.python.org/issue22165 closed by serhiy.storchaka #22188: test_gdb fails on invalid gdbinit http://bugs.python.org/issue22188 closed by python-dev #22191: warnings.__all__ incomplete http://bugs.python.org/issue22191 closed by brett.cannon #22200: Remove distutils checks for Python version http://bugs.python.org/issue22200 closed by python-dev #22201: python -mzipfile fails to unzip files with folders created by http://bugs.python.org/issue22201 closed by serhiy.storchaka #22205: debugmallocstats test is cpython only http://bugs.python.org/issue22205 closed by python-dev #22206: PyThread_create_key(): fix comparison between signed and unsig http://bugs.python.org/issue22206 closed by haypo #22224: docs.python.org is prone to political blocking in Russia http://bugs.python.org/issue22224 closed by georg.brandl #22230: 'python -mzipfile -c' does not zip empty directories http://bugs.python.org/issue22230 closed by serhiy.storchaka #22238: fractions.gcd results in infinite loop when nan or inf given a http://bugs.python.org/issue22238 closed by mark.dickinson #22245: test_urllib2_localnet prints out error messages http://bugs.python.org/issue22245 closed by orsenthil

1 0

PEP 4000 to explicitly declare we won't be doing a Py3k style compatibility break again?
by Nick Coghlan Aug. 21, 2014

Aug. 21, 2014

I've seen a few people on python-ideas express the assumption that there will be another Py3k style compatibility break for Python 4.0. I've also had people express the concern that "you broke compatibility in a major way once, how do we know you won't do it again?". Both of those contrast strongly with Guido's stated position that he never wants to go through a transition like the 2->3 one again. Barry wrote PEP 404 to make it completely explicit that python-dev had no plans to create a Python 2.8 release. Would it be worth writing a similarly explicit "not an option" PEP explaining that the regular deprecation and removal process (roughly documented in PEP 387) is the *only* deprecation and removal process? It could also point to the fact that we now have PEP 411 (provisional APIs) to help reduce our chances of being locked indefinitely into design decisions we aren't happy with. If folks (most signficantly, Guido) are amenable to the idea, it shouldn't take long to put such a PEP together, and I think it could help reduce some of the confusions around the expectations for Python 4.0 and the evolution of 3.x in general. Regards, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

12 19

Fwd: PEP 467: Minor API improvements for bytes & bytearray
by Ian Cordasco Aug. 19, 2014

Aug. 19, 2014

On Aug 17, 2014 12:17 PM, "Donald Stufft" <donald(a)stufft.io> wrote: >> On Aug 17, 2014, at 1:07 PM, Raymond Hettinger <raymond.hettinger(a)gmail.com> wrote: >> >> >> On Aug 17, 2014, at 1:41 AM, Nick Coghlan <ncoghlan(a)gmail.com> wrote: >> >>> If I see "bytearray(10)" there is nothing there that suggests "this >>> creates an array of length 10 and initialises it to zero" to me. I'd >>> be more inclined to guess it would be equivalent to "bytearray([10])". >>> >>> "bytearray.zeros(10)", on the other hand, is relatively clear, >>> independently of user expectations. >> >> >> Zeros would have been great but that should have been done originally. >> The time to get API design right is at inception. >> Now, you're just breaking code and invalidating any published examples. >> >>>> >>>> Another thought is that the core devs should be very reluctant to deprecate >>>> anything we don't have to while the 2 to 3 transition is still in progress. >>>> Every new deprecation of APIs that existed in Python 2.7 just adds another >>>> obstacle to converting code. Individually, the differences are trivial. >>>> Collectively, they present a good reason to never migrate code to Python 3. >>> >>> >>> This is actually one of the inconsistencies between the Python 2 and 3 >>> binary APIs: >> >> >> However, bytearray(n) is the same in both Python 2 and Python 3. >> Changing it in Python 3 increases the gulf between the two. >> >> The further we let Python 3 diverge from Python 2, the less likely that >> people will convert their code and the harder you make it to write code >> that runs under both. >> >> FWIW, I've been teaching Python full time for three years. I cover the >> use of bytearray(n) in my classes and not a single person out of 3000+ >> engineers have had a problem with it. I seriously question the PEP's >> assertion that there is a real problem to be solved (i.e. that people >> are baffled by bytearray(bufsiz)) and that the problem is sufficiently >> painful to warrant the headaches that go along with API changes. >> >> The other proposal to add bytearray.byte(3) should probably be named >> bytearray.from_byte(3) for clarity. That said, I question whether there is >> actually a use case for this. I have never seen seen code that has a >> need to create a byte array of length one from a single integer. >> For the most part, the API will be easiest to learn if it matches what >> we do for lists and for array.array. >> >> Sorry Nick, but I think you're making the API worse instead of better. >> This API isn't perfect but it isn't flat-out broken either. There is some >> unfortunate asymmetry between bytes() and bytearray() in Python 2, >> but that ship has sailed. The current API for Python 3 is pretty good >> (though there is still a tension between wanting to be like lists and like >> strings both at the same time). >> >> >> Raymond >> >> >> P.S. The most important problem in the Python world now is getting >> Python 2 users to adopt Python 3. The core devs need to develop >> a strong distaste for anything that makes that problem harder. >> > > For the record I’ve had all of the problems that Nick states and I’m > +1 on this change. I've run into these problems as well, but I'm swayed by Raymond's argument regarding bytearray's constructor. I wouldn't be adverse to adding zeroes (for some parity between bytes and bytearray) to that but I'm not sure deprecating te behaviour of bytearray's constructor is necessary. (Whilst on my phone I only replied to Donald, so I'm forwarding this to the list.)

10 18