Mailman 3 September 2014 - Python-Dev

List insert at index that is well out of range - behaves like append
by Harish Tech Sept. 15, 2014

Sept. 15, 2014

I had a list a = [1, 2, 3] when I did a.insert(100, 100) [1, 2, 3, 100] as list was originally of size 4 and I was trying to insert value at index 100 , it behaved like append instead of throwing any errors as I was trying to insert in an index that did not even existed . Should it not throw IndexError: list assignment index out of range exception as it throws when I attempt doing a[100] = 100 Question : 1. Any idea Why has it been designed to silently handle this instead of informing the user with an exception ? Personal Opinion : Lets see how other dynamic languages behave in such a situation : Ruby : > a = [1, 2] > a[100] = 100 > a => [1, 2, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, nil, 100] The way ruby handles this is pretty clear and sounds meaningful (and this is how I expected to behave and it behaved as per my expectation) at least to me . So what I felt was either it should throw exception or do the way ruby handles it . Is ruby way of handling not the obvious way ? I even raised it in stackoverflow http://stackoverflow.com/questions/25840177/list-insert-at-index-that-is-we… and got some responses .

7 8

namedtuples bug between 3.3.2 and 3.4.1
by Brynjar Smári Bjarnason Sept. 15, 2014

Sept. 15, 2014

Hi. I am using Python 3.4.1 installed with Anaconda. I tried the following (expecting an OrderedDict as result): >>>from collections import namedtuple >>>NT = namedtuple("NT",["a","b"]) >>>nt = NT(1,2) >>>print(vars(nt)) {} so the result is an empty dict. In Python 3.3.2 (downgraded in the same Anaconda environment) results in: >>>print(vars(nt)) OrderedDict([('a', 1), ('b', 2)]) I haven't looked at the source code, I can do that later in the week and see if I can pinpoint where this is happening. But any suggestions what and where to fix this would be good :) Cheers, Brynjar

4 3

new hg.python.org server
by Benjamin Peterson Sept. 13, 2014

Sept. 13, 2014

I just switched hg.python.org from a OSUOSL VM to a Rackspace VM. The new VM is a bit beefier and has what I think is better network connectivity, so hopefully that will improving the speed of repository operations. We also now support HTTPS for repository browsing and cloning, so update all your links to https://hg.python.org! IPv6 support has also returned for those who like that sort of thing. Note the host keys changed, so you'll probably have to futz with known_hosts to quiet ssh down. I apologize, but I noticed that that the current RSA host key is 1024 bits, so I decided to upgrade it to 2048 during the transition. Thanks to Donald Stufft for helping me set this up.

3 3

Summary of Python tracker Issues
by Python tracker Sept. 12, 2014

Sept. 12, 2014

ACTIVITY SUMMARY (2014-09-05 - 2014-09-12) Python tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 4652 (+12) closed 29509 (+38) total 34161 (+50) Open issues with patches: 2196 Issues opened (39) ================== #16662: load_tests not invoked in package/__init__.py http://bugs.python.org/issue16662 reopened by haypo #22343: Install bash activate script on Windows when using venv http://bugs.python.org/issue22343 opened by marfire #22344: Reorganize unittest.mock docs into linear manner http://bugs.python.org/issue22344 opened by py.user #22347: mimetypes.guess_type("//example.com") misinterprets host name http://bugs.python.org/issue22347 opened by vadmium #22348: Documentation of asyncio.StreamWriter.drain() http://bugs.python.org/issue22348 opened by martius #22350: nntplib file write failure causes exception from QUIT command http://bugs.python.org/issue22350 opened by vadmium #22351: NNTP constructor exception leaves socket for garbage collector http://bugs.python.org/issue22351 opened by vadmium #22352: Ensure opcode names and args fit in disassembly output http://bugs.python.org/issue22352 opened by ncoghlan #22354: Highlite tabs in the IDLE http://bugs.python.org/issue22354 opened by Christian.Kleineidam #22355: inconsistent results with inspect.getsource() / inspect.getsou http://bugs.python.org/issue22355 opened by isedev #22356: mention explicitly that stdlib assumes gmtime(0) epoch is 1970 http://bugs.python.org/issue22356 opened by akira #22357: inspect module documentation makes no reference to __qualname_ http://bugs.python.org/issue22357 opened by isedev #22359: Remove incorrect uses of recursive make http://bugs.python.org/issue22359 opened by Sjlver #22360: Adding manually offset parameter to str/bytes split function http://bugs.python.org/issue22360 opened by cwr #22361: Ability to join() threads in concurrent.futures.ThreadPoolExec http://bugs.python.org/issue22361 opened by dktrkranz #22362: Warn about octal escapes > 0o377 in re http://bugs.python.org/issue22362 opened by serhiy.storchaka #22363: argparse AssertionError with add_mutually_exclusive_group and http://bugs.python.org/issue22363 opened by Zacrath #22364: Unify error messages of re and regex http://bugs.python.org/issue22364 opened by serhiy.storchaka #22365: SSLContext.load_verify_locations(cadata) does not accept CRLs http://bugs.python.org/issue22365 opened by Ralph.Broenink #22366: urllib.request.urlopen shoudl take a "context" (SSLContext) ar http://bugs.python.org/issue22366 opened by alex #22367: Please add F_OFD_SETLK, etc support to fcntl.lockf http://bugs.python.org/issue22367 opened by Andrew.Lutomirski #22370: pathlib OS detection http://bugs.python.org/issue22370 opened by Antony.Lee #22371: tests failing with -uall and http_proxy and https_proxy set http://bugs.python.org/issue22371 opened by doko #22374: Replace contextmanager example and improve explanation http://bugs.python.org/issue22374 opened by terry.reedy #22376: urllib2.urlopen().read().splitlines() opening a directory in a http://bugs.python.org/issue22376 opened by alanoe #22377: %Z in strptime doesn't match EST and others http://bugs.python.org/issue22377 opened by cool-RR #22378: SO_MARK support for Linux http://bugs.python.org/issue22378 opened by jpv #22379: Empty exception message of str.join http://bugs.python.org/issue22379 opened by fossilet #22382: sqlite3 connection built from apsw connection should raise Int http://bugs.python.org/issue22382 opened by wtonkin #22384: Tk.report_callback_exception kills process when run with pytho http://bugs.python.org/issue22384 opened by Aivar.Annamaa #22385: Allow 'x' and 'X' to accept bytes-like objects in string forma http://bugs.python.org/issue22385 opened by ncoghlan #22387: Making tempfile.NamedTemporaryFile a class http://bugs.python.org/issue22387 opened by Antony.Lee #22388: Unify style of "Contributed by" notes http://bugs.python.org/issue22388 opened by serhiy.storchaka #22389: Generalize contextlib.redirect_stdout http://bugs.python.org/issue22389 opened by barry #22390: test.regrtest should complain if a test doesn't remove tempora http://bugs.python.org/issue22390 opened by haypo #22391: MSILIB truncates last character in summary information stream http://bugs.python.org/issue22391 opened by Kevin.Phillips #22392: Clarify documentation of __getinitargs__ http://bugs.python.org/issue22392 opened by David.Gilman #22393: multiprocessing.Pool shouldn't hang forever if a worker proces http://bugs.python.org/issue22393 opened by dan.oreilly #22394: Update documentation building to use venv and pip http://bugs.python.org/issue22394 opened by brett.cannon Most recent 15 issues with no replies (15) ========================================== #22394: Update documentation building to use venv and pip http://bugs.python.org/issue22394 #22393: multiprocessing.Pool shouldn't hang forever if a worker proces http://bugs.python.org/issue22393 #22392: Clarify documentation of __getinitargs__ http://bugs.python.org/issue22392 #22388: Unify style of "Contributed by" notes http://bugs.python.org/issue22388 #22378: SO_MARK support for Linux http://bugs.python.org/issue22378 #22370: pathlib OS detection http://bugs.python.org/issue22370 #22367: Please add F_OFD_SETLK, etc support to fcntl.lockf http://bugs.python.org/issue22367 #22357: inspect module documentation makes no reference to __qualname_ http://bugs.python.org/issue22357 #22356: mention explicitly that stdlib assumes gmtime(0) epoch is 1970 http://bugs.python.org/issue22356 #22354: Highlite tabs in the IDLE http://bugs.python.org/issue22354 #22352: Ensure opcode names and args fit in disassembly output http://bugs.python.org/issue22352 #22351: NNTP constructor exception leaves socket for garbage collector http://bugs.python.org/issue22351 #22350: nntplib file write failure causes exception from QUIT command http://bugs.python.org/issue22350 #22347: mimetypes.guess_type("//example.com") misinterprets host name http://bugs.python.org/issue22347 #22344: Reorganize unittest.mock docs into linear manner http://bugs.python.org/issue22344 Most recent 15 issues waiting for review (15) ============================================= #22393: multiprocessing.Pool shouldn't hang forever if a worker proces http://bugs.python.org/issue22393 #22390: test.regrtest should complain if a test doesn't remove tempora http://bugs.python.org/issue22390 #22389: Generalize contextlib.redirect_stdout http://bugs.python.org/issue22389 #22388: Unify style of "Contributed by" notes http://bugs.python.org/issue22388 #22384: Tk.report_callback_exception kills process when run with pytho http://bugs.python.org/issue22384 #22379: Empty exception message of str.join http://bugs.python.org/issue22379 #22378: SO_MARK support for Linux http://bugs.python.org/issue22378 #22366: urllib.request.urlopen shoudl take a "context" (SSLContext) ar http://bugs.python.org/issue22366 #22363: argparse AssertionError with add_mutually_exclusive_group and http://bugs.python.org/issue22363 #22362: Warn about octal escapes > 0o377 in re http://bugs.python.org/issue22362 #22359: Remove incorrect uses of recursive make http://bugs.python.org/issue22359 #22356: mention explicitly that stdlib assumes gmtime(0) epoch is 1970 http://bugs.python.org/issue22356 #22348: Documentation of asyncio.StreamWriter.drain() http://bugs.python.org/issue22348 #22339: Incorrect behavior when subclassing enum.Enum http://bugs.python.org/issue22339 #22330: PyOS_mystricmp is broken http://bugs.python.org/issue22330 Top 10 most discussed issues (10) ================================= #22299: resolve() on Windows makes some pathological paths unusable http://bugs.python.org/issue22299 19 msgs #22302: Windows os.path.isabs UNC path bug http://bugs.python.org/issue22302 12 msgs #9951: introduce bytes.hex method http://bugs.python.org/issue9951 11 msgs #16662: load_tests not invoked in package/__init__.py http://bugs.python.org/issue16662 11 msgs #22166: test_codecs leaks references http://bugs.python.org/issue22166 10 msgs #21228: Missing enumeration of HTTPResponse Objects methods of urllib. http://bugs.python.org/issue21228 9 msgs #7559: TestLoader.loadTestsFromName swallows import errors http://bugs.python.org/issue7559 7 msgs #22339: Incorrect behavior when subclassing enum.Enum http://bugs.python.org/issue22339 7 msgs #22240: argparse support for "python -m module" in help http://bugs.python.org/issue22240 6 msgs #22360: Adding manually offset parameter to str/bytes split function http://bugs.python.org/issue22360 6 msgs Issues closed (37) ================== #4972: context management support in imaplib, smtplib, ftplib http://bugs.python.org/issue4972 closed by serhiy.storchaka #8315: ./python -m unittest test.test_importlib doesn't work http://bugs.python.org/issue8315 closed by berker.peksag #11487: build_installer.py should avoid relying on a young Python http://bugs.python.org/issue11487 closed by ned.deily #13968: Support recursive globs http://bugs.python.org/issue13968 closed by serhiy.storchaka #15594: test_copyfile_named_pipe() fails on Mac OS X Snow Leopard: OSE http://bugs.python.org/issue15594 closed by ned.deily #16104: Compileall script: add option to use multiple cores http://bugs.python.org/issue16104 closed by brett.cannon #19232: Speed up _decimal import http://bugs.python.org/issue19232 closed by skrah #19524: ResourceWarning when urlopen() forgets the HTTPConnection obje http://bugs.python.org/issue19524 closed by serhiy.storchaka #20417: ensurepip should not be installed with --without-ensurepip http://bugs.python.org/issue20417 closed by ncoghlan #20643: Strange dot in documentation (after generator.close) http://bugs.python.org/issue20643 closed by serhiy.storchaka #21122: CPython fails to build modules with LLVM LTO on Mac OS X http://bugs.python.org/issue21122 closed by Sjlver #21147: sqlite3 doesn't complain if the request contains a null charac http://bugs.python.org/issue21147 closed by serhiy.storchaka #21951: tcl test change crashes AIX http://bugs.python.org/issue21951 closed by haypo #22131: uuid.bytes optimization http://bugs.python.org/issue22131 closed by serhiy.storchaka #22192: dict_values objects are hashable http://bugs.python.org/issue22192 closed by roippi #22212: zipfile.py fails if zlib.so module fails to build. http://bugs.python.org/issue22212 closed by ned.deily #22215: "embedded NUL character" exceptions http://bugs.python.org/issue22215 closed by serhiy.storchaka #22226: Refactor dict result handling in Tkinter http://bugs.python.org/issue22226 closed by serhiy.storchaka #22284: decimal module contains less symbols when the _decimal module http://bugs.python.org/issue22284 closed by skrah #22285: The Modules/ directory should not be added to sys.path http://bugs.python.org/issue22285 closed by ned.deily #22295: Clarify available commands for package installation http://bugs.python.org/issue22295 closed by ncoghlan #22336: _tkinter should use Python PyMem_Malloc() instead of Tcl ckall http://bugs.python.org/issue22336 closed by python-dev #22338: test_json crash on memory allocation failure http://bugs.python.org/issue22338 closed by haypo #22340: Fix Python 3 warnings in Python 2 tests http://bugs.python.org/issue22340 closed by haypo #22342: Fix typo in PEP 380 -- Syntax for Delegating to a Subgenerator http://bugs.python.org/issue22342 closed by python-dev #22345: https://docs.python.org/release/1.4/ returns 403 http://bugs.python.org/issue22345 closed by benjamin.peterson #22346: asyncio documentation does not mention provisional status http://bugs.python.org/issue22346 closed by gvanrossum #22349: Remove more unnecessary version checks from distutils http://bugs.python.org/issue22349 closed by python-dev #22353: re.findall() documentation lacks information about finding THE http://bugs.python.org/issue22353 closed by gvanrossum #22358: Unnecessary JUMP_FORWARD(0) (NOP) in if statements without els http://bugs.python.org/issue22358 closed by serhiy.storchaka #22369: "context management protocol" vs "context manager protocol" http://bugs.python.org/issue22369 closed by serhiy.storchaka #22373: PyArray_FromAny tries to deallocate double: 12 (d) http://bugs.python.org/issue22373 closed by benjamin.peterson #22375: urllib2.urlopen().read().splitlines() opening a directory in a http://bugs.python.org/issue22375 closed by alanoe #22380: Y2K compliance section in FAQ is 14 years too old http://bugs.python.org/issue22380 closed by python-dev #22381: update zlib in 2.7 to 1.2.8 http://bugs.python.org/issue22381 closed by doko #22383: Crazy unicode : How g and ɡ look the same but are two differe http://bugs.python.org/issue22383 closed by ezio.melotti #22386: Python 3.4 logging.getLevelName() no longer maps string to lev http://bugs.python.org/issue22386 closed by python-dev

1 0

Proposed schedule for 3.4.2
by Larry Hastings Sept. 11, 2014

Sept. 11, 2014

Matthias asked me when I was going to release 3.4.2. I propose the following schedule: Tag 3.4.2rc1 Friday Sep 12 2014 Release 3.4.2rc1 Saturday Sep 13 2014 Tag 3.4.2 final Saturday Sep 27 2014 Release 3.4.2 final Sunday Sep 28 2014 Normally I want to tag on Saturdays and release on Sundays, however I propose moving rc1 a day earlier because I'll be unavailable that Sunday. Any objections? I will interpret silence as tacit approval. //arry/

11 23

recursive closure
by Li Tianqing Sept. 11, 2014

Sept. 11, 2014

Hello, Can someone explain me why gc(CPython) can not collect recursive closure's cycle reference? There is no __del__ here, why gc can not collect? Thanks a lot. For example: #!/usr/bin/env python import ipdb import gc gc.set_debug(gc.DEBUG_LEAK) def A(): N = [1] def aa(n): if n in N: return 1 else: return n * aa(n-1) x = 33 + aa(10) #ipdb.set_trace() print x if __name__ == '__main__': while xrange(1000): A() -- Best Li Tianqing

2 1

PEP 476: Enabling certificate validation by default!
by Alex Gaynor Sept. 10, 2014

Sept. 10, 2014

Hi all, I've just submitted PEP 476, on enabling certificate validation by default for HTTPS clients in Python. Please have a look and let me know what you think. PEP text follows. Alex --- PEP: 476 Title: Enabling certificate verification by default for stdlib http clients Version: $Revision$ Last-Modified: $Date$ Author: Alex Gaynor <alex.gaynor(a)gmail.com> Status: Draft Type: Standards Track Content-Type: text/x-rst Created: 28-August-2014 Abstract ======== Currently when a standard library http client (the ``urllib`` and ``http`` modules) encounters an ``https://`` URL it will wrap the network HTTP traffic in a TLS stream, as is necessary to communicate with such a server. However, during the TLS handshake it will not actually check that the server has an X509 certificate is signed by a CA in any trust root, nor will it verify that the Common Name (or Subject Alternate Name) on the presented certificate matches the requested host. The failure to do these checks means that anyone with a privileged network position is able to trivially execute a man in the middle attack against a Python application using either of these HTTP clients, and change traffic at will. This PEP proposes to enable verification of X509 certificate signatures, as well as hostname verification for Python's HTTP clients by default, subject to opt-out on a per-call basis. Rationale ========= The "S" in "HTTPS" stands for secure. When Python's users type "HTTPS" they are expecting a secure connection, and Python should adhere to a reasonable standard of care in delivering this. Currently we are failing at this, and in doing so, APIs which appear simple are misleading users. When asked, many Python users state that they were not aware that Python failed to perform these validations, and are shocked. The popularity of ``requests`` (which enables these checks by default) demonstrates that these checks are not overly burdensome in any way, and the fact that it is widely recommended as a major security improvement over the standard library clients demonstrates that many expect a higher standard for "security by default" from their tools. The failure of various applications to note Python's negligence in this matter is a source of *regular* CVE assignment [#]_ [#]_ [#]_ [#]_ [#]_ [#]_ [#]_ [#]_ [#]_ [#]_ [#]_. .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2010-4340 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2012-3533 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2012-5822 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2012-5825 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-1909 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-2037 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-2073 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-2191 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-4111 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-6396 .. [#] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2013-6444 Technical Details ================= Python would use the system provided certificate database on all platforms. Failure to locate such a database would be an error, and users would need to explicitly specify a location to fix it. This can be achieved by simply replacing the use of ``ssl._create_stdlib_context`` with ``ssl.create_default_context`` in ``http.client``. Trust database -------------- This PEP proposes using the system-provided certificate database. Previous discussions have suggested bundling Mozilla's certificate database and using that by default. This was decided against for several reasons: * Using the platform trust database imposes a lower maintenance burden on the Python developers -- shipping our own trust database would require doing a release every time a certificate was revoked. * Linux vendors, and other downstreams, would unbundle the Mozilla certificates, resulting in a more fragmented set of behaviors. * Using the platform stores makes it easier to handle situations such as corporate internal CAs. Backwards compatibility ----------------------- This change will have the appearance of causing some HTTPS connections to "break", because they will now raise an Exception during handshake. This is misleading however, in fact these connections are presently failing silently, an HTTPS URL indicates an expectation of confidentiality and authentication. The fact that Python does not actually verify that the user's request has been made is a bug, further: "Errors should never pass silently." Nevertheless, users who have a need to access servers with self-signed or incorrect certificates would be able to do so by providing a context with custom trust roots or which disables validation (documentation should strongly recommend the former where possible). Users will also be able to add necessary certificates to system trust stores in order to trust them globally. Twisted's 14.0 release made this same change, and it has been met with almost no opposition. Other protocols =============== This PEP only proposes requiring this level of validation for HTTP clients, not for other protocols such as SMTP. This is because while a high percentage of HTTPS servers have correct certificates, as a result of the validation performed by browsers, for other protocols self-signed or otherwise incorrect certificates are far more common. Note that for SMTP at least, this appears to be changing and should be reviewed for a potential similar PEP in the future: * https://www.facebook.com/notes/protect-the-graph/the-current-state-of-smtp starttls-deployment/1453015901605223 * https://www.facebook.com/notes/protect-the-graph/massive-growth-in-smtp- starttls-deployment/1491049534468526 Python Versions =============== This PEP proposes making these changes to ``default`` (Python 3) branch. I strongly believe these changes also belong in Python 2, but doing them in a patch-release isn't reasonable, and there is strong opposition to doing a 2.8 release. Copyright ========= This document has been placed into the public domain. .. Local Variables: mode: indented-text indent-tabs-mode: nil sentence-end-double-space: t fill-column: 70 coding: utf-8

25 137

Suggested changes to verify HTTPS by default (was Re: Proposed schedule for 3.4.2)
by Nick Coghlan Sept. 9, 2014

Sept. 9, 2014

On 9 September 2014 03:44, Alex Gaynor <alex.gaynor(a)gmail.com> wrote: > *Shifts uncomfortably* it looks like presently there's not a good way to > change anything about the SSL configuration for urllib.request.urlopen. It > does not take a `context` argument, as the http.client API does: > https://docs.python.org/3/library/urllib.request.html#module-urllib.request > and instead takes the cafile, capath, cadefault args. > > This would need to be updated first, once it *did* take such an argument, > this would be accomplished by: > > context = ssl.create_default_context() > context.verify_mode = CERT_OPTIONACERT_NONE > context.verify_hostname = False > urllib.request.urlopen("https://something-i-apparently-dont-care-much-about", > context=context) I'd never needed to use the existing global configuration settings in urllib.request before, but it actually *does* already support setting the default opener for urllib.urlopen. To explicitly set it to use verified HTTPS by default: import ssl, urllib.request https_handler = HTTPSHandler(context=ssl.create_default_context(), check_hostname=True) urllib.request.install_opener(urllib.request.build_opener(https_handler) When the default changes, turning off verification by default for urllib.request.urlopen would look like: import ssl, urllib.request unverified_context = ssl.create_default_context() unverified_context.verify_mode = CERT_OPTIONACERT_NONE unverified_context.verify_hostname = False unverified_handler = HTTPSHandler(context=unverified_context, check_hostname=False) urllib.request.install_opener(urllib.request.build_opener(unverified_handler) However, even setting the opener like that still leaves http.client.HTTPSConnection, urllib.request.URLOpener and urllib.request.FancyURLOpener using unverified HTTPS with no easy way to change their default behaviour. That means some other approach to global configuration is going to be needed to cover the "coping with legacy corporate infrastructure" case, and I still think a monkeypatching based hack is likely to be our best bet. So, focusing on 3.4, but in a way that should be feasible to backport, the changes that I now believe would be needed are: 1. Add "context" arguments to urlopen, URLOpener and FancyURLOpener (the latter two have been deprecated since 3.3, but this would make things easier for a subsequent 2.7 backport) 2. Add a ssl._create_https_context() alias for ssl.create_default_context() 3. Change urllib.request.urlopen() and http.client.HTTPSConnection to call ssl_create_https_context() rather than ssl._create_stdlib_context() 4. Rename ssl._create_stdlib_context() to ssl._create_unverified_context() (updating call sites accordingly) To revert any given call site to the old behaviour: http.client.HTTPSConnection(context=ssl._create_unverified_context()) urllib.request.urlopen(context=ssl._create_unverified_context()) urllib.request.URLOpener(context=ssl._create_unverified_context()) urllib.request.FancyURLOpener(context=ssl._create_unverified_context()) And to revert to the old default behaviour globally: import ssl ssl._create_https_context = ssl._create_unverified_context The backport to 2.7 would then be a matter of bringing urllib, urllib2, httplib and ssl into line with their 3.4.2 counterparts. Regards, Nick. -- Nick Coghlan | ncoghlan(a)gmail.com | Brisbane, Australia

2 1

cpython and parallel make
by Jonas Wagner Sept. 8, 2014

Sept. 8, 2014

Hi, what’s people’s experience with compiling cpython using multiple jobs (e.g., make -j 8)? In my case, I sometimes experience build errors that happen when using -j, whereas the single-job build always works. I haven’t tracked this down in detail, though… here’s an extract from a sample log: 17:42:56 make[1]: Entering directory `/path/to/cpython/build' 17:42:57 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/Python-ast.o Python/Python-ast.c 17:42:57 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/ast.o ../../cpython/Python/ast.c 17:42:57 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/ast.o ../../cpython/Python/ast.c 17:42:57 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/ceval.o ../../cpython/Python/ceval.c 17:42:58 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/compile.o ../../cpython/Python/compile.c 17:43:07 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/graminit.o Python/graminit.c 17:43:07 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/ceval.o ../../cpython/Python/ceval.c 17:43:07 clang -c -Wno-unused-result -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -O3 -fsanitize=address -Werror=declaration-after-statement -I. -IInclude -I../../cpython/Include -DPy_BUILD_CORE -o Python/compile.o ../../cpython/Python/compile.c 17:43:08 make Include/graminit.h 17:43:08 make[1]: Entering directory `/path/to/cpython/build' 17:43:08 make[1]: `Include/graminit.h' is up to date. 17:43:08 make[1]: Leaving directory `/path/to/cpython/build' 17:43:24 clang -fsanitize=address -o Modules/_freeze_importlib Modules/_freeze_importlib.o Modules/getbuildinfo.o Parser/acceler.o [...] Objects/abstract.o [...] Objects/weakrefobject.o Python/_warnings.o [...] Python/ceval.o Python/compile.o Python/codecs.o [...] Modules/faulthandler.o Modules/_tracemalloc.o Modules/hashtable.o Modules/symtablemodule.o Modules/xxsubtype.o -ldl -lutil -lm 17:43:24 /usr/bin/ld: error: Python/ceval.o: file is empty 17:43:24 /usr/bin/ld: error: Python/compile.o: file is empty For some reason, some files like Python/ceval.o seem to be built multiple times. I reckon this causes race conditions that result in some empty object files, which causes the linker to fail. Any ideas about where this comes from, and how to fix it? Cheers, Jonas

4 9

Re: [Python-Dev] cpython (3.4): Issue #22295: Adopt 'python -m pip' as the preferred invocation
by Antoine Pitrou Sept. 6, 2014

Sept. 6, 2014

On Sat, 6 Sep 2014 12:40:19 +0200 (CEST) nick.coghlan <python-checkins(a)python.org> wrote: > > The following command will install the latest version of a module and its > dependencies from the Python Package Index:: > > - pip install SomePackage > + python -m pip install SomePackage > + > +.. note:: > + > + For POSIX users (including Mac OS X and Linux users), the examples in > + this guide assume the use of a :term:`virtual environment`. Why not advocate --user instead? It is simpler than messing around with virtual environments and will suffice for most use cases. Regards Antoine.

4 4