Mailman 3 August 2018 - Python-Dev

Python 2.7 EOL date
by Collin Anderson 02 Sep '18

02 Sep '18

Hi All, Sorry if this has been mentioned before, but I noticed the Python 2.7 EOL date was recently set to Jan 1st, 2020. My understanding was Python releases get 5 years of support from their initial release, and Python 2.7 was extended an additional 5 years. Python 2.7 was originally released on 2010-07-03, and with an original EOL of 2015-07-03. Extended 5 years, shouldn't the EOL be 2020-07-03? Also, this statement is a little unclear to me: > Specifically, 2.7 will receive bugfix support until January 1, 2020. All 2.7 development work will cease in 2020. This statement makes it sound like bugfixes end on Jan 1st, but seems to leave open the possibility that security fixes could continue through the year. Thanks! Collin

7 9

AIX and python tests
by Michael 02 Sep '18

02 Sep '18

As I have time, I'll dig into these. I have a couple of PR already 'out there', which I hope someone will be looking at when/as he/she/they have time. My time will also be intermittent. My next test - and I hope not too difficult - would be the test_utf8. The test: FAIL: test_cmd_line (test.test_utf8_mode.UTF8ModeTests) fails - and I am wondering if it is as simple as AIX default mode is ISO8559-1 and the test looks to be comparing UTF8 with the locale_default. If that is the case, obviously this test will never succeed - asis. Am I understanding the test properly. If yes, then I'll see what I can come up with for a patch to the test for AIX. If no, I'll need some hand holding to help me understand the test A bigger challenge, and I think a major issue with many of the test failures is test_ssl. Here I already know I'll need so assistance. I am quite lost. I know AIX at an expert level, but I do not know python (especially python internals, macros, etc..) and after about 3 levels I am lost. I also find it hard to get 'artifacts' from the tests to know what is expected. Looking forward to assistance from various people - in understanding the tests, and probably better python coding criticism. Michael

3 2

UTF-8 Mode now also enabled by the POSIX locale
by Victor Stinner 02 Sep '18

02 Sep '18

Hi, While working on test_utf8_mode on AIX (bpo-34347) and HP-UX (bpo-34403), I noticed that FreeBSD doesn't work properly with the POSIX locale (bpo-34527). I also noticed that my implementation of my PEP 540 "UTF-8 Mode" doesn't respect the PEP: the UTF-8 Mode should be enabled by the POSIX locale, not only by the C locale. I just modified Python 3.7 and master (future 3.8) to enable UTF-8 Mode if the LC_CTYPE locale is "POSIX": https://bugs.python.org/issue34527 I also fixed FreeBSD to support the "POSIX" locale as well (3.6, 3.7 and master branches). Note: The C locale coercion (PEP 538) is only enabled if the LC_CTYPE locale is "C". To finish my list of recent Unicode issues, I'm also working on bpo-34523: select the Python filesystem encoding before Py_Initialize(). This change will allow embedders to force an encoding instead of letting Python choose one for them. Victor

2 1

make patchcheck and git path
by Michael 01 Sep '18

01 Sep '18

I am trying to be a 'good scout' and run "make patchcheck" more regularly. However, I generally am not successful because I build and test in separate directories. There is access to git! just no ready reference in the build area. So, not calling it a bug - but if someone else also experiences this, and feels capable of makeing it more flexible - you will get thanks from me, in any case! Michael

5 5

Summary of Python tracker Issues
by Python tracker 31 Aug '18

31 Aug '18

ACTIVITY SUMMARY (2018-08-24 - 2018-08-31) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6828 (+21) closed 39479 (+48) total 46307 (+69) Open issues with patches: 2719 Issues opened (49) ================== #34171: Lib/trace.cover not removed by the clean target https://bugs.python.org/issue34171 reopened by pablogsal #34488: improve performance of BytesIO.writelines() by avoiding creati https://bugs.python.org/issue34488 opened by sir-sigurd #34489: subprocess: execution of batch-files (.cmd/.bat) is vulnerable https://bugs.python.org/issue34489 opened by sebres #34490: transport.get_extra_info('sockname') of test_asyncio fails on https://bugs.python.org/issue34490 opened by Michael.Felt #34496: Argparse library: parse --set type https://bugs.python.org/issue34496 opened by fralau #34498: Python 3.7 breaks on singledispatch_function.register(pseudo_t https://bugs.python.org/issue34498 opened by Dutcho #34499: Extend registering of single-dispatch functions to parametrize https://bugs.python.org/issue34499 opened by Dutcho #34500: Fix ResourceWarning in difflib.py https://bugs.python.org/issue34500 opened by Tiger-222 #34505: urllib2 fails for proxy credentials that contains a '/' charac https://bugs.python.org/issue34505 opened by Balibax5445 #34506: Traceback logged when SSL handshake fails https://bugs.python.org/issue34506 opened by hniksic #34507: Add path expansion interpolation in pyvenv.cfg home key https://bugs.python.org/issue34507 opened by chnlior #34508: return of non-parenthesized star-unpacking expression a Syntax https://bugs.python.org/issue34508 opened by mark.dickinson #34509: Starting to use gcc-8 on CI https://bugs.python.org/issue34509 opened by junaruga #34510: add HTTPConnection.settimeout() https://bugs.python.org/issue34510 opened by collinanderson #34512: Document platform-specific strftime() behavior for non-ASCII f https://bugs.python.org/issue34512 opened by izbyshev #34513: test_multiprocessing_spawn fails on x86 Windows7 3.7 buildbot https://bugs.python.org/issue34513 opened by pablogsal #34514: assertEqual doesn't use maxDiff when comparing dictionaries https://bugs.python.org/issue34514 opened by Victor Engmark2 #34515: lib2to3: support non-ASCII identifiers https://bugs.python.org/issue34515 opened by monson #34516: httplib sets unbefitting "Host" in request header when request https://bugs.python.org/issue34516 opened by visionwun #34518: Documentation for coroutine objects https://bugs.python.org/issue34518 opened by hniksic #34519: Add additional aliases for HP Roman 8 https://bugs.python.org/issue34519 opened by michael-o #34520: test_asyncio leaked [2, 2, 2] references, sum=6 in AMD64 Windo https://bugs.python.org/issue34520 opened by pablogsal #34521: test_socket.RecvmsgIntoSCMRightsStreamTest fails on AMD64 Free https://bugs.python.org/issue34521 opened by pablogsal #34522: PyTypeObject's tp_base initialization bug https://bugs.python.org/issue34522 opened by eelizondo #34525: smtplib's authobject return value wrongly documented https://bugs.python.org/issue34525 opened by srittau #34526: Path.relative_to() taking multiple arguments could be better d https://bugs.python.org/issue34526 opened by Antony.Lee #34529: add the option for json.dumps to return newline delimited json https://bugs.python.org/issue34529 opened by ronron #34530: distutils: find_executable() fails if the PATH environment var https://bugs.python.org/issue34530 opened by vstinner #34532: Python launcher on Windows exits with error when requesting li https://bugs.python.org/issue34532 opened by bgerrity #34533: Apply PEP384 to _csv module https://bugs.python.org/issue34533 opened by eelizondo #34535: queue.Queue(timeout=0.001) avg delay Windows:14.5ms, Ubuntu: 0 https://bugs.python.org/issue34535 opened by Gammaguy #34536: Enum._missing_ doesn't raise TypeError when a non-Enum object https://bugs.python.org/issue34536 opened by Paul Pinterits #34537: test_gdb fails with LC_ALL=C https://bugs.python.org/issue34537 opened by vstinner #34538: Remove encouragement to author a base class for all Exception https://bugs.python.org/issue34538 opened by Nathaniel Manista #34539: namedtuple's exec() throws segmentation fault https://bugs.python.org/issue34539 opened by turicas #34541: pathlib.Path.iterdir doesn't throw an exception until you star https://bugs.python.org/issue34541 opened by Paul Pinterits #34542: [TLS] Update test certs to future proof settings https://bugs.python.org/issue34542 opened by christian.heimes #34543: _struct.Struct: calling functions without calling __init__ res https://bugs.python.org/issue34543 opened by DeKrain #34544: FreeBSD: Fatal Python error: get_locale_encoding: failed to ge https://bugs.python.org/issue34544 opened by vstinner #34546: Zipfile encryption function https://bugs.python.org/issue34546 opened by 大野隆弘 #34547: Wsgiref server does not handle closed connections gracefully https://bugs.python.org/issue34547 opened by Petter S #34548: IDLE: Make TextView use the configured theme colors https://bugs.python.org/issue34548 opened by taleinat #34549: unittest docs could use another header https://bugs.python.org/issue34549 opened by napsterinblue #34550: UnicodeDecodeError when invoke method configure() of Menu inst https://bugs.python.org/issue34550 opened by sbellct #34551: Redundant store can be removed from _PyFunction_FastCallDict https://bugs.python.org/issue34551 opened by Eric Lippert #34552: Clarify built-in types comparisons https://bugs.python.org/issue34552 opened by Windson Yang #34553: Python Crashes when trying to access any date related fields i https://bugs.python.org/issue34553 opened by vijay #34555: AF_VSOCK not unset because of wrong nesting https://bugs.python.org/issue34555 opened by mcduke #34556: Add --upgrade to venv module https://bugs.python.org/issue34556 opened by cooperlees Most recent 15 issues with no replies (15) ========================================== #34555: AF_VSOCK not unset because of wrong nesting https://bugs.python.org/issue34555 #34552: Clarify built-in types comparisons https://bugs.python.org/issue34552 #34550: UnicodeDecodeError when invoke method configure() of Menu inst https://bugs.python.org/issue34550 #34549: unittest docs could use another header https://bugs.python.org/issue34549 #34548: IDLE: Make TextView use the configured theme colors https://bugs.python.org/issue34548 #34547: Wsgiref server does not handle closed connections gracefully https://bugs.python.org/issue34547 #34546: Zipfile encryption function https://bugs.python.org/issue34546 #34537: test_gdb fails with LC_ALL=C https://bugs.python.org/issue34537 #34536: Enum._missing_ doesn't raise TypeError when a non-Enum object https://bugs.python.org/issue34536 #34533: Apply PEP384 to _csv module https://bugs.python.org/issue34533 #34532: Python launcher on Windows exits with error when requesting li https://bugs.python.org/issue34532 #34526: Path.relative_to() taking multiple arguments could be better d https://bugs.python.org/issue34526 #34525: smtplib's authobject return value wrongly documented https://bugs.python.org/issue34525 #34521: test_socket.RecvmsgIntoSCMRightsStreamTest fails on AMD64 Free https://bugs.python.org/issue34521 #34515: lib2to3: support non-ASCII identifiers https://bugs.python.org/issue34515 Most recent 15 issues waiting for review (15) ============================================= #34555: AF_VSOCK not unset because of wrong nesting https://bugs.python.org/issue34555 #34551: Redundant store can be removed from _PyFunction_FastCallDict https://bugs.python.org/issue34551 #34548: IDLE: Make TextView use the configured theme colors https://bugs.python.org/issue34548 #34542: [TLS] Update test certs to future proof settings https://bugs.python.org/issue34542 #34541: pathlib.Path.iterdir doesn't throw an exception until you star https://bugs.python.org/issue34541 #34533: Apply PEP384 to _csv module https://bugs.python.org/issue34533 #34530: distutils: find_executable() fails if the PATH environment var https://bugs.python.org/issue34530 #34525: smtplib's authobject return value wrongly documented https://bugs.python.org/issue34525 #34522: PyTypeObject's tp_base initialization bug https://bugs.python.org/issue34522 #34519: Add additional aliases for HP Roman 8 https://bugs.python.org/issue34519 #34515: lib2to3: support non-ASCII identifiers https://bugs.python.org/issue34515 #34512: Document platform-specific strftime() behavior for non-ASCII f https://bugs.python.org/issue34512 #34509: Starting to use gcc-8 on CI https://bugs.python.org/issue34509 #34508: return of non-parenthesized star-unpacking expression a Syntax https://bugs.python.org/issue34508 #34500: Fix ResourceWarning in difflib.py https://bugs.python.org/issue34500 Top 10 most discussed issues (10) ================================= #34171: Lib/trace.cover not removed by the clean target https://bugs.python.org/issue34171 12 msgs #34535: queue.Queue(timeout=0.001) avg delay Windows:14.5ms, Ubuntu: 0 https://bugs.python.org/issue34535 9 msgs #34538: Remove encouragement to author a base class for all Exception https://bugs.python.org/issue34538 9 msgs #34529: add the option for json.dumps to return newline delimited json https://bugs.python.org/issue34529 8 msgs #34508: return of non-parenthesized star-unpacking expression a Syntax https://bugs.python.org/issue34508 7 msgs #34522: PyTypeObject's tp_base initialization bug https://bugs.python.org/issue34522 7 msgs #34453: ipaddress module accepts some strange IPv6 addresses that it s https://bugs.python.org/issue34453 6 msgs #34481: Different behavior of C and Python impls of datetime.strftime https://bugs.python.org/issue34481 6 msgs #34007: test_gdb fails in s390x SLES buildbots https://bugs.python.org/issue34007 5 msgs #34200: importlib: python -m test test_pkg -m test_7 fails randomly https://bugs.python.org/issue34200 5 msgs Issues closed (47) ================== #6700: inspect.getsource() returns incorrect source lines at the modu https://bugs.python.org/issue6700 closed by taleinat #11190: test_locale error on AIX https://bugs.python.org/issue11190 closed by vstinner #11193: test_subprocess test_undecodable_env error on AIX https://bugs.python.org/issue11193 closed by gregory.p.smith #13312: test_time fails: strftime('%Y', y) for negative year https://bugs.python.org/issue13312 closed by gregory.p.smith #17102: tarfile extract can write files outside the destination path https://bugs.python.org/issue17102 closed by gregory.p.smith #21145: Add the @cached_property decorator https://bugs.python.org/issue21145 closed by ncoghlan #24482: itertools.tee causes segfault in a multithreading environment, https://bugs.python.org/issue24482 closed by xiang.zhang #26694: Disasembler fall with Key Error while disassemble obfuscated c https://bugs.python.org/issue26694 closed by serhiy.storchaka #32836: Symbol table for comprehensions (list, dict, set) still includ https://bugs.python.org/issue32836 closed by serhiy.storchaka #32968: Fraction modulo infinity should behave consistently with other https://bugs.python.org/issue32968 closed by mark.dickinson #33550: Sigpipe handling issue should be documented https://bugs.python.org/issue33550 closed by Mariatta #34062: Python launcher on Windows does not work with --list or --list https://bugs.python.org/issue34062 closed by steve.dower #34207: test_cmd_line test_utf8_mode test_warnings fail in all FreeBSD https://bugs.python.org/issue34207 closed by vstinner #34306: minidom: wrong processing of xmlns attributes https://bugs.python.org/issue34306 closed by porton #34319: Clarify pathlib.Path("filepath").read_text() https://bugs.python.org/issue34319 closed by CuriousLearner #34347: AIX: test_utf8_mode.test_cmd_line fails https://bugs.python.org/issue34347 closed by vstinner #34355: SIGSEGV (Address boundary error) https://bugs.python.org/issue34355 closed by inada.naoki #34395: memory leaks in error handling in csv and pickle modules https://bugs.python.org/issue34395 closed by serhiy.storchaka #34403: test_utf8_mode.test_cmd_line() fails on HP-UX due to false ass https://bugs.python.org/issue34403 closed by vstinner #34426: "__lltrace__" seems to be wrong , "__ltrace__" is correct in https://bugs.python.org/issue34426 closed by Mariatta #34427: calling MutableSequence.extend on self produces infinite loop https://bugs.python.org/issue34427 closed by rhettinger #34428: tokenize https://bugs.python.org/issue34428 closed by terry.reedy #34434: Removal of kwargs for built-in types not covered with "changed https://bugs.python.org/issue34434 closed by xiang.zhang #34448: incomplete/missing message from configure.ac for usable wchar_ https://bugs.python.org/issue34448 closed by berker.peksag #34483: eval() raises NameError: name '...' is not defined https://bugs.python.org/issue34483 closed by eric.smith #34485: _PyCoreConfig: add stdio_encoding and stdio_errors https://bugs.python.org/issue34485 closed by vstinner #34491: _bsddb.c: Missing Py_DECREF() in DB_join() https://bugs.python.org/issue34491 closed by xiang.zhang #34492: Python/coreconfig.c: Fix _Py_wstrlist_copy() https://bugs.python.org/issue34492 closed by vstinner #34493: Objects/genobject.c: Missing NULL check in compute_cr_origin() https://bugs.python.org/issue34493 closed by benjamin.peterson #34494: simple "sequence" class ignoring __len__ https://bugs.python.org/issue34494 closed by rhettinger #34495: excess_args asserts if args == nullptr https://bugs.python.org/issue34495 closed by benjamin.peterson #34497: Remove needless set operator restriction https://bugs.python.org/issue34497 closed by rhettinger #34501: PyType_FromSpecWithBases: spec->name is dereferenced before ch https://bugs.python.org/issue34501 closed by benjamin.peterson #34502: Docs of sys.exit() mention utf8_mode for an unclear reason https://bugs.python.org/issue34502 closed by benjamin.peterson #34503: Reference leak in PyErr_SetObject() https://bugs.python.org/issue34503 closed by xiang.zhang #34504: PySequence_Check: argument is dereferenced and then checked fo https://bugs.python.org/issue34504 closed by benjamin.peterson #34511: I suggest to add documentation about "method" parameter of url https://bugs.python.org/issue34511 closed by Mariatta #34517: Error referencing local variables in dict comprehensions insid https://bugs.python.org/issue34517 closed by serhiy.storchaka #34523: Choose the filesystem encoding before Python initialization (a https://bugs.python.org/issue34523 closed by vstinner #34524: Format conversion documentation example don't match comment https://bugs.python.org/issue34524 closed by Richard Evans #34527: On FreeBSD, Python 3 doesn't support support the POSIX locale https://bugs.python.org/issue34527 closed by vstinner #34528: Windows installer: Failed to run untrusted mode. https://bugs.python.org/issue34528 closed by steve.dower #34531: doc Move comment about list sorting behavour outside impl-deta https://bugs.python.org/issue34531 closed by rhettinger #34534: importlib.resources does not work with packages that have no _ https://bugs.python.org/issue34534 closed by barry #34540: shutil._call_external_zip should use subprocess https://bugs.python.org/issue34540 closed by benjamin.peterson #34545: error in the repl due to indentation https://bugs.python.org/issue34545 closed by eryksun #34554: Add match built-in function https://bugs.python.org/issue34554 closed by eric.snow

1 0

A Subtle Bug in Class Initializations
by Eddie Elizondo 29 Aug '18

29 Aug '18

Background: Through the implementation of an alternate runtime I've been poking around some of the class initialization routines and I found out that there was a subtle bug with PyType_Ready and the header initializer PyVarObject_HEAD_INIT. Looking through the codebase, I couldn't really find any pattern of when the type should be defined within PyVarObject_HEAD_INIT. Sometimes it was initialized to NULL (or 0) and PyType_Type (let's ignore Py_True and Py_False from now). From PyType_Ready it turns out that setting the value PyType_Type is never actually needed outside of PyType_Type and PyBaseObject type. This is clear from the code: if (Py_TYPE(type) == NULL && base != NULL) Py_TYPE(type) = Py_TYPE(base);  Given that any PyTypeObject's base is of type PyType_Type, setting PyVarObject_HEAD_INIT(&PyType_Ready) is superfluous. Therefore, setting all static PyTypeObjects to their ob_type to NULL should be a safe assumption to make. Uninitialized Types: A quick s/PyVarObject_HEAD_INIT(&PyType_Type/PyVarObject_HEAD_INIT(NULL/ shows that some objects do need to have their ob_type set from the outset, violating the previous assumption. After writing a quick script, I found that out of the ~300 PyVarObject_HEAD_INIT present in CPython, only these 14 types segfaulted: PyByteArrayIter_Type PyBytesIter_Type PyDictIterKey_Type PyDictIterValue_Type PyDictIterItem_Type PyClassMethod_Type PyAsyncGen_Type PyListIter_Type PyListRevIter_Type PyODictIter_Type PyLongRangeIter_Type PySetIter_Type PyTupleIter_Type PyUnicodeIter_Type Bug: It turns out that these PyTypeObjects are never initialized through PyType_Ready. However, they are used as fully initialized types. It is by pure chance that the work without having to call the initializer on them. This though is undefined behavior. This not only might result in a weird future bug which is hard to chase down but also, it affects other runtimes as this behavior depends on implementation details of CPython. This is a pervasive pattern that should be removed from the codebase and ideally extensions should follow as well. Solution: Here are my proposed solutions in order from less controversial to most controversial. Note that all of them I already tried in a local branch and are working: 1) Initialize all uninitialized types. Example: https://github.com/eduardo-elizondo/cpython/commit/bc53db3cf4e5a6923b0b1afa… 2) Move all PyVarObject_HEAD_INIT to NULL except PyType_Type, PyBaseObject_Type and the booleans. 3) Special case the initialization of PyType_Type and PyBaseObject_Type within PyType_Ready to now make all calls to PyVarObject_HEAD_INIT use NULL. To enable this a small change within PyType_Ready is needed to initialize PyType_Type PyBaseObject: if (base == NULL) { Py_TYPE(&PyType_Type) = &PyType_Type; Py_TYPE(type) = &PyType_Type; } Also, the booleans have to be fully initialized without calling PyVarObject_HEAD_INIT. I propose: struct _longobject _Py_FalseStruct = { PyObject_HEAD_INIT(&PyBool_Type), 0, { 0 } }; This will clean-up the entire codebase of this anti-pattern. Example: https://github.com/eduardo-elizondo/cpython/commit/542fd79e4279c64c077c127b… 4) Modify PyVarObject_HEAD_INIT to ignore the input and initialize to NULL and 0. In order to prevent this antipattern within extension code as well, we should make PyVarObject_HEAD_INIT ignore the inputs and just set the value to NULL. #define PyVarObject_HEAD_INIT(type, size) \ { PyObject_HEAD_INIT(NULL) 0 }, This will prevent external code to have a semi-initialized type that is not initialized through PyType_Ready. 5) Finally, I would go even further and suggest making PyVarObject_HEAD_INIT argumentless. #define PyVarObject_HEAD_INIT \ { PyObject_HEAD_INIT(NULL) 0 }, However, this breaks backward compatibility. That being said, this will make extension maintainers aware of this antipattern. Example: https://github.com/eduardo-elizondo/cpython/commit/3869e53843008ff096764f4a… Thoughts?

5 8

Review of Pull Request #2078
by Pierre Quentel 27 Aug '18

27 Aug '18

Hi, A few months ago I have submitted the Pull Request #2078 named "bpo-30576 : Add HTTP compression support to http.server". After a couple of iterations, discussions on the PR page ( https://github.com/python/cpython/pull/2078) and on the bug tracker ( https://bugs.python.org/issue30576), it seems to me that there are no objection to adding this feature (the Github page even has recent messages favorable to its inclusion) and that the implementation is not a complete mess ;-) It has been in the "waiting core review" state for many months now. As indicated on the contributing page ( https://github.com/python/cpython/blob/master/.github/CONTRIBUTING.rst) I send this message to python-dev to see if one of the core developers could take a look at the Pull Request. Thanks for your time, Pierre

1 0

Re: [Python-Dev] [Python-checkins] bpo-34171: Prevent creating Lib/trace.cover when run the trace module. (GH-8841)
by Jeremy Kloth 27 Aug '18

27 Aug '18

On Sat, Aug 25, 2018 at 1:28 AM Serhiy Storchaka <webhook-mailer(a)python.org> wrote: > > https://github.com/python/cpython/commit/c406d5cd74002964a64c3eb7d9e2445a7f… > commit: c406d5cd74002964a64c3eb7d9e2445a7fd3a03f > branch: master > author: Serhiy Storchaka <storchaka(a)gmail.com> > committer: GitHub <noreply(a)github.com> > date: 2018-08-25T10:27:55+03:00 > summary: > > bpo-34171: Prevent creating Lib/trace.cover when run the trace module. (GH-8841) > > files: > A Misc/NEWS.d/next/Library/2018-08-21-00-29-01.bpo-34171.6LkWav.rst > M Lib/test/test_trace.py > M Lib/trace.py This change seems to have caused most buildbots to go red.

2 2

AIX, test_ssl in particular, but also AIX failed tests in general - getting to the 'STABLE' side
by Michael 27 Aug '18

27 Aug '18

Dear all, Last week I experimented with test_ssl. My expectation was that test failures was caused by the openssl.base provided by IBM for AIX not having a default certificate file (CApath). However, that is not the case. The tests that fail are similar to: self.assertRaisesRegex(ssl.SSLError, "PEM lib") I started out by testing with something as: if not AIX: with self.assertRaisesRegex(ssl.SSLError, "PEM lib"): ctx.load_cert_chain(BADCERT) else: with self.assertRaises(ssl.SSLError): ctx.load_cert_chain(BADCERT) This is after an analysis where I saw that calls too SSL were returning an non-success status (!= 1) while ERR_peek_last_error() regularly returned 0. Hence, the frequent 'AssertionError: "PEM lib" does not match "unknown error ...' with "unknown error" the string Python provides. While above might remove the 'fail messages' it did not satisfy me. So, I downloaded openssl (1.0.2p) and compiled - with no optimization! And now, even from Python3.6 I see: test_ssl passed in 1 min 23 sec == Tests result: SUCCESS == 1 test OK. In short, the failures of test_ssl may be ignored - as far as raising an exception goes. a) I am running a bot for Python, and once the argument "-with-openssl=/opt/aixtools" is added my bot will stop showing these errors. I mention this so that it is clear why they suddenly disappear on my bot (but not elsewhere). Also to alert Python-Dev that the AIX platform, regarding ssl.py, _ssl.c and test_ssl.py functions 'stable' but is not as friendly when it comes to saying why WHEN (my guess) a heavily optimized (I am thinking -O3 to -O5) library is used. b) With this feedback - MAYBE - the team from IBM might review the way they package openssl and make sure the messages are visible via ERR_peek_last_error() et al. Ideally, IBM will notice and work on it without prompting. One can dream :) c) In the meantime - I am curious to know what this 'proof' means to Python-Dev. I have a simple goal - work through the tests that AIX has been failing historically and figure out why they fail and fix the tests. To that end I have submitted several PR's - starting back In January, then nothing as noone ever seemed to notice, and the last weeks several additional ones. Victor has been kind enough to say he will look at the tests as he has time (and back from vacation). But we are all, or most, working on our time. My goal, rephrased, is to see AIX in the 'stable' column so that when a test fails it is because there is a regression that needs addressing - either in the test or in the proposed code change. So I would be grateful if others were also looking. I am not trying to re-invent the wheel and will not be surprised if my 'test fix' is not done in the 'Python' way. I'll learn over time - but this calls for instructive (and critical) comments. "bij voorbaat dank" aka Thanks in Advance. So, hoping this helps - I'll continue as I can. Time and resources are limited. And, I am very curious re: point c) above. Great Days! everyone, Michael

1 0

Summary of Python tracker Issues
by Python tracker 24 Aug '18

24 Aug '18

ACTIVITY SUMMARY (2018-08-17 - 2018-08-24) Python tracker at https://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue. Do NOT respond to this message. Issues counts and deltas: open 6807 (+31) closed 39431 (+36) total 46238 (+67) Open issues with patches: 2707 Issues opened (48) ================== #34421: Cannot install package with unicode module names on Windows https://bugs.python.org/issue34421 opened by julien.malard #34422: __name__ not available for classes in typing module https://bugs.python.org/issue34422 opened by Gabriel Tremblay #34423: Overflow when casting from double to time_t, and_PyTime_t. https://bugs.python.org/issue34423 opened by enedil #34424: Unicode names break email header https://bugs.python.org/issue34424 opened by _savage #34426: "__lltrace__" seems to be wrong , "__ltrace__" is correct in https://bugs.python.org/issue34426 opened by Nojima Takahide #34427: calling MutableSequence.extend on self produces infinite loop https://bugs.python.org/issue34427 opened by Naris R #34428: tokenize https://bugs.python.org/issue34428 opened by lkcl #34429: On Windows tempfile.TemporaryFile behaves like NamedTemporaryF https://bugs.python.org/issue34429 opened by dwich #34430: Symmetrical chaining futures in asyncio.future.wrap_future https://bugs.python.org/issue34430 opened by huji #34431: Docs does not eval allows code object as argument https://bugs.python.org/issue34431 opened by jfine2358 #34433: cancel all other pending child futures https://bugs.python.org/issue34433 opened by tzongw #34434: Removal of kwargs for built-in types not covered with "changed https://bugs.python.org/issue34434 opened by andymaier #34439: Expose venv --prompt value to an environment value https://bugs.python.org/issue34439 opened by Tomer #34442: zlib module not built on windows https://bugs.python.org/issue34442 opened by steveire #34443: enum repr should use __qualname__ https://bugs.python.org/issue34443 opened by doerwalter #34444: Module's __file__ should be absolute always ("." in sys.path) https://bugs.python.org/issue34444 opened by blueyed #34445: asyncio support in doctests https://bugs.python.org/issue34445 opened by Stefan Tjarks #34446: ambiguous _max_size parameter in SpooledTemporaryFile https://bugs.python.org/issue34446 opened by jcc2220 #34447: ttk.TreeView (and maybe other functions) is overzealous in con https://bugs.python.org/issue34447 opened by abarnert #34448: incomplete/missing message from configure.ac for usable wchar_ https://bugs.python.org/issue34448 opened by michael-o #34449: HP aCC complains about invalid -fPIC on HP-UX https://bugs.python.org/issue34449 opened by michael-o #34450: improve shutil.make_archive https://bugs.python.org/issue34450 opened by redstone-cold #34451: docs: tutorial/introduction doesn't mention toggle of prompts https://bugs.python.org/issue34451 opened by jfine2358 #34453: ipaddress module accepts some strange IPv6 addresses that it s https://bugs.python.org/issue34453 opened by lkcl #34455: Tkinter crashing when pressing Command + ^ (OSX) https://bugs.python.org/issue34455 opened by iPodClassic #34458: No way to alternate options https://bugs.python.org/issue34458 opened by porton #34459: email.contentmanager should use IANA encoding https://bugs.python.org/issue34459 opened by era #34460: email.charset: common IANA labels missing https://bugs.python.org/issue34460 opened by era #34461: Availability of parsers in etree initializer https://bugs.python.org/issue34461 opened by nilanjan roy #34463: Discrepancy between traceback.print_exception and sys.__except https://bugs.python.org/issue34463 opened by Timothy McCurrach #34464: There are inconsitencies in the treatment of True, False, None https://bugs.python.org/issue34464 opened by jfine2358 #34465: ipaddress should accept bytearray in addition to bytes https://bugs.python.org/issue34465 opened by joernheissler #34466: socket.settimeout working incorrectly for connect() method of https://bugs.python.org/issue34466 opened by Slon #34467: No mechanism to abort created coroutine or suppress not-awaite https://bugs.python.org/issue34467 opened by Sheng Zhong #34470: windows msi in headless mode fails to install Script directory https://bugs.python.org/issue34470 opened by cdknorow #34472: zipfile: does not include optional descriptor signature https://bugs.python.org/issue34472 opened by silas #34475: functools.partial objects have no __qualname__ attribute https://bugs.python.org/issue34475 opened by chris.jerdonek #34476: asyncio.sleep(0) not documented https://bugs.python.org/issue34476 opened by hniksic #34478: Possibly misleading/wrong documentation about PyModuleDef.m_fr https://bugs.python.org/issue34478 opened by Segev Finer #34479: ArgumentParser subparser error display at the wrong level https://bugs.python.org/issue34479 opened by siming85 #34480: _markupbase.py fails with UnboundLocalError on invalid keyword https://bugs.python.org/issue34480 opened by kodial #34481: Different behavior of C and Python impls of datetime.strftime https://bugs.python.org/issue34481 opened by izbyshev #34482: datetime: Tests for potential crashes due to non-UTF-8-encodab https://bugs.python.org/issue34482 opened by izbyshev #34483: eval() raises NameError: name '...' is not defined https://bugs.python.org/issue34483 opened by alexb #34484: Unicode HOWTO incorrectly refers to Private Use Area for surro https://bugs.python.org/issue34484 opened by mark.dickinson #34485: _PyCoreConfig: add stdio_encoding and stdio_errors https://bugs.python.org/issue34485 opened by vstinner #34486: "RuntimeError: release unlocked lock" when starting a thread https://bugs.python.org/issue34486 opened by Stanisław Skonieczny (Uosiu) #34487: enum _sunder_ names mix metaclass and enum class attributes https://bugs.python.org/issue34487 opened by Gerrit.Holl Most recent 15 issues with no replies (15) ========================================== #34487: enum _sunder_ names mix metaclass and enum class attributes https://bugs.python.org/issue34487 #34485: _PyCoreConfig: add stdio_encoding and stdio_errors https://bugs.python.org/issue34485 #34482: datetime: Tests for potential crashes due to non-UTF-8-encodab https://bugs.python.org/issue34482 #34481: Different behavior of C and Python impls of datetime.strftime https://bugs.python.org/issue34481 #34479: ArgumentParser subparser error display at the wrong level https://bugs.python.org/issue34479 #34478: Possibly misleading/wrong documentation about PyModuleDef.m_fr https://bugs.python.org/issue34478 #34475: functools.partial objects have no __qualname__ attribute https://bugs.python.org/issue34475 #34472: zipfile: does not include optional descriptor signature https://bugs.python.org/issue34472 #34463: Discrepancy between traceback.print_exception and sys.__except https://bugs.python.org/issue34463 #34461: Availability of parsers in etree initializer https://bugs.python.org/issue34461 #34460: email.charset: common IANA labels missing https://bugs.python.org/issue34460 #34451: docs: tutorial/introduction doesn't mention toggle of prompts https://bugs.python.org/issue34451 #34449: HP aCC complains about invalid -fPIC on HP-UX https://bugs.python.org/issue34449 #34447: ttk.TreeView (and maybe other functions) is overzealous in con https://bugs.python.org/issue34447 #34445: asyncio support in doctests https://bugs.python.org/issue34445 Most recent 15 issues waiting for review (15) ============================================= #34485: _PyCoreConfig: add stdio_encoding and stdio_errors https://bugs.python.org/issue34485 #34482: datetime: Tests for potential crashes due to non-UTF-8-encodab https://bugs.python.org/issue34482 #34472: zipfile: does not include optional descriptor signature https://bugs.python.org/issue34472 #34461: Availability of parsers in etree initializer https://bugs.python.org/issue34461 #34449: HP aCC complains about invalid -fPIC on HP-UX https://bugs.python.org/issue34449 #34448: incomplete/missing message from configure.ac for usable wchar_ https://bugs.python.org/issue34448 #34434: Removal of kwargs for built-in types not covered with "changed https://bugs.python.org/issue34434 #34433: cancel all other pending child futures https://bugs.python.org/issue34433 #34430: Symmetrical chaining futures in asyncio.future.wrap_future https://bugs.python.org/issue34430 #34427: calling MutableSequence.extend on self produces infinite loop https://bugs.python.org/issue34427 #34426: "__lltrace__" seems to be wrong , "__ltrace__" is correct in https://bugs.python.org/issue34426 #34424: Unicode names break email header https://bugs.python.org/issue34424 #34423: Overflow when casting from double to time_t, and_PyTime_t. https://bugs.python.org/issue34423 #34421: Cannot install package with unicode module names on Windows https://bugs.python.org/issue34421 #34408: possible null pointer dereference in pystate.c https://bugs.python.org/issue34408 Top 10 most discussed issues (10) ================================= #34207: test_cmd_line test_utf8_mode test_warnings fail in all FreeBSD https://bugs.python.org/issue34207 9 msgs #34455: Tkinter crashing when pressing Command + ^ (OSX) https://bugs.python.org/issue34455 9 msgs #26544: platform.libc_ver() returns incorrect version number https://bugs.python.org/issue26544 7 msgs #34428: tokenize https://bugs.python.org/issue34428 6 msgs #34434: Removal of kwargs for built-in types not covered with "changed https://bugs.python.org/issue34434 6 msgs #34347: AIX: test_utf8_mode.test_cmd_line fails https://bugs.python.org/issue34347 5 msgs #34410: itertools.tee not thread-safe; can segfault interpreter when w https://bugs.python.org/issue34410 5 msgs #34217: windows: cross compilation fails due to headers with uppercase https://bugs.python.org/issue34217 4 msgs #34431: Docs does not eval allows code object as argument https://bugs.python.org/issue34431 4 msgs #6700: inspect.getsource() returns incorrect source lines at the modu https://bugs.python.org/issue6700 3 msgs Issues closed (35) ================== #2122: mmap.flush does not check for errors on windows https://bugs.python.org/issue2122 closed by berker.peksag #5999: compile error on HP-UX 11.22 ia64 - 'mbstate_t' is used as a t https://bugs.python.org/issue5999 closed by vstinner #18925: select.poll.modify is not documented https://bugs.python.org/issue18925 closed by berker.peksag #22057: The doc say all globals are copied on eval(), but only __built https://bugs.python.org/issue22057 closed by berker.peksag #22602: UTF-7 codec decodes ill-formed sequences starting with "+" https://bugs.python.org/issue22602 closed by serhiy.storchaka #26363: __builtins__ propagation is misleading described in exec and e https://bugs.python.org/issue26363 closed by berker.peksag #27088: doc: select: epoll.poll: incorrect timeout units, missing maxe https://bugs.python.org/issue27088 closed by berker.peksag #30411: git doesn't support "-C" args under 1.8.5 occurs in configure. https://bugs.python.org/issue30411 closed by xiang.zhang #34170: Py_Initialize(): computing path configuration must not have si https://bugs.python.org/issue34170 closed by vstinner #34318: Convert deprecated behavior of assertRaises() etc into errors https://bugs.python.org/issue34318 closed by serhiy.storchaka #34381: Make tests with outbound connection optional https://bugs.python.org/issue34381 closed by terry.reedy #34412: strsignal(3) does not exist on HP-UX https://bugs.python.org/issue34412 closed by berker.peksag #34413: Porting section of 3.5 "What's New" doc does not mention bytec https://bugs.python.org/issue34413 closed by eric.snow #34415: Typo in logging.Formatter docstring https://bugs.python.org/issue34415 closed by vinay.sajip #34416: PyCapsule_Import seems to release the GIL without acquiring it https://bugs.python.org/issue34416 closed by brett.cannon #34417: imp.find_module reacts badly to iterator https://bugs.python.org/issue34417 closed by eric.snow #34425: :s formatting broken for objects without __format__ https://bugs.python.org/issue34425 closed by martin.panter #34432: doc Mention complex and decimal.Decimal on str.format note abo https://bugs.python.org/issue34432 closed by eric.smith #34435: Missing NULL check in unicode_encode_ucs1() https://bugs.python.org/issue34435 closed by serhiy.storchaka #34436: Overallocation is never disabled in _PyBytes_FormatEx() https://bugs.python.org/issue34436 closed by izbyshev #34437: print statement using \x results in improper and extra bytes https://bugs.python.org/issue34437 closed by steven.daprano #34438: do_handshake stuck in ssl.py https://bugs.python.org/issue34438 closed by christian.heimes #34440: Certificate verify failed (works fine in 3.6) https://bugs.python.org/issue34440 closed by christian.heimes #34441: NULL dereference when issubclass() is called on a class with b https://bugs.python.org/issue34441 closed by izbyshev #34452: docs: help text for [>>>] toggle always in English https://bugs.python.org/issue34452 closed by Mariatta #34454: datetime: NULL dereference in fromisoformat() on PyUnicode_AsU https://bugs.python.org/issue34454 closed by taleinat #34456: pickle: Missing NULL check in save_global() https://bugs.python.org/issue34456 closed by izbyshev #34457: Missing NULL check in alias_for_import_name() from Python/ast. https://bugs.python.org/issue34457 closed by serhiy.storchaka #34462: _xxsubinterpreters: Wrong NULL check in _copy_raw_string() https://bugs.python.org/issue34462 closed by berker.peksag #34468: An always-false condition in range_repr() from Objects/rangeob https://bugs.python.org/issue34468 closed by benjamin.peterson #34469: windows msi in headless mode fails to install Script directory https://bugs.python.org/issue34469 closed by cdknorow #34471: _datetime: Missing NULL check in tzinfo_from_isoformat_results https://bugs.python.org/issue34471 closed by benjamin.peterson #34473: pip is unusable on Windows 10 1803 - SHA-1 certificates are un https://bugs.python.org/issue34473 closed by mtuttle #34474: Python/bltinmodule.c: Missing NULL check in builtin_sum_impl() https://bugs.python.org/issue34474 closed by benjamin.peterson #34477: Objects/typeobject.c: Missing NULL check in type_init() https://bugs.python.org/issue34477 closed by benjamin.peterson

1 0