[Python-Dev] Failing tests [Was: Re: Python 3.7.0 is now available! (and so is 3.6.6)]

[Victor Stinner]

Hi,

2018-07-01 23:48 GMT+02:00 Matěj Cepl <mcepl at cepl.eu>:
> I am working on updating openSUSE packages to python 3.7, but
> I have hit quite large number of failing tests (the testsuite
> obviously passed with 3.6), see
> https://build.opensuse.org/package/show/home:mcepl:work/python3
> (click on the red "failed" label to get logs).

I created https://bugs.python.org/issue34022

> I fell into
> a bout of depression, only to discover that we are not alone in
> this problem ... Debian doesn't seem to do much better
> https://is.gd/HKBU4j.

It seems like it's the same failures.

I'm running the Python test suite every day on Fedora and all tests
pass. We also run tests multiple times per day on Travis CI (Ubuntu)
and buildbots (Debian, Gentoo, RHEL, SLES).

Wait, there is a SLES buildbot and all tests pass except of
test_gdb.test_threads(). SLES is OpenSUSE no?

The Debian buildbot is green on all branches.

Ned Deily:
> Without doing a detailed analysis of how your build system is set up, I do note you have "--enable-shared" set on ./configure which is often the source of problems.

We have 2 buildbot builders testing this configuration, on FreeBSD and Ubuntu.

I just ran the full test suite on my Fedora using --enable-shared: all
tests pass.
---
$ ./configure --enable-shared
$ make
$ LD_LIBRARY_PATH=$PWD ./python -m test -r -j0
397 tests OK.
Total duration: 3 min 9 sec
Tests result: SUCCESS
---

I also tried after installing Python: all tests pass as well.
---
./configure --enable-shared --prefix=/opt/py37 && make install
LD_LIBRARY_PATH=/opt/py37/lib /opt/py37/bin/python3 -m test -r -j0
---

Victor