[Python-ideas] unittest: 0 tests pass means failure of the testsuite

Nathaniel Smith njs at pobox.com
Wed Mar 6 22:21:10 EST 2019

On Wed, Mar 6, 2019 at 12:13 PM Matěj Cepl <mcepl at cepl.eu> wrote:
> Hi,
> I am a lead maintainer of Python packages in OpenSUSE and I can
> see the pattern of many packagers adding blindly
>     python setup.py test
> to %check section of our SPEC file. The problem is that if the
> package doesn't use unittest (it actually uses nose, pytest or
> something), it could lead to zero found tests, which pass and
> Python returns exit code 0 (success) even though nothing has been
> tested. It seems from the outside that everything is all right,
> package is being tested on every build, but actually it is lie.
> Would it be possible to change unittest runner, so that when 0
> tests pass, whole test suite would end up failing?

You probably want to file a bug on the setuptools tracker:

It's maintained by different people than Python itself, and is
responsible for defining 'setup.py test'.


Nathaniel J. Smith -- https://vorpus.org

More information about the Python-ideas mailing list