[New-bugs-announce] [issue33873] False positives when running refleaks tests with -R 1:1

[Pablo Galindo Salgado]

New submission from Pablo Galindo Salgado <pablogsal at gmail.com>:

I am not sure is a problem we can do something about but right know if you run the refleak tests with low repetitions it reports leaks:

./python -m test test_list -R 1:1
Run tests sequentially
0:00:00 load avg: 0.66 [1/1] test_list
beginning 2 repetitions
12
..

test_list leaked [3] memory blocks, sum=3
test_list failed

== Tests result: FAILURE ==

1 test failed:
    test_list

Total duration: 1 sec 759 ms
Tests result: FAILURE

This also happens with other low numbers: 

./python -m test test_list -R 1:2

Obviously using this numbers is "wrong" (there is not enough repetitions to get meaningful results). The only problem I see is that if you are not aware of this limitation (in the case this is a real limitation on how `dash_R` works) the output is a bit misleading. 

Should we leave this as it is or try to improve the output?

----------
components: Tests
messages: 319688
nosy: pablogsal, serhiy.storchaka, vstinner
priority: normal
severity: normal
status: open
title: False positives when running refleaks tests with -R 1:1
type: behavior
versions: Python 3.8

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue33873>
_______________________________________