[New-bugs-announce] [issue13954] Add regrtest option to record test results to a file

[Brett Cannon]

New submission from Brett Cannon <brett at python.org>:

The idea is that if a test succeeded then it is written to a file commented out(including skipped tests w/ the appropriate comment), and if a test failed then it is left uncommented. This way the failing tests can simply be passed to --fromfile for easy repeatability. This becomes especially handy when randomizing test order and there is some dependency on a previously run test as you can begin to uncomment tests until you find the trigger.

This can also be used with some other new flag which lists which tests to skip (i.e. the inverse of --fromfile). This is helpful when you don't want to run tests in some branch when you know they are failing in the default branch already and you are not trying to fix them.

----------
components: Tests
messages: 152771
nosy: brett.cannon
priority: normal
severity: normal
stage: needs patch
status: open
title: Add regrtest option to record test results to a file
versions: Python 3.3

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue13954>
_______________________________________