On Wed, 15 Mar 2017 at 17:03 Barry Warsaw <barry@python.org> wrote:
On Mar 16, 2017, at 12:00 AM, Brett Cannon wrote:

>But that would require that external contributors know to set that label
>ahead of time and I'm willing to bet most won't.

Not if the test has a retry feature.  Your change is trivial but you didn't
add the label.  The test fails.  You add the label and retry the test.  Now it
passes.

Ah, you didn't say you wanted this to be a status check. :) Do we want to go so far as that rather than a comment or PR template?