New issue 894: Test suite does not detect load function breakage https://bitbucket.org/yt_analysis/yt/issue/894/test-suite-does-not-detect-lo...

Andrew Myers:

This issue came up regarding PR 1190. Currently, if one breaks the code in such a way that the load function fails for certain datasets, the test suite will skip those datasets instead of reporting a failure.

IME, breaking the _is_valid methods is really easy to do when doing frontend work, and it be nice if the answer tests reported a failure when this happens.

As Nathan suggested in IRC, the requires_ds decorator probably just needs to be made smarter.

Responsible: atmyers