New issue 894: Test suite does not detect load function breakage https://bitbucket.org/yt_analysis/yt/issue/894/test-suite-does-not-detect-lo...
This issue came up regarding PR 1190. Currently, if one breaks the code in such a way that the load function fails for certain datasets, the test suite will skip those datasets instead of reporting a failure.
IME, breaking the _is_valid methods is really easy to do when doing frontend work, and it be nice if the answer tests reported a failure when this happens.
As Nathan suggested in IRC, the requires_ds decorator probably just needs to be made smarter.