Currently we run all unit and answer tests on every push. Running answer
testing, particularly with FLASH data, takes a long time. (Sidenote: FLASH in
2.x is particularly bad for large data objects, which answer testing does.)
This will get worse once Orion and Chombo have been added. I think we're
looking at up to 15 minutes per run. This has two effects:
1) Changes which break unit tests take longer to get reported.
2) We'll go through our ShiningPanda monthly allocation quite quickly.
There are two solutions that I see:
1) Buy more time on ShiningPanda
2) Only run answer testing at most once a day, but still run unit tests on every
My proposal is to go with #2 with the backup of #1 as needed. Can I get [+-]1
yt-dev mailing list