panfrost: ci: Check for incomplete runs
authorTomeu Vizoso <tomeu.vizoso@collabora.com>
Tue, 7 May 2019 06:44:03 +0000 (08:44 +0200)
committerTomeu Vizoso <tomeu.vizoso@collabora.com>
Fri, 10 May 2019 05:37:05 +0000 (07:37 +0200)
To improve robustness, check that we got the expected number of results.
Right now we hard-code the expected number of tests run, but with some
effort we may be able to infer it.

Signed-off-by: Tomeu Vizoso <tomeu.vizoso@collabora.com>
Reviewed-by: Alyssa Rosenzweig <alyssa@rosenzweig.io>
src/gallium/drivers/panfrost/ci/gitlab-ci.yml

index af8019b033924814799a1fa5c52e199985d7d73a..635d7b04bcdedc74dd2d1b3f0176e44453806a30 100644 (file)
@@ -192,6 +192,7 @@ build-arm64:
     - 'echo "Passed: $PASSED ($(expr $PASSED \* 100 / $TOTAL)%)"'
     - 'echo "Failed: $FAILED ($(expr $FAILED \* 100 / $TOTAL)%)"'
     - 'echo "Total: $TOTAL"'
+    - 'if [ $TOTAL != 17439 ]; then echo "WARNING: Unexpected count of results. Incomplete run?"; fi'
 
     - sed '/,pass/d' results/results-$lava_job_id.csv | sed 's/,fail//' > results/failures-$lava_job_id.txt
     - diff -u src/gallium/drivers/panfrost/ci/expected-failures.txt results/failures-$lava_job_id.txt