Remove support for *.expect files in regressions (#2341)
authorAndres Noetzli <andres.noetzli@gmail.com>
Tue, 21 Aug 2018 03:23:09 +0000 (20:23 -0700)
committerGitHub <noreply@github.com>
Tue, 21 Aug 2018 03:23:09 +0000 (20:23 -0700)
commit29b2e5a74eb007f04a18e01d7a9c21eff577c9b1
treeb6ea5c072884fd78bd3a0dfec9b0b45ebf0d3b25
parenta82837a03cf3bd33f906901f45b2c6f36cf420de
Remove support for *.expect files in regressions (#2341)

Currently, we can optionally specify an *.expect file with the metadata
of a regression test. This commit removes that option because it was not
widely used, adds maintenance overhead and makes the transition to a new
build system more cumbersome. Regression files can still be fed to a
solver without removing the metadata first since they are in comments of
the corresponding input format (note that this was not always the case,
it changed in efc6163629c6c5de446eccfe81777c93829995d5).
82 files changed:
test/regress/Makefile.am
test/regress/Makefile.tests
test/regress/README.md
test/regress/regress0/arith/miplib-opt1217--27.smt
test/regress/regress0/arith/miplib-opt1217--27.smt.expect [deleted file]
test/regress/regress0/arith/miplib-pp08a-3000.smt
test/regress/regress0/arith/miplib-pp08a-3000.smt.expect [deleted file]
test/regress/regress0/decision/aufbv-fuzz01.smt
test/regress/regress0/decision/aufbv-fuzz01.smt.expect [deleted file]
test/regress/regress0/decision/bitvec0.delta01.smt
test/regress/regress0/decision/bitvec0.delta01.smt.expect [deleted file]
test/regress/regress0/decision/bitvec0.smt
test/regress/regress0/decision/bitvec0.smt.expect [deleted file]
test/regress/regress0/decision/bitvec5.smt
test/regress/regress0/decision/bitvec5.smt.expect [deleted file]
test/regress/regress0/decision/bug347.smt
test/regress/regress0/decision/bug347.smt.expect [deleted file]
test/regress/regress0/decision/bug374a.smt
test/regress/regress0/decision/bug374a.smt.expect [deleted file]
test/regress/regress0/decision/bug374b.smt2
test/regress/regress0/decision/bug374b.smt2.expect [deleted file]
test/regress/regress0/decision/just_sat.expect [deleted file]
test/regress/regress0/decision/just_unsat.expect [deleted file]
test/regress/regress0/decision/pp-regfile.delta01.smt
test/regress/regress0/decision/pp-regfile.delta01.smt.expect [deleted file]
test/regress/regress0/decision/pp-regfile.delta02.smt
test/regress/regress0/decision/pp-regfile.delta02.smt.expect [deleted file]
test/regress/regress0/decision/quant-ex1.smt2
test/regress/regress0/decision/quant-ex1.smt2.expect [deleted file]
test/regress/regress0/decision/uflia-xs-09-16-3-4-1-5.delta03.smt
test/regress/regress0/decision/uflia-xs-09-16-3-4-1-5.delta03.smt.expect [deleted file]
test/regress/regress0/decision/uflia-xs-09-16-3-4-1-5.smt
test/regress/regress0/decision/uflia-xs-09-16-3-4-1-5.smt.expect [deleted file]
test/regress/regress0/decision/wchains010ue.delta02.smt
test/regress/regress0/decision/wchains010ue.delta02.smt.expect [deleted file]
test/regress/regress0/decision/wchains010ue.smt
test/regress/regress0/decision/wchains010ue.smt.expect [deleted file]
test/regress/regress0/expect/scrub.01.smt
test/regress/regress0/expect/scrub.01.smt.expect [deleted file]
test/regress/regress0/expect/scrub.03.smt2
test/regress/regress0/expect/scrub.03.smt2.expect [deleted file]
test/regress/regress0/quantifiers/bug291.smt2
test/regress/regress0/quantifiers/bug291.smt2.expect [deleted file]
test/regress/regress0/uflia/check02.smt2
test/regress/regress0/uflia/check02.smt2.expect [deleted file]
test/regress/regress0/uflia/check03.smt2
test/regress/regress0/uflia/check03.smt2.expect [deleted file]
test/regress/regress0/uflia/check04.smt2
test/regress/regress0/uflia/check04.smt2.expect [deleted file]
test/regress/regress0/uflia/stalmark_e7_27_e7_31.ec.minimized.smt2
test/regress/regress0/uflia/stalmark_e7_27_e7_31.ec.minimized.smt2.expect [deleted file]
test/regress/regress0/uflia/tiny.smt2
test/regress/regress0/uflia/tiny.smt2.expect [deleted file]
test/regress/regress1/bug216.smt2
test/regress/regress1/bug216.smt2.expect [deleted file]
test/regress/regress1/bug590.smt2
test/regress/regress1/bug590.smt2.expect [deleted file]
test/regress/regress1/decision/quant-Arrays_Q1-noinfer.smt2
test/regress/regress1/decision/quant-Arrays_Q1-noinfer.smt2.expect [deleted file]
test/regress/regress1/decision/quant-symmetric_unsat_7.smt2
test/regress/regress1/decision/quant-symmetric_unsat_7.smt2.expect [deleted file]
test/regress/regress1/push-pop/bug216.smt2
test/regress/regress1/push-pop/bug216.smt2.expect [deleted file]
test/regress/regress1/simplification_bug4.smt2
test/regress/regress1/simplification_bug4.smt2.expect [deleted file]
test/regress/regress1/uflia/DRAGON_11_e1_2450.ec.minimized.smt2
test/regress/regress1/uflia/DRAGON_11_e1_2450.ec.minimized.smt2.expect [deleted file]
test/regress/regress1/uflia/FIREFLY_3_e2_2236_e7_3681.ec.core.smt2
test/regress/regress1/uflia/FIREFLY_3_e2_2236_e7_3681.ec.core.smt2.expect [deleted file]
test/regress/regress1/uflia/speed2_e8_449_e8_517.ec.smt2
test/regress/regress1/uflia/speed2_e8_449_e8_517.ec.smt2.expect [deleted file]
test/regress/regress1/uflia/stalmark_e7_27_e7_31.ec.smt2
test/regress/regress1/uflia/stalmark_e7_27_e7_31.ec.smt2.expect [deleted file]
test/regress/regress2/FIREFLY_3_e2_2236_e7_3681.ec.minimized.smt2
test/regress/regress2/FIREFLY_3_e2_2236_e7_3681.ec.minimized.smt2.expect [deleted file]
test/regress/regress2/uflia-error0.smt2
test/regress/regress2/uflia-error0.smt2.expect [deleted file]
test/regress/regress2/xs-09-16-3-4-1-5.decn.smt
test/regress/regress2/xs-09-16-3-4-1-5.decn.smt.expect [deleted file]
test/regress/regress3/pp-regfile.smt
test/regress/regress3/pp-regfile.smt.expect [deleted file]
test/regress/run_regression.py