* Regression Tests - Tests that use simple 'diffs' of output (e.g. code that can be driven within shell scripts with config files).

9

* Performance Tests - Tests that evaluate runtime, cost and/or the number of iterations over a suite of test problems. (Test comparisons are made with respect to a history of previous test results.)

10

* Benchmark Tests - Test that evaluate the absolute runtime, cost and/or number of iterations over a suite of test problems. (Test comparisons are made with respect to published results and/or third-party solvers.)

11

12

The following table summarizes the types of tests that are supported within Acro, and the maturity of Acro's testing capabilities.