QF_LRA (Model Validation Track)
Competition results for the QF_LRA
logic
in the Model Validation Track.
Results were generated on 2024-07-08
Benchmarks: 494
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| winner_seq | winner_par | winner_sat | winner_unsat | winner_24s |
|---|
| OpenSMT | OpenSMT | OpenSMT | - | Yices2 |
Sequential Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 484 | 10216.05884 | 10267.599148 | 484 | 484 | 0 | 10 | 0 | 10 | 0 |
| cvc5 | 0 | 475 | 17361.119616 | 17410.631589 | 475 | 475 | 0 | 19 | 0 | 19 | 0 |
| Yices2 | 0 | 472 | 4694.813435 | 4743.272882 | 472 | 472 | 0 | 22 | 0 | 22 | 0 |
| SMTInterpol | 0 | 467 | 29879.340877 | 25694.583253 | 467 | 467 | 0 | 27 | 0 | 25 | 0 |
Parallel Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 484 | 10216.05884 | 10267.599148 | 484 | 484 | 0 | 10 | 0 | 10 | 0 |
| cvc5 | 0 | 475 | 17361.119616 | 17410.631589 | 475 | 475 | 0 | 19 | 0 | 19 | 0 |
| Yices2 | 0 | 472 | 4694.813435 | 4743.272882 | 472 | 472 | 0 | 22 | 0 | 22 | 0 |
| SMTInterpol | 0 | 467 | 29879.340877 | 25694.583253 | 467 | 467 | 0 | 27 | 0 | 25 | 0 |
SAT Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 484 | 10216.05884 | 10267.599148 | 484 | 484 | 0 | 10 | 0 | 10 | 0 |
| cvc5 | 0 | 475 | 17361.119616 | 17410.631589 | 475 | 475 | 0 | 19 | 0 | 19 | 0 |
| Yices2 | 0 | 472 | 4694.813435 | 4743.272882 | 472 | 472 | 0 | 22 | 0 | 22 | 0 |
| SMTInterpol | 0 | 467 | 29879.340877 | 25694.583253 | 467 | 467 | 0 | 27 | 0 | 25 | 0 |
24 seconds Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Yices2 | 0 | 441 | 708.740248 | 753.090415 | 441 | 441 | 0 | 0 | 53 | 0 | 0 |
| OpenSMT | 0 | 424 | 834.843205 | 877.488263 | 424 | 424 | 0 | 0 | 70 | 0 | 0 |
| cvc5 | 0 | 380 | 714.26744 | 752.325663 | 380 | 380 | 0 | 0 | 114 | 0 | 0 |
| SMTInterpol | 0 | 353 | 2072.420642 | 887.235717 | 353 | 353 | 0 | 0 | 141 | 0 | 0 |