SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_AUFLIA (Single Query Track)

Competition results for the QF_AUFLIA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 467
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
Yices2Yices2Yices2 Yices2 Yices2

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-Yices 2.6.2n 0 467 12.965 15.47746721525200 0
Yices2-fixedn 0 467 15.002 18.33546721525200 0
Yices2 0 467 15.128 17.39646721525200 0
z3n 0 467 19.084 19.14446721525200 0
MathSAT5n 0 467 97.9 98.05746721525200 0
CVC4 0 467 109.114 109.22346721525200 0
SMTInterpol 0 467 602.999 286.51446721525200 0
SMTInterpol-fixedn 0 467 609.553 282.68446721525200 0
Alt-Ergo 0 221 82271.363 60767.213221022124644 0
veriT 0 51 6.185 7.124510514160 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-Yices 2.6.2n 0 467 12.965 15.47746721525200 0
Yices2 0 467 15.128 17.39646721525200 0
Yices2-fixedn 0 467 15.002 18.33546721525200 0
z3n 0 467 19.084 19.14446721525200 0
MathSAT5n 0 467 97.9 98.05746721525200 0
CVC4 0 467 109.114 109.22346721525200 0
SMTInterpol-fixedn 0 467 609.553 282.68446721525200 0
SMTInterpol 0 467 602.999 286.51446721525200 0
Alt-Ergo 0 237 103047.773 45753.21237023723021 0
veriT 0 51 6.185 7.124510514160 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices2 0 215 3.76 4.91721521502520 0
2019-Yices 2.6.2n 0 215 3.63 4.9921521502520 0
Yices2-fixedn 0 215 3.711 5.52121521502520 0
z3n 0 215 7.948 7.97921521502520 0
MathSAT5n 0 215 32.298 32.35221521502520 0
CVC4 0 215 66.974 67.03321521502520 0
SMTInterpol-fixedn 0 215 189.764 98.30221521502520 0
SMTInterpol 0 215 190.372 101.93921521502520 0
veriT 0 0 2.885 3.2870004670 0
Alt-Ergo 0 0 30366.264 13967.27800046721 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-Yices 2.6.2n 0 252 9.336 10.48725202522150 0
z3n 0 252 11.136 11.16525202522150 0
Yices2 0 252 11.367 12.47925202522150 0
Yices2-fixedn 0 252 11.291 12.81425202522150 0
CVC4 0 252 42.141 42.1925202522150 0
MathSAT5n 0 252 65.603 65.70525202522150 0
SMTInterpol-fixedn 0 252 419.789 184.38225202522150 0
SMTInterpol 0 252 412.627 184.57525202522150 0
Alt-Ergo 0 237 72681.509 31785.932237023723021 0
veriT 0 51 3.301 3.837510514160 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-Yices 2.6.2n 0 467 12.965 15.47746721525200 0
Yices2 0 467 15.128 17.39646721525200 0
Yices2-fixedn 0 467 15.002 18.33546721525200 0
z3n 0 467 19.084 19.14446721525200 0
MathSAT5n 0 467 97.9 98.05746721525200 0
CVC4 0 467 109.114 109.22346721525200 0
SMTInterpol-fixedn 0 467 609.553 282.68446721525200 0
SMTInterpol 0 467 602.999 286.51446721525200 0
Alt-Ergo 0 188 6835.119 3942.3081880188279118 0
veriT 0 51 6.185 7.124510514160 0

n Non-competing.