SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_FPArith (Single Query Track)

Competition results for the QF_FPArith division in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 1500
Time Limit: 1200 seconds
Memory Limit: 60 GB

Logics:

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 1439 82604.868 82577.783143954989061045 0
cvc5 0 1429 132292.259 132136.806142954988071071 0
2021-cvc5n 0 1423 133834.826 133708.602142354288177077 0
MathSATn 0 1386 159982.817 159934.20113865348521140103 0
z3-4.8.17n 0 1316 294174.216 304576.62313165048121840156 4
COLIBRI 0 1267 144280.522 144248.22612675167512321112 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 143982610.63882576.183143954989061045 0
cvc5 0 1429132305.219132133.386142954988071071 0
2021-cvc5n 0 1423133847.276133704.732142354288177077 0
MathSATn 0 1386160001.767159929.90113865348521140103 0
z3-4.8.17n 0 1316294675.736304569.52313165048121840156 4
COLIBRI 0 1267144280.522144248.22612675167512321112 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 54913236.78813231.95254954901493745 0
cvc5 0 54929685.15929659.44754954901493771 0
2021-cvc5n 0 54235449.63835407.37754254202193777 0
MathSATn 0 53439717.30939716.76534534029937103 0
COLIBRI 0 51635992.86635976.572516516046938112 0
z3-4.8.17n 0 50488235.96795171.904504504059937156 4

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 89057373.8557344.23189008903757345 0
2021-cvc5n 0 88186397.63886297.35488108814657377 0
cvc5 0 88090620.0690473.93988008804757371 0
MathSATn 0 852108284.458108213.141852085275573103 0
z3-4.8.17n 0 812194439.769197397.6198120812115573156 4
COLIBRI 0 75196287.65596271.6547510751176573112 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 13285623.6355584.68213285068221720156 0
COLIBRI 0 12326305.4876272.50812325057272671148 0
MathSATn 0 12299755.249717.12812294637662710260 0
2021-cvc5n 0 121811580.34211431.62912184847342820282 0
cvc5 0 119211839.63211701.88611924637293080308 0
z3-4.8.17n 0 89818246.09218236.5778983765226020598 4

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.