SMT-COMP 2024

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

SMT-COMP 2024

QF_Bitvec (Model Validation Track)

Competition results for the QF_Bitvec division in the Model Validation Track.

Results were generated on 2024-07-08

Benchmarks: 8215
Time Limit: 1200 seconds
Memory Limit: 20480 GB

Logics:

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24 seconds Performance (parallel)
STPSTPSTP-STP

Sequential Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
STP0817857297.08431858127.575467817881780370320
Bitwuzla0816657488.23694858317.623943816681660490403
Yices20812497925.85993898760.245354812481240910910
cvc507824120629.194128121428.718629782478240391037315
SMTInterpol03951221183.527252189021.0684673960396004255034360

Parallel Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
STP0817857297.08431858127.575467817881780370320
Bitwuzla0816657488.23694858317.623943816681660490403
Yices20812497925.85993898760.245354812481240910910
cvc507824120629.194128121428.718629782478240391037315
SMTInterpol03960232371.507225199573.5541043960396004255034360

SAT Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
STP0817857297.08431858127.575467817881780370320
Bitwuzla0816657488.23694858317.623943816681660490403
Yices20812497925.85993898760.245354812481240910910
cvc507824120629.194128121428.718629782478240391037315
SMTInterpol03960232371.507225199573.5541043960396004255034360

24 seconds Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
STP0783511501.34645212287.353546783578350038000
Bitwuzla0780210269.04520611050.906276780278020041300
Yices2076775406.4825866175.111584767776770053800
cvc50705215988.41524716693.2267117052705200116300
SMTInterpol0322621593.8117799571.181138322632260359463000