SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_FPArith (Single Query Track)

Competition results for the QF_FPArith division in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 1442
Time Limit: 1200 seconds
Memory Limit: 60 GB

Logics:

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 1386 27893.071 27844.487138650787956056 0
Bitwuzla Fixedn 0 1386 27980.926 27918.632138650787956056 0
2022-Bitwuzlan 0 1374 26288.753 26293.004137449787768052 0
cvc5 0 1258 52579.513 52543.2161258474784184081 0
COLIBRI 0 1206 4372.757 4345.03312064637432360110 0
Z3-Owl Fixedn 0 570 55841.523 55756.141570253317117755117 0
Z3-Owl 357 330 269.291 269.287330304263577550 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 138627893.07127844.487138650787956056 0
Bitwuzla Fixedn 0 138627980.92627918.632138650787956056 0
2022-Bitwuzlan 0 137426288.75326293.004137449787768052 0
cvc5 0 125852579.51352543.2161258474784184081 0
COLIBRI 0 12064372.7574345.03312064637432360110 0
Z3-Owl Fixedn 0 57055841.52355756.141570253317117755117 0
Z3-Owl 357 330269.291269.287330304263577550 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 5077848.1617840.73150750701991656 0
Bitwuzla Fixedn 0 5077870.5817863.48850750701991656 0
2022-Bitwuzlan 0 4978814.2648816.30249749702991652 0
cvc5 0 47410760.37410730.27947447405291681 0
COLIBRI 0 4632288.6532283.283463463063916110 0
Z3-Owl Fixedn 0 25323721.21823683.4382532530511138117 0
Z3-Owl 357 304217.641217.6193043040011380 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 87920044.9120003.75687908793752656 0
Bitwuzla Fixedn 0 87920110.34520055.14587908793752656 0
2022-Bitwuzlan 0 87717474.4917476.70287708773952652 0
cvc5 0 78441819.13841812.938784078413252681 0
COLIBRI 0 7432084.1042061.757430743173526110 0
Z3-Owl Fixedn 0 31732120.30532072.7033170317661059117 0
Z3-Owl 0 2651.6551.6682602635710590 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla Fixedn 0 12852011.3231997.13412854678181570157 0
Bitwuzla 0 12852050.611998.07312854678181570157 0
2022-Bitwuzlan 0 12671857.4811857.16912674568111750159 0
COLIBRI 0 11832382.682354.70811834517322590133 0
cvc5 0 9854210.144165.1219853875984570354 0
Z3-Owl Fixedn 0 3012868.1392848.425301132169386755386 0
Z3-Owl 357 330269.291269.287330304263577550 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.