SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

ANIA (Single Query Track)

Competition results for the ANIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:53 +0000

Benchmarks: 56
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 iProver cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 3 0.062 0.06330535 0
iProver 0 1 1.91 0.6511015555 0
iProver Fixedn 0 1 1.96 0.6521015555 0
Vampire 0 0 0.0 0.0000560 0
UltimateEliminator+MathSAT 0 0 0.0 0.0000560 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 30.0620.06330535 0
iProver 0 11.910.6511015555 0
iProver Fixedn 0 11.960.6521015555 0
Vampire 0 00.00.0000560 0
UltimateEliminator+MathSAT 0 00.00.0000560 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 30.0620.063300535 0
Vampire 0 00.00.00003530 0
UltimateEliminator+MathSAT 0 00.00.00003530 0
iProver 0 00.00.000035355 0
iProver Fixedn 0 00.00.000035355 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
iProver 0 11.910.65110105555 0
iProver Fixedn 0 11.960.65210105555 0
Vampire 0 00.00.00001550 0
cvc5 0 00.00.00001555 0
UltimateEliminator+MathSAT 0 00.00.00001550 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 30.0620.06330535 0
iProver 0 11.910.6511015555 0
iProver Fixedn 0 11.960.6521015555 0
Vampire 0 00.00.0000560 0
UltimateEliminator+MathSAT 0 00.00.0000561 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.