SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_SLIA (Single Query Track)

Competition results for the QF_SLIA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 26930
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 CVC4

Note: the division has disagreements

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 26696 408908.954 410843.413266961654010156234233 0
Z3str4 0 23362 4216303.028 4214729.31523362133381002435683501 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 26696 409225.784 410833.113266961654010156234233 0
Z3str4 0 23362 4216352.488 4214720.32523362133381002435683501 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 16540 139125.614 140490.5971654016540010390233 0
Z3str4 0 13338 3868493.019 3867185.06413338133380135923501 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 10156 27694.387 27936.7331015601015616774233 0
Z3str4 0 10024 119698.239 119435.61810024010024169063501 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 26165 28442.194 28360.891261651610010065765764 0
Z3str4 0 23323 90164.637 88562.58423323132991002436073541 0

n Non-competing.