ABVFPLRA (Single Query Track)

Competition results for the ABVFPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 75
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
CVC4	CVC4	CVC4	CVC4	CVC4

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
CVC4	0	18	16949.738	16951.703	18	16	2	57		13	0
UltimateEliminator+MathSAT	0	0	249.949	167.428	0	0	0	75		0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
CVC4	0	18	16951.008	16951.223	18	16	2	57		13	0
UltimateEliminator+MathSAT	0	0	249.949	167.428	0	0	0	75		0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	16	2.14	2.135	16	16	0	59	13	0
UltimateEliminator+MathSAT	0	0	54.625	35.697	0	0	0	75	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	2	4.161	4.161	2	0	2	73	13	0
UltimateEliminator+MathSAT	0	0	6.333	4.428	0	0	0	75	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
CVC4	0	18	370.054	370.038	18	16	2	57		15	0
UltimateEliminator+MathSAT	0	0	249.949	167.428	0	0	0	75		0	0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.