FPLRA (Single Query Track)

Competition results for the FPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 27
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
CVC4	CVC4	CVC4	—	CVC4

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
CVC4	0	15	12941.13	12943.354	15	15	0	12		10	0
UltimateEliminator+MathSAT	0	0	86.704	60.352	0	0	0	27		0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
CVC4	0	15	12942.88	12942.924	15	15	0	12		10	0
UltimateEliminator+MathSAT	0	0	86.704	60.352	0	0	0	27		0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	15	2140.235	2140.279	15	15	0	12	10	0
UltimateEliminator+MathSAT	0	0	51.567	35.689	0	0	0	27	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	0	0.0	0.0	0	0	0	27	10	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	27	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
CVC4	0	13	295.95	295.945	13	13	0	14		12	0
UltimateEliminator+MathSAT	0	0	86.704	60.352	0	0	0	27		0	0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.