BVFPLRA (Single Query Track)

Competition results for the BVFPLRA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:05 +0000

Benchmarks: 185
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	96	66061.983	66071.193	96	91	5	89	55	0
2020-CVC4n	0	92	66024.663	66037.656	92	87	5	93	55	0
UltimateEliminator+MathSAT	0	38	1315.147	967.172	38	33	5	147	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	96	66069.493	66069.453	96	91	5	89	55	0
2020-CVC4n	0	92	66035.193	66035.176	92	87	5	93	55	0
UltimateEliminator+MathSAT	0	38	1315.147	967.172	38	33	5	147	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	91	6040.729	6040.694	91	91	0	6	88	55	0
2020-CVC4n	0	87	6019.154	6019.141	87	87	0	10	88	55	0
UltimateEliminator+MathSAT	0	33	695.794	517.082	33	33	0	64	88	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-CVC4n	0	5	7.909	7.908	5	0	5	0	180	55	0
cvc5	0	5	18.732	18.735	5	0	5	0	180	55	0
UltimateEliminator+MathSAT	0	5	48.285	37.366	5	0	5	0	180	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	96	1389.493	1389.453	96	91	5	89	55	0
2020-CVC4n	0	92	1355.193	1355.176	92	87	5	93	55	0
UltimateEliminator+MathSAT	0	38	1290.979	948.772	38	33	5	147	3	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.