BVFP (Single Query Track)

Competition results for the BVFP logic in the Single Query Track.

Page generated on 2021-07-18 17:29:05 +0000

Benchmarks: 205
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	127	91759.058	95563.037	127	120	7	78	78	0
2020-CVC4n	0	109	21062.342	21066.744	109	105	4	96	17	0
UltimateEliminator+MathSAT	0	22	1367.4	972.163	22	22	0	183	0	0
2019-Z3n	0	0	41283.291	41294.339	0	0	0	205	28	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	127	95556.204	95559.057	127	120	7	78	78	0
2020-CVC4n	0	109	21066.102	21066.164	109	105	4	96	17	0
UltimateEliminator+MathSAT	0	22	1367.4	972.163	22	22	0	183	0	0
2019-Z3n	0	0	41290.801	41293.149	0	0	0	205	28	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	120	4833.232	4835.83	120	120	0	3	82	78	0
2020-CVC4n	0	105	6027.637	6027.611	105	105	0	18	82	17	0
UltimateEliminator+MathSAT	0	22	918.98	669.128	22	22	0	101	82	0	0
2019-Z3n	0	0	21732.154	21733.582	0	0	0	123	82	28	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	7	722.971	723.227	7	0	7	0	198	78	0
2020-CVC4n	0	4	579.547	579.64	4	0	4	3	198	17	0
UltimateEliminator+MathSAT	0	0	42.222	41.147	0	0	0	7	198	0	0
2019-Z3n	0	0	3260.478	3260.654	0	0	0	7	198	28	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	119	2128.97	2128.922	119	116	3	86	86	0
2020-CVC4n	0	105	591.306	591.274	105	105	0	100	21	0
UltimateEliminator+MathSAT	0	16	1263.18	883.305	16	16	0	189	6	0
2019-Z3n	0	0	1686.011	1686.078	0	0	0	205	50	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.