ABVFP (Single Query Track)

Competition results for the ABVFP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 30
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	25	6024.565	6025.739	25	23	2	5	5	0
cvc5	0	18	14998.662	15041.046	18	17	1	12	12	0
2021-cvc5n	0	17	15566.952	15604.771	17	15	2	13	13	0
UltimateEliminator+MathSAT	0	10	298.697	251.602	10	10	0	20	0	0
Bitwuzla	0	0	0.134	0.366	0	0	0	30	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	25	6025.495	6025.449	25	23	2	5	5	0
cvc5	0	18	15008.112	15040.236	18	17	1	12	12	0
2021-cvc5n	0	17	15604.002	15604.011	17	15	2	13	13	0
UltimateEliminator+MathSAT	0	10	298.697	251.602	10	10	0	20	0	0
Bitwuzla	0	0	0.134	0.366	0	0	0	30	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	23	1225.417	1225.374	23	23	0	1	6	5	0
cvc5	0	17	9008.032	9040.157	17	17	0	7	6	12	0
2021-cvc5n	0	15	10803.632	10803.64	15	15	0	9	6	13	0
UltimateEliminator+MathSAT	0	10	271.703	233.267	10	10	0	14	6	0	0
Bitwuzla	0	0	0.107	0.291	0	0	0	24	6	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	2	0.079	0.075	2	0	2	0	28	5	0
2021-cvc5n	0	2	0.37	0.371	2	0	2	0	28	13	0
cvc5	0	1	1200.08	1200.079	1	0	1	1	28	12	0
Bitwuzla	0	0	0.009	0.025	0	0	0	2	28	0	0
UltimateEliminator+MathSAT	0	0	8.927	5.393	0	0	0	2	28	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	25	145.495	145.449	25	23	2	5	5	0
2021-cvc5n	0	17	316.002	316.011	17	15	2	13	13	0
cvc5	0	16	339.675	339.666	16	15	1	14	14	0
UltimateEliminator+MathSAT	0	8	229.633	188.089	8	8	0	22	2	0
Bitwuzla	0	0	0.134	0.366	0	0	0	30	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.