ABV (Single Query Track)

Competition results for the ABV logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 169
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	90	84682.076	84692.341	90	67	23	79	68	0
2021-cvc5n	0	34	98303.014	121022.978	34	11	23	135	80	0
cvc5	0	34	108681.711	110953.437	34	11	23	135	70	0
UltimateEliminator+MathSAT	0	1	3717.685	3316.504	1	0	1	168	1	1
Bitwuzla	0	0	0.769	2.491	0	0	0	169	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	90	84689.766	84689.991	90	67	23	79	68	0
cvc5	0	34	110291.171	110948.477	34	11	23	135	70	0
2021-cvc5n	0	34	119937.0	121018.968	34	11	23	135	80	0
UltimateEliminator+MathSAT	0	1	3717.685	3316.504	1	0	1	168	1	1
Bitwuzla	0	0	0.769	2.491	0	0	0	169	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	67	2455.454	2455.337	67	67	0	2	100	68	0
cvc5	0	11	37379.205	37792.196	11	11	0	58	100	70	0
2021-cvc5n	0	11	40700.642	41331.535	11	11	0	58	100	80	0
Bitwuzla	0	0	0.323	1.074	0	0	0	69	100	0	0
UltimateEliminator+MathSAT	0	0	1849.983	1673.288	0	0	0	69	100	1	1

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	23	2458.604	2458.928	23	0	23	4	142	68	0
cvc5	0	23	2526.733	2645.866	23	0	23	4	142	70	0
2021-cvc5n	0	23	3291.435	3387.842	23	0	23	4	142	80	0
UltimateEliminator+MathSAT	0	1	186.211	107.053	1	0	1	26	142	1	1
Bitwuzla	0	0	0.124	0.385	0	0	0	27	142	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	89	1992.423	1992.27	89	67	22	80	80	0
2021-cvc5n	0	32	3305.076	3305.213	32	11	21	137	137	0
cvc5	0	29	3377.223	3377.288	29	10	19	140	140	0
UltimateEliminator+MathSAT	0	1	985.593	642.379	1	0	1	168	5	1
Bitwuzla	0	0	0.769	2.491	0	0	0	169	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.