ABV (Single Query Track)

Competition results for the ABV logic in the Single Query Track.

Page generated on 2021-07-18 17:29:04 +0000

Benchmarks: 169
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3n	0	45	114494.144	114720.193	45	24	21	124	92	0
2020-z3n	0	41	118514.888	118529.231	41	24	17	128	95	0
cvc5 - fixedn	0	34	105287.496	128364.089	34	12	22	135	85	0
cvc5	0	34	105664.585	131622.154	34	12	22	135	92	0
2020-CVC4n	0	19	7.57	7.512	19	6	13	150	0	0
UltimateEliminator+MathSAT	0	1	6804.981	6589.494	1	0	1	168	3	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3n	0	45	114690.974	114716.653	45	24	21	124	92	0
2020-z3n	0	41	118525.118	118525.711	41	24	17	128	95	0
cvc5 - fixedn	0	34	127192.28	128357.869	34	12	22	135	85	0
cvc5	0	34	130821.016	131617.264	34	12	22	135	92	0
2020-CVC4n	0	19	7.57	7.512	19	6	13	150	0	0
UltimateEliminator+MathSAT	0	1	6804.981	6589.494	1	0	1	168	3	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-z3n	0	24	3619.053	3619.056	24	24	0	4	141	95	0
z3n	0	24	4801.471	4801.472	24	24	0	4	141	92	0
cvc5	0	12	14208.999	14244.543	12	12	0	16	141	92	0
cvc5 - fixedn	0	12	14722.52	14785.694	12	12	0	16	141	85	0
2020-CVC4n	0	6	1.628	1.618	6	6	0	22	141	0	0
UltimateEliminator+MathSAT	0	0	1333.59	1280.331	0	0	0	28	141	3	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5 - fixedn	0	22	2873.863	2935.649	22	0	22	3	144	85	0
cvc5	0	22	3471.414	3504.445	22	0	22	3	144	92	0
z3n	0	21	2981.052	2981.151	21	0	21	4	144	92	0
2020-z3n	0	17	8220.379	8220.406	17	0	17	8	144	95	0
2020-CVC4n	0	13	2.855	2.846	13	0	13	12	144	0	0
UltimateEliminator+MathSAT	0	1	608.125	474.904	1	0	1	24	144	3	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3n	0	45	2742.712	2742.734	45	24	21	124	107	0
2020-z3n	0	40	2894.03	2894.042	40	24	16	129	114	0
cvc5 - fixedn	0	32	3298.973	3298.954	32	12	20	137	137	0
cvc5	0	32	3299.098	3299.087	32	12	20	137	137	0
2020-CVC4n	0	19	7.57	7.512	19	6	13	150	0	0
UltimateEliminator+MathSAT	0	0	1047.999	730.935	0	0	0	169	10	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.