ABVFPLRA (Single Query Track)

Competition results for the ABVFPLRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 75
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	47	32274.347	32279.365	47	45	2	28	26	0
cvc5	0	36	51088.89	51147.759	36	32	4	39	39	0
2021-cvc5n	0	22	54786.641	54845.515	22	18	4	53	45	0
UltimateEliminator+MathSAT	0	10	426.57	298.247	10	10	0	65	0	0
Bitwuzla	0	0	0.33	0.918	0	0	0	75	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	47	32278.097	32278.115	47	45	2	28	26	0
cvc5	0	36	51132.21	51145.989	36	32	4	39	39	0
2021-cvc5n	0	22	54837.161	54843.595	22	18	4	53	45	0
UltimateEliminator+MathSAT	0	10	426.57	298.247	10	10	0	65	0	0
Bitwuzla	0	0	0.33	0.918	0	0	0	75	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	45	3.735	3.648	45	45	0	0	30	26	0
cvc5	0	32	19877.908	19891.677	32	32	0	13	30	39	0
2021-cvc5n	0	18	32701.813	32701.898	18	18	0	27	30	45	0
UltimateEliminator+MathSAT	0	10	285.78	201.349	10	10	0	35	30	0	0
Bitwuzla	0	0	0.198	0.549	0	0	0	45	30	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2021-cvc5n	0	4	34.5	34.502	4	0	4	0	71	45	0
cvc5	0	4	54.302	54.312	4	0	4	0	71	39	0
z3-4.8.17n	0	2	2274.201	2274.307	2	0	2	2	71	26	0
Bitwuzla	0	0	0.017	0.049	0	0	0	4	71	0	0
UltimateEliminator+MathSAT	0	0	18.052	11.228	0	0	0	4	71	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	46	658.247	658.155	46	45	1	29	27	0
cvc5	0	21	1324.831	1324.83	21	18	3	54	54	0
2021-cvc5n	0	20	1201.055	1201.04	20	17	3	55	49	0
UltimateEliminator+MathSAT	0	10	426.57	298.247	10	10	0	65	0	0
Bitwuzla	0	0	0.33	0.918	0	0	0	75	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.