QF_UFBV (Single Query Track)

Competition results for the QF_UFBV logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Yices2	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	293	17992.565	17990.603	293	160	133	7	7	0
2020-Bitwuzlan	0	286	16323.542	16325.524	286	160	126	14	6	0
cvc5	0	272	67777.777	67730.297	272	153	119	28	28	0
z3-4.8.17n	0	266	67368.734	67353.77	266	146	120	34	34	0
Yices2	0	259	77903.499	77910.672	259	160	99	41	41	0
MathSATn	0	242	94067.044	94075.723	242	142	100	58	58	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	293	17993.885	17990.353	293	160	133	7	7	0
2020-Bitwuzlan	0	286	16324.722	16325.084	286	160	126	14	6	0
cvc5	0	272	67784.757	67728.537	272	153	119	28	28	0
z3-4.8.17n	0	266	67375.544	67351.99	266	146	120	34	34	0
Yices2	0	259	77905.859	77909.542	259	160	99	41	41	0
MathSATn	0	242	94079.844	94073.183	242	142	100	58	58	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-Bitwuzlan	0	160	4485.833	4486.31	160	160	0	3	137	6	0
Yices2	0	160	4690.08	4690.226	160	160	0	3	137	41	0
Bitwuzla	0	160	5376.727	5371.991	160	160	0	3	137	7	0
cvc5	0	153	20604.533	20594.962	153	153	0	10	137	28	0
z3-4.8.17n	0	146	27935.981	27909.465	146	146	0	17	137	34	0
MathSATn	0	142	26995.589	26984.723	142	142	0	21	137	58	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	133	12617.158	12618.362	133	0	133	4	163	7	0
2020-Bitwuzlan	0	126	11838.889	11838.774	126	0	126	11	163	6	0
z3-4.8.17n	0	120	39439.563	39442.525	120	0	120	17	163	34	0
cvc5	0	119	47180.224	47133.575	119	0	119	18	163	28	0
MathSATn	0	100	67084.255	67088.46	100	0	100	37	163	58	0
Yices2	0	99	73215.779	73219.316	99	0	99	38	163	41	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	204	3115.442	3110.477	204	134	70	96	96	0
Yices2	0	200	2775.106	2775.19	200	153	47	100	100	0
2020-Bitwuzlan	0	200	2989.836	2988.535	200	131	69	100	92	0
MathSATn	0	159	3839.765	3827.163	159	119	40	141	141	0
z3-4.8.17n	0	151	3870.85	3870.633	151	109	42	149	149	0
cvc5	0	147	4676.405	4664.796	147	109	38	153	153	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.