QF_ABVFP (Single Query Track)

Competition results for the QF_ABVFP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 600
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	600	2151.74	2131.775	600	104	496	0	0	0
MathSATn	0	595	12888.664	12815.647	595	104	491	5	5	0
2021-cvc5n	0	593	19333.196	19232.775	593	102	491	7	7	0
cvc5	0	591	21914.657	21817.595	591	102	489	9	9	0
z3-4.8.17n	0	555	93363.834	93313.967	555	101	454	45	44	0
COLIBRI	0	495	41261.919	41243.658	495	96	399	105	30	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	600	2151.74	2131.775	600	104	496	0	0	0
MathSATn	0	595	12889.374	12815.357	595	104	491	5	5	0
2021-cvc5n	0	593	19334.406	19232.355	593	102	491	7	7	0
cvc5	0	591	21917.117	21817.015	591	102	489	9	9	0
z3-4.8.17n	0	555	93372.634	93311.907	555	101	454	45	44	0
COLIBRI	0	495	41261.919	41243.658	495	96	399	105	30	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	104	146.167	146.244	104	104	0	0	496	0	0
MathSATn	0	104	792.027	789.155	104	104	0	0	496	5	0
2021-cvc5n	0	102	2886.481	2872.306	102	102	0	2	496	7	0
cvc5	0	102	3567.126	3547.969	102	102	0	2	496	9	0
z3-4.8.17n	0	101	8588.528	8590.022	101	101	0	3	496	44	0
COLIBRI	0	96	3797.192	3794.793	96	96	0	8	496	30	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	496	2005.573	1985.531	496	0	496	0	104	0	0
MathSATn	0	491	12097.347	12026.201	491	0	491	5	104	5	0
2021-cvc5n	0	491	16447.925	16360.049	491	0	491	5	104	7	0
cvc5	0	489	18349.992	18269.046	489	0	489	7	104	9	0
z3-4.8.17n	0	454	84784.105	84721.885	454	0	454	42	104	44	0
COLIBRI	0	399	37464.727	37448.865	399	0	399	97	104	30	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	586	1029.066	1008.94	586	103	483	14	14	0
MathSATn	0	569	2627.858	2594.718	569	99	470	31	31	0
2021-cvc5n	0	508	4334.069	4230.913	508	100	408	92	92	0
cvc5	0	491	4531.927	4470.212	491	85	406	109	109	0
COLIBRI	0	488	2611.992	2593.372	488	94	394	112	38	0
z3-4.8.17n	0	335	7859.646	7856.575	335	74	261	265	265	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.