QF_BVFPLRA (Single Query Track)

Competition results for the QF_BVFPLRA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:06 +0000

Benchmarks: 72
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	COLIBRI

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	64	12508.094	12507.999	64	39	25	8	8	0
cvc5	0	63	17272.26	17273.429	63	38	25	9	9	0
MathSAT5n	0	59	20399.86	20357.355	59	38	21	13	13	0
2020-MathSAT5n	0	59	20497.85	20498.064	59	38	21	13	13	0
2020-CVC4n	0	56	23550.36	23550.91	56	36	20	16	16	0
COLIBRI	0	54	8523.25	8524.511	54	30	24	18	7	0
COLIBRI - fixedn	0	54	8533.038	8520.002	54	30	24	18	7	0
2020-COLIBRIn	0	45	19325.139	19327.287	45	21	24	27	16	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	64	12508.494	12507.589	64	39	25	8	8	0
cvc5	0	63	17272.67	17273.199	63	38	25	9	9	0
MathSAT5n	0	59	20402.2	20356.645	59	38	21	13	13	0
2020-MathSAT5n	0	59	20500.41	20497.414	59	38	21	13	13	0
2020-CVC4n	0	56	23553.15	23550.32	56	36	20	16	16	0
COLIBRI - fixedn	0	54	8533.358	8519.742	54	30	24	18	7	0
COLIBRI	0	54	8524.23	8524.261	54	30	24	18	7	0
2020-COLIBRIn	0	45	19326.869	19326.887	45	21	24	27	16	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	39	172.949	172.959	39	39	0	0	33	8	0
cvc5	0	38	1713.345	1713.414	38	38	0	1	33	9	0
MathSAT5n	0	38	2397.863	2351.249	38	38	0	1	33	13	0
2020-MathSAT5n	0	38	2393.439	2391.448	38	38	0	1	33	13	0
2020-CVC4n	0	36	4784.531	4784.667	36	36	0	3	33	16	0
COLIBRI - fixedn	0	30	90.842	76.538	30	30	0	9	33	7	0
COLIBRI	0	30	81.914	81.927	30	30	0	9	33	7	0
2020-COLIBRIn	0	21	10868.378	10868.399	21	21	0	18	33	16	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	25	12335.545	12334.63	25	0	25	8	39	8	0
cvc5	0	25	15559.325	15559.785	25	0	25	8	39	9	0
COLIBRI	0	24	8442.316	8442.334	24	0	24	9	39	7	0
COLIBRI - fixedn	0	24	8442.516	8443.203	24	0	24	9	39	7	0
2020-COLIBRIn	0	24	8458.491	8458.487	24	0	24	9	39	16	0
MathSAT5n	0	21	18004.337	18005.396	21	0	21	12	39	13	0
2020-MathSAT5n	0	21	18106.971	18105.966	21	0	21	12	39	13	0
2020-CVC4n	0	20	18768.619	18765.652	20	0	20	13	39	16	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI - fixedn	0	54	301.358	287.742	54	30	24	18	7	0
COLIBRI	0	54	292.23	292.261	54	30	24	18	7	0
Bitwuzla	0	53	557.942	556.9	53	37	16	19	19	0
cvc5	0	48	738.525	738.55	48	33	15	24	24	0
2020-CVC4n	0	45	720.577	717.325	45	31	14	27	27	0
MathSAT5n	0	45	766.195	766.205	45	31	14	27	27	0
2020-COLIBRIn	0	44	510.745	510.76	44	21	23	28	17	0
2020-MathSAT5n	0	44	777.76	773.517	44	30	14	28	28	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.