UFBV (Single Query Track)

Competition results for the UFBV logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 144
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-z3-4.8.17n	0	105	3379.946	3380.304	105	36	69	39	36	0
Bitwuzla Fixedn	0	98	2481.865	2480.038	98	19	79	46	46	0
Bitwuzla	0	97	2523.944	2501.895	97	19	78	47	47	0
cvc5	0	94	5265.231	5445.111	94	18	76	50	18	0
UltimateEliminator+MathSAT	0	6	55.735	25.279	6	0	6	138	4	4
UltimateIntBlastingWrapper+SMTInterpol	0	0	0.0	0.0	0	0	0	144	42	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-z3-4.8.17n	0	105	3379.946	3380.304	105	36	69	39	36	0
Bitwuzla Fixedn	0	98	2481.865	2480.038	98	19	79	46	46	0
Bitwuzla	0	97	2523.944	2501.895	97	19	78	47	47	0
cvc5	0	94	5265.231	5445.111	94	18	76	50	18	0
UltimateEliminator+MathSAT	0	6	55.735	25.279	6	0	6	138	4	4
UltimateIntBlastingWrapper+SMTInterpol	0	0	0.0	0.0	0	0	0	144	34	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-z3-4.8.17n	0	36	1676.213	1676.443	36	36	0	1	107	36	0
Bitwuzla Fixedn	0	19	238.84	238.987	19	19	0	18	107	46	0
Bitwuzla	0	19	1019.172	996.614	19	19	0	18	107	47	0
cvc5	0	18	2887.723	3009.464	18	18	0	19	107	18	0
UltimateIntBlastingWrapper+SMTInterpol	0	0	0.0	0.0	0	0	0	37	107	34	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	37	107	4	4

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla Fixedn	0	79	2243.025	2241.051	79	0	79	7	58	46	0
Bitwuzla	0	78	1504.771	1505.281	78	0	78	8	58	47	0
cvc5	0	76	2377.508	2435.647	76	0	76	10	58	18	0
2022-z3-4.8.17n	0	69	1703.733	1703.861	69	0	69	17	58	36	0
UltimateEliminator+MathSAT	0	6	55.735	25.279	6	0	6	80	58	4	4
UltimateIntBlastingWrapper+SMTInterpol	0	0	0.0	0.0	0	0	0	86	58	34	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-z3-4.8.17n	0	94	136.907	136.813	94	31	63	50	50	0
Bitwuzla Fixedn	0	91	267.347	265.283	91	17	74	53	53	0
Bitwuzla	0	90	274.046	251.368	90	16	74	54	54	0
cvc5	0	60	206.439	182.739	60	1	59	84	84	0
UltimateEliminator+MathSAT	0	6	55.735	25.279	6	0	6	138	7	4
UltimateIntBlastingWrapper+SMTInterpol	0	0	0.0	0.0	0	0	0	144	82	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.