Bitvec (Single Query Track)

Competition results for the Bitvec division in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 1040
Time Limit: 1200 seconds
Memory Limit: 60 GB

Logics:

• BV : 1040 benchmarks

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	Bitwuzla	cvc5	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
2019-Par4n	0	961	11999.273	3171.227	961	252	709	79	0	79	0
cvc5	0	937	34547.172	35619.028	937	246	691	103	0	103	0
Bitwuzla	0	838	10821.129	10804.53	838	255	583	202	0	202	0
Bitwuzla Fixedn	0	838	10824.968	10799.985	838	255	583	202	0	202	0
YicesQS	0	749	4938.411	4938.946	749	211	538	291	0	290	0
UltimateEliminator+MathSAT	0	310	4241.81	3240.701	310	29	281	730	0	138	12
UltimateIntBlastingWrapper+SMTInterpol	0	5	82.875	34.615	5	1	4	1035	0	210	0
Q3B	4	889	10354.898	4366.962	889	243	646	151	0	146	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
2019-Par4n	0	968	25562.323	6627.59	968	255	713	72	0	72	0
cvc5	0	937	34547.172	35619.028	937	246	691	103	0	103	0
Bitwuzla Fixedn	0	838	10824.968	10799.985	838	255	583	202	0	202	0
Bitwuzla	0	838	10821.129	10804.53	838	255	583	202	0	202	0
YicesQS	0	749	4938.411	4938.946	749	211	538	291	0	290	0
UltimateEliminator+MathSAT	0	310	4241.81	3240.701	310	29	281	730	0	137	12
UltimateIntBlastingWrapper+SMTInterpol	0	5	82.875	34.615	5	1	4	1035	0	208	0
Q3B	4	896	24903.638	9234.061	896	248	648	144	0	139	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
Bitwuzla	0	255	2482.104	2482.427	255	255	0	17	768	202	0
Bitwuzla Fixedn	0	255	2511.153	2498.285	255	255	0	17	768	202	0
2019-Par4n	0	255	11604.959	3019.365	255	255	0	17	768	72	0
cvc5	0	246	23401.599	24066.333	246	246	0	26	768	103	0
YicesQS	0	211	2456.763	2457.058	211	211	0	61	768	290	0
UltimateEliminator+MathSAT	0	29	1836.505	1561.68	29	29	0	243	768	137	12
UltimateIntBlastingWrapper+SMTInterpol	0	1	11.386	4.401	1	1	0	271	768	208	0
Q3B	4	248	16618.059	6415.328	248	248	0	24	768	139	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
2019-Par4n	0	713	13957.364	3608.225	713	0	713	37	290	72	0
cvc5	0	691	11145.574	11552.695	691	0	691	59	290	103	0
Q3B	0	648	8285.579	2818.733	648	0	648	102	290	139	0
Bitwuzla Fixedn	0	583	8313.815	8301.7	583	0	583	167	290	202	0
Bitwuzla	0	583	8339.025	8322.103	583	0	583	167	290	202	0
YicesQS	0	538	2481.647	2481.889	538	0	538	212	290	290	0
UltimateEliminator+MathSAT	0	281	2405.305	1679.022	281	0	281	469	290	137	12
UltimateIntBlastingWrapper+SMTInterpol	0	4	71.489	30.214	4	0	4	746	290	208	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Abstained	Timeout	Memout
2019-Par4n	0	934	2168.49	629.077	934	239	695	106	0	106	0
Bitwuzla Fixedn	0	772	885.443	858.685	772	226	546	268	0	268	0
Bitwuzla	0	772	876.927	858.945	772	226	546	268	0	268	0
cvc5	0	759	1207.058	1178.819	759	139	620	281	0	281	0
YicesQS	0	730	311.585	311.618	730	205	525	310	0	310	0
UltimateEliminator+MathSAT	0	291	1842.193	1040.097	291	20	271	749	0	192	12
UltimateIntBlastingWrapper+SMTInterpol	0	5	82.875	34.615	5	1	4	1035	0	288	0
Q3B	4	856	2190.452	831.491	856	225	631	184	0	180	0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.