AUFBVDTLIA (Single Query Track)

Competition results for the AUFBVDTLIA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 742
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	358	486249.167	499016.417	358	209	149	384	358	0
2021-cvc5n	0	288	275503.387	560549.151	288	157	131	454	430	0
z3-4.8.17n	0	150	669405.058	669613.374	150	59	91	592	547	0
UltimateEliminator+MathSAT	0	0	3419.184	2100.527	0	0	0	742	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	358	496018.197	498998.867	358	209	149	384	358	0
2021-cvc5n	0	288	558929.54	560526.701	288	157	131	454	430	0
z3-4.8.17n	0	150	669496.648	669592.104	150	59	91	592	547	0
UltimateEliminator+MathSAT	0	0	3419.184	2100.527	0	0	0	742	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	209	47612.955	50069.011	209	209	0	2	531	358	0
2021-cvc5n	0	157	93042.569	94406.481	157	157	0	54	531	430	0
z3-4.8.17n	0	59	179263.1	179263.518	59	59	0	152	531	547	0
UltimateEliminator+MathSAT	0	0	976.336	606.298	0	0	0	211	531	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	149	19224.223	19682.592	149	0	149	0	593	358	0
2021-cvc5n	0	131	34269.13	34476.847	131	0	131	18	593	430	0
z3-4.8.17n	0	91	70113.986	70114.052	91	0	91	58	593	547	0
UltimateEliminator+MathSAT	0	0	672.324	416.046	0	0	0	149	593	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	143	14222.798	14222.536	143	53	90	599	591	0
cvc5	0	104	15334.578	15335.306	104	9	95	638	638	0
2021-cvc5n	0	102	15376.924	15376.943	102	7	95	640	640	0
UltimateEliminator+MathSAT	0	0	3419.184	2100.527	0	0	0	742	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.