UFDTLIA (Single Query Track)

Competition results for the UFDTLIA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 277
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	—	cvc5	Vampire

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	195	150037.879	152443.406	195	0	195	82	82	0
cvc5	0	192	156987.858	160363.292	192	0	192	85	85	0
Vampire	0	128	180240.158	177382.198	128	0	128	149	147	0
z3-4.8.17n	0	38	254917.502	258418.219	38	0	38	239	200	0
smtinterpol	0	26	303195.177	302937.074	26	0	26	251	251	0
UltimateEliminator+MathSAT	0	0	1288.557	768.735	0	0	0	277	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	195	151268.129	152439.476	195	0	195	82	82	0
cvc5	0	192	158680.898	160359.142	192	0	192	85	85	0
Vampire	0	128	205441.108	177361.548	128	0	128	149	147	0
z3-4.8.17n	0	38	254962.692	258408.909	38	0	38	239	200	0
smtinterpol	0	26	303195.177	302937.074	26	0	26	251	251	0
UltimateEliminator+MathSAT	0	0	1288.557	768.735	0	0	0	277	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-CVC4n	0	0	0.0	0.0	0	0	0	0	277	82	0
cvc5	0	0	0.0	0.0	0	0	0	0	277	85	0
smtinterpol	0	0	0.0	0.0	0	0	0	0	277	251	0
Vampire	0	0	0.0	0.0	0	0	0	0	277	147	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	0	277	0	0
z3-4.8.17n	0	0	0.0	0.0	0	0	0	0	277	200	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-CVC4n	0	195	63668.129	64839.476	195	0	195	9	73	82	0
cvc5	0	192	71080.898	72759.142	192	0	192	12	73	85	0
Vampire	0	128	107040.688	89770.138	128	0	128	76	73	147	0
z3-4.8.17n	0	38	174232.825	177131.885	38	0	38	166	73	200	0
smtinterpol	0	26	215595.177	215337.074	26	0	26	178	73	251	0
UltimateEliminator+MathSAT	0	0	941.287	568.065	0	0	0	204	73	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Vampire	0	120	4343.621	3890.721	120	0	120	157	155	0
z3-4.8.17n	0	37	5809.736	5809.671	37	0	37	240	240	0
2020-CVC4n	0	26	6064.115	6064.109	26	0	26	251	251	0
cvc5	0	24	6108.244	6108.244	24	0	24	253	253	0
smtinterpol	0	21	6257.04	6188.794	21	0	21	256	256	0
UltimateEliminator+MathSAT	0	0	1288.557	768.735	0	0	0	277	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.