AUFNIRA (Single Query Track)

Competition results for the AUFNIRA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:53 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	Vampire	—	Vampire	Vampire

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	54	3523.165	3591.325	54	0	54	246	244	0
2022-cvc5n	0	52	3079.69	3108.903	52	0	52	248	246	0
Vampire	0	52	5431.54	1375.447	52	0	52	248	248	0
iProver Fixedn	0	32	3624.262	931.506	32	0	32	268	268	0
iProver	0	32	4902.389	1242.641	32	0	32	268	268	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	300	2	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Vampire	0	58	19183.88	4835.412	58	0	58	242	242	0
cvc5	0	54	3523.165	3591.325	54	0	54	246	244	0
2022-cvc5n	0	52	3079.69	3108.903	52	0	52	248	246	0
iProver	0	38	17161.519	4350.765	38	0	38	262	262	0
iProver Fixedn	0	36	10677.232	2720.123	36	0	36	264	264	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	300	2	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-cvc5n	0	0	0.0	0.0	0	0	0	1	299	246	0
Vampire	0	0	0.0	0.0	0	0	0	1	299	242	0
cvc5	0	0	0.0	0.0	0	0	0	1	299	244	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	1	299	2	0
iProver	0	0	0.0	0.0	0	0	0	1	299	262	0
iProver Fixedn	0	0	0.0	0.0	0	0	0	1	299	264	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Vampire	0	58	19183.88	4835.412	58	0	58	13	229	242	0
cvc5	0	54	3523.165	3591.325	54	0	54	17	229	244	0
2022-cvc5n	0	52	3079.69	3108.903	52	0	52	19	229	246	0
iProver	0	38	17161.519	4350.765	38	0	38	33	229	262	0
iProver Fixedn	0	36	10677.232	2720.123	36	0	36	35	229	264	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	71	229	2	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Vampire	0	41	303.23	82.367	41	0	41	259	259	0
cvc5	0	34	68.887	68.879	34	0	34	266	265	0
2022-cvc5n	0	29	46.142	46.141	29	0	29	271	270	0
iProver Fixedn	0	23	157.093	47.102	23	0	23	277	277	0
iProver	0	22	131.313	40.448	22	0	22	278	278	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	300	8	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.