NIA (Single Query Track)

Competition results for the NIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 248
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	222	4130.654	4148.959	222	76	146	26	26	0
UltimateEliminator+MathSAT	0	145	1180.941	920.824	145	48	97	103	30	0
YicesQS	0	112	1163.379	1163.43	112	68	44	136	136	0
2021-z3n	0	94	117.959	117.976	94	61	33	154	66	0
iProver Fixedn	0	36	658.418	178.152	36	0	36	212	212	0
iProver	1	38	2084.679	530.337	38	0	38	210	209	0
Vampire	3	82	11602.046	2931.614	82	0	82	166	163	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	222	4130.654	4148.959	222	76	146	26	26	0
UltimateEliminator+MathSAT	0	145	1180.941	920.824	145	48	97	103	30	0
YicesQS	0	112	1163.379	1163.43	112	68	44	136	136	0
2021-z3n	0	94	117.959	117.976	94	61	33	154	66	0
iProver Fixedn	0	37	2528.348	653.209	37	0	37	211	211	0
iProver	1	38	2084.679	530.337	38	0	38	210	209	0
Vampire	3	89	25844.036	6519.305	89	0	89	159	156	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	76	3313.38	3326.306	76	76	0	5	167	26	0
YicesQS	0	68	742.296	742.3	68	68	0	13	167	136	0
2021-z3n	0	61	6.616	6.621	61	61	0	20	167	66	0
UltimateEliminator+MathSAT	0	48	641.762	565.515	48	48	0	33	167	30	0
Vampire	0	0	0.0	0.0	0	0	0	81	167	156	0
iProver	0	0	0.0	0.0	0	0	0	81	167	209	0
iProver Fixedn	0	0	0.0	0.0	0	0	0	81	167	211	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	146	817.274	822.653	146	0	146	17	85	26	0
UltimateEliminator+MathSAT	0	97	539.179	355.309	97	0	97	66	85	30	0
YicesQS	0	44	421.082	421.13	44	0	44	119	85	136	0
iProver Fixedn	0	37	2528.348	653.209	37	0	37	126	85	211	0
2021-z3n	0	33	111.343	111.355	33	0	33	130	85	66	0
iProver	1	38	2084.679	530.337	38	0	38	125	85	209	0
Vampire	3	89	25844.036	6519.305	89	0	89	74	85	156	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	206	38.193	38.105	206	63	143	42	42	0
UltimateEliminator+MathSAT	0	142	805.314	452.624	142	46	96	106	33	0
YicesQS	0	106	86.74	86.744	106	65	41	142	142	0
2021-z3n	0	93	41.394	41.404	93	61	32	155	74	0
iProver Fixedn	0	34	75.608	28.679	34	0	34	214	214	0
iProver	0	34	93.974	33.212	34	0	34	214	214	0
Vampire	1	41	518.656	135.789	41	0	41	207	206	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.