UFFPDTNIRA (Single Query Track)

Competition results for the UFFPDTNIRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 396
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	362	21469.552	22049.242	362	40	322	34	10	0
2021-cvc5n	0	360	16645.222	28767.168	360	40	320	36	18	0
z3-4.8.17n	0	334	54957.855	54891.051	334	35	299	62	35	0
UltimateEliminator+MathSAT	0	0	1870.056	1112.075	0	0	0	396	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	362	21578.772	22048.622	362	40	322	34	10	0
2021-cvc5n	0	360	28360.846	28765.888	360	40	320	36	18	0
z3-4.8.17n	0	334	54964.775	54889.691	334	35	299	62	35	0
UltimateEliminator+MathSAT	0	0	1870.056	1112.075	0	0	0	396	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2021-cvc5n	0	40	984.886	996.409	40	40	0	3	353	18	0
cvc5	0	40	1218.631	1226.247	40	40	0	3	353	10	0
z3-4.8.17n	0	35	4202.673	4182.058	35	35	0	8	353	35	0
UltimateEliminator+MathSAT	0	0	203.43	119.404	0	0	0	43	353	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	322	4246.075	4570.437	322	0	322	3	71	10	0
2021-cvc5n	0	320	7628.602	7992.772	320	0	320	5	71	18	0
z3-4.8.17n	0	299	24157.779	24103.314	299	0	299	26	71	35	0
UltimateEliminator+MathSAT	0	0	1529.429	915.608	0	0	0	325	71	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2021-cvc5n	0	352	1181.992	1182.143	352	36	316	44	37	0
cvc5	0	350	1207.666	1207.654	350	33	317	46	40	0
z3-4.8.17n	0	288	2624.367	2575.96	288	25	263	108	90	0
UltimateEliminator+MathSAT	0	0	1870.056	1112.075	0	0	0	396	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.