AUFBVDTNIRA (Single Query Track)

Competition results for the AUFBVDTNIRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 1062
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	—	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	368	789041.751	797260.204	368	0	368	694	655	0
cvc5	0	131	1113026.852	1113358.436	131	0	131	931	927	0
UltimateEliminator+MathSAT	0	0	4930.179	2915.77	0	0	0	1062	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	368	797256.241	797231.194	368	0	368	694	655	0
cvc5	0	131	1113322.812	1113313.356	131	0	131	931	927	0
UltimateEliminator+MathSAT	0	0	4930.179	2915.77	0	0	0	1062	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	0	0.0	0.0	0	0	0	0	1062	927	0
UltimateEliminator+MathSAT	0	0	0.0	0.0	0	0	0	0	1062	0	0
z3-4.8.17n	0	0	0.0	0.0	0	0	0	0	1062	655	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	368	797256.241	797231.194	368	0	368	694	0	655	0
cvc5	0	131	1113322.812	1113313.356	131	0	131	931	0	927	0
UltimateEliminator+MathSAT	0	0	4930.179	2915.77	0	0	0	1062	0	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	324	18408.091	18380.872	324	0	324	738	710	0
cvc5	0	126	22785.701	22776.183	126	0	126	936	932	0
UltimateEliminator+MathSAT	0	0	4930.179	2915.77	0	0	0	1062	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.