QF_FP (Single Query Track)

Competition results for the QF_FP logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 273
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	cvc5	COLIBRI	COLIBRI

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-Bitwuzlan	0	231	15876.443	15879.672	231	138	93	42	42	0
Bitwuzla	0	228	18288.542	18265.961	228	135	93	45	45	0
Bitwuzla Fixedn	0	228	18367.87	18364.861	228	135	93	45	45	0
COLIBRI	0	225	1958.322	1945.562	225	126	99	48	48	0
cvc5	0	224	19119.629	19105.251	224	135	89	49	49	0
Z3-Owl Fixedn	0	169	30874.223	30858.042	169	103	66	104	104	0
Z3-Owl	114	159	111.675	111.615	159	154	5	114	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-Bitwuzlan	0	231	15876.443	15879.672	231	138	93	42	42	0
Bitwuzla	0	228	18288.542	18265.961	228	135	93	45	45	0
Bitwuzla Fixedn	0	228	18367.87	18364.861	228	135	93	45	45	0
COLIBRI	0	225	1958.322	1945.562	225	126	99	48	48	0
cvc5	0	224	19119.629	19105.251	224	135	89	49	49	0
Z3-Owl Fixedn	0	169	30874.223	30858.042	169	103	66	104	104	0
Z3-Owl	114	159	111.675	111.615	159	154	5	114	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-Bitwuzlan	0	138	7063.642	7065.188	138	138	0	16	119	42	0
cvc5	0	135	6220.592	6204.015	135	135	0	19	119	49	0
Bitwuzla	0	135	6606.748	6608.41	135	135	0	19	119	45	0
Bitwuzla Fixedn	0	135	6623.871	6623.991	135	135	0	19	119	45	0
COLIBRI	0	126	1500.013	1496.392	126	126	0	28	119	48	0
Z3-Owl Fixedn	0	103	17528.721	17533.047	103	103	0	51	119	104	0
Z3-Owl	114	154	108.12	108.06	154	154	0	0	119	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
COLIBRI	0	99	458.308	449.17	99	0	99	20	154	48	0
2022-Bitwuzlan	0	93	8812.801	8814.484	93	0	93	26	154	42	0
Bitwuzla	0	93	11681.794	11657.551	93	0	93	26	154	45	0
Bitwuzla Fixedn	0	93	11743.999	11740.869	93	0	93	26	154	45	0
cvc5	0	89	12899.037	12901.236	89	0	89	30	154	49	0
Z3-Owl Fixedn	0	66	13345.502	13324.995	66	0	66	53	154	104	0
Z3-Owl	0	5	3.555	3.555	5	0	5	114	154	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI	0	213	563.978	551.111	213	117	96	60	60	0
2022-Bitwuzlan	0	173	614.307	614.394	173	108	65	100	100	0
Bitwuzla Fixedn	0	167	589.225	583.67	167	103	64	106	106	0
Bitwuzla	0	167	611.434	585.947	167	103	64	106	106	0
cvc5	0	143	782.309	764.898	143	92	51	130	130	0
Z3-Owl Fixedn	0	40	609.254	587.807	40	24	16	233	233	0
Z3-Owl	114	159	111.675	111.615	159	154	5	114	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.