Wanda: the power of the DP framework

This group of experiments considers the power of the dynamic and static DP frameworks. For the explanation and evaluation, see the full explanation of the ESOP'19 experiments. To reproduce the results with Wanda, use the following settings:

nodp: Wanda with dependency pairs disabled: ./wanda.exe -d dp
paper: Wanda with static dependency pairs as described in the ESOP'19 paper: ./wanda.exe -d nt,rr,dynamic,fwrt,uwrt -i none
dpaper: As above, but with dynamic rather than static dependency pairs: ./wanda.exe -d nt,rr,static,fwrt,uwrt -i none
static: Wanda with static dependency pairs as described in the ESOP'19 paper, but also using delegation to a first-order tool: ./wanda.exe -d rr,dynamic,fwrt,uwrt
static: As above, but with dynamic rather than static dependency pairs: ./wanda.exe -d rr,dynamic,fwrt,uwrt
combined: As above, but with both static and dynamic dependency pairs: ./wanda.exe -d rr,fwrt,uwrt

(The fwrt and uwrt consider the unpublished result of formative and usable rules with respect to an argument filtering; rr refers to rule removal and nt to non-termination analysis.)

Filename	nodp	paper	dpaper	static	dynamic	combined
01GoedelT	TIMEOUT	MAYBE	TIMEOUT	MAYBE	TIMEOUT	TIMEOUT
02Ackermann	YES 0.11	YES 0.01	YES 0.01	YES 0.59	YES 0.48	YES 0.49
03minus	YES 0.00	YES 0.00	YES 0.00	YES 0.46	YES 0.44	YES 0.43
04arrow	YES 0.00	YES 0.02	YES 0.01	YES 0.44	YES 0.47	YES 0.47
05height	YES 0.00	YES 0.01	YES 0.00	YES 0.47	YES 0.45	YES 0.50
06plusmult	YES 0.18	YES 0.01	YES 0.01	YES 0.52	YES 0.52	YES 0.53
07ordinal	YES 0.01	MAYBE	YES 0.07	MAYBE	YES 0.07	YES 0.14
09ex	YES 0.11	MAYBE	YES 0.20	MAYBE	YES 0.20	YES 0.20
churchNum2	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
churchNum	TIMEOUT	MAYBE	TIMEOUT	MAYBE	TIMEOUT	TIMEOUT
DicosmoKesner93	MAYBE	YES 0.01	MAYBE	YES 0.48	MAYBE	YES 0.46
gstate	MAYBE	TIMEOUT	MAYBE	TIMEOUT	MAYBE	TIMEOUT
kripke	MAYBE	YES 0.01	MAYBE	YES 0.47	MAYBE	YES 0.44
lambda_prod	MAYBE	YES 0.02	MAYBE	YES 0.43	MAYBE	YES 0.45
lambda_sum	MAYBE	YES 0.02	MAYBE	YES 0.01	MAYBE	YES 0.01
monad	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
pical	YES 0.08	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT	TIMEOUT
restriction	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
slml	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
SystemT	TIMEOUT	MAYBE	TIMEOUT	MAYBE	TIMEOUT	TIMEOUT
typed_lamUNC	MAYBE	YES 0.01	MAYBE	YES 0.01	MAYBE	YES 0.01
typed_lam	MAYBE	YES 0.01	MAYBE	YES 0.01	MAYBE	YES 0.01
ysllc	MAYBE	YES 0.01	MAYBE	YES 0.02	MAYBE	YES 0.01
average	MAYBE	MAYBE	YES 0.03	MAYBE	YES 0.51	YES 0.49
lambda5	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
merge	YES 0.05	YES 0.03	YES 0.05	YES 0.61	YES 0.48	YES 0.46
noneating	MAYBE	YES 0.00	YES 0.00	YES 0.49	YES 0.49	YES 0.47
shuffle	YES 0.09	YES 0.04	YES 0.08	YES 0.60	YES 0.59	YES 0.57
twice	MAYBE	MAYBE	YES 0.05	MAYBE	YES 0.04	YES 0.04
fuhkop11frocos	YES 0.07	YES 0.02	YES 0.06	YES 0.61	YES 0.68	YES 0.63
fuhkop12rta1	YES 0.11	YES 0.04	YES 0.06	YES 0.61	YES 0.58	YES 0.55
fuhkop12rta2	MAYBE	YES 0.05	YES 0.09	YES 0.66	YES 0.71	YES 0.67
kop11cai1	YES 0.70	MAYBE	YES 3.11	MAYBE	YES 3.12	YES 3.13
kop11cai2	YES 0.01	MAYBE	YES 0.00	MAYBE	YES 0.00	YES 0.00
kop12lmcs1	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
kop12lmcs2	MAYBE	YES 0.00	MAYBE	YES 0.00	MAYBE	YES 0.06
kop12thesis_ex2.11	YES 0.21	YES 0.00	YES 0.32	YES 0.01	YES 0.32	YES 0.01
kop12thesis_ex7.23	YES 0.05	YES 0.00	YES 0.02	YES 0.00	YES 0.02	YES 0.00
kop12thesis_ex7.45_1	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
kop12thesis_ex7.45_2	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
kop12thesis_sec3.3.3	MAYBE	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
applicative	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
apply	MAYBE	YES 0.00	YES 0.01	YES 0.00	YES 0.01	YES 0.00
app	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
counterex1	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
counterex2	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
curry1	YES 0.00	YES 0.00	YES 0.00	YES 0.49	YES 0.00	YES 0.00
curry	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
deriv	TIMEOUT	MAYBE	TIMEOUT	MAYBE	TIMEOUT	TIMEOUT
eval	MAYBE	MAYBE	YES 0.02	MAYBE	YES 0.44	YES 0.45
extrec	YES 0.14	YES 0.01	YES 0.61	YES 0.45	YES 1.04	YES 0.50
filter	YES 0.03	YES 0.01	YES 0.05	YES 0.49	YES 0.49	YES 0.49
findzero	MAYBE	MAYBE	YES 0.26	MAYBE	YES 0.68	YES 0.92
foldl	YES 0.27	YES 0.01	YES 0.19	YES 0.01	YES 0.20	YES 0.19
foobar	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
from	MAYBE	YES 0.26	YES 1.16	YES 0.74	YES 1.62	YES 0.74
hrsdif1	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
hrsdif2	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
if	MAYBE	YES 0.11	YES 0.34	YES 0.55	YES 0.78	YES 0.56
inlamb	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
iterative	YES 1.00	MAYBE	YES 0.01	MAYBE	YES 0.46	YES 0.43
lambda1	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
lambda2	MAYBE	MAYBE	MAYBE	NO 1.60	NO 1.51	NO 1.50
lambda3	MAYBE	MAYBE	YES 0.00	MAYBE	YES 0.02	YES 0.00
length	YES 0.10	YES 0.02	YES 0.05	YES 0.01	YES 0.07	YES 0.01
loopy	YES 0.02	YES 0.00	YES 0.01	YES 0.00	YES 0.01	YES 0.01
map	YES 0.02	YES 0.00	YES 0.02	YES 0.00	YES 0.02	YES 0.01
noabs	MAYBE	MAYBE	YES 0.02	MAYBE	YES 0.02	YES 0.02
onearg	YES 0.18	YES 0.01	YES 0.02	YES 0.38	YES 0.42	YES 0.38
ordrec	MAYBE	YES 0.02	MAYBE	YES 0.01	MAYBE	YES 0.23
plode	YES 0.28	YES 0.01	YES 1.03	YES 0.01	YES 1.03	YES 1.03
prefixsum	MAYBE	YES 0.05	MAYBE	YES 0.04	MAYBE	YES 0.04
prenex	YES 0.11	MAYBE	YES 0.69	MAYBE	YES 0.69	YES 0.69
process	YES 1.31	MAYBE	YES 2.23	MAYBE	YES 2.23	YES 2.24
qsort	MAYBE	YES 0.70	YES 0.82	YES 1.17	YES 1.26	YES 1.17
rec	YES 0.11	YES 0.00	YES 0.04	YES 0.00	YES 0.04	YES 0.00
reverse	YES 0.57	YES 0.01	YES 16.96	YES 0.45	YES 17.34	YES 17.31
sdu	YES 0.27	MAYBE	YES 0.78	MAYBE	YES 0.79	YES 0.79
sort	YES 2.00	YES 0.03	YES 6.20	YES 0.52	YES 6.66	YES 0.50
uncurry	YES 0.01	YES 0.00	YES 0.00	YES 0.49	YES 0.45	YES 0.45
zipWith	MAYBE	YES 0.08	YES 0.26	YES 0.69	YES 0.93	YES 0.70
fuhs11frocos_a	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
listrepeat	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
prefixshuffle	MAYBE	YES 0.44	MAYBE	YES 1.16	MAYBE	YES 0.96
prenex_modif1	YES 0.20	MAYBE	YES 0.71	MAYBE	YES 0.72	YES 0.72
sqr	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
tailrecgen	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
twice_modif4	MAYBE	MAYBE	YES 0.02	MAYBE	YES 0.02	YES 0.02
AotoYamada_05__001	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
AotoYamada_05__002	MAYBE	YES 0.01	YES 0.16	YES 0.01	YES 0.17	YES 0.01
AotoYamada_05__003	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
AotoYamada_05__004	YES 0.03	YES 0.01	YES 0.03	YES 0.46	YES 0.48	YES 0.43
AotoYamada_05__005	YES 0.03	YES 0.00	YES 0.01	YES 0.47	YES 0.47	YES 0.46
AotoYamada_05__006	YES 0.03	YES 0.01	YES 0.05	YES 0.00	YES 0.05	YES 0.00
AotoYamada_05__007	YES 0.05	YES 0.01	YES 0.03	YES 0.44	YES 0.45	YES 0.46
AotoYamada_05__009	YES 0.05	YES 0.01	YES 0.02	YES 0.47	YES 0.54	YES 0.47
AotoYamada_05__010	YES 0.62	YES 0.02	YES 0.06	YES 0.48	YES 0.56	YES 0.52
AotoYamada_05__011	YES 0.18	YES 0.01	YES 0.04	YES 0.44	YES 0.48	YES 0.48
AotoYamada_05__012	YES 0.06	YES 0.01	YES 0.02	YES 0.46	YES 0.48	YES 0.47
AotoYamada_05__013	YES 0.07	YES 0.01	YES 0.09	YES 0.46	YES 0.51	YES 0.46
AotoYamada_05__014	YES 0.29	YES 0.02	YES 0.05	YES 0.50	YES 0.51	YES 0.53
AotoYamada_05__015	YES 0.21	YES 0.01	YES 0.10	YES 0.44	YES 0.52	YES 0.44
AotoYamada_05__016	YES 0.31	YES 0.02	YES 0.17	YES 0.46	YES 0.60	YES 0.62
AotoYamada_05__017	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
AotoYamada_05__019	YES 0.06	YES 0.00	YES 0.01	YES 0.00	YES 0.01	YES 0.01
AotoYamada_05__020	YES 0.10	YES 0.01	YES 0.02	YES 0.48	YES 0.50	YES 0.49
AotoYamada_05__021	YES 0.79	YES 0.02	YES 0.05	YES 0.49	YES 0.58	YES 0.52
AotoYamada_05__022	YES 0.05	YES 0.01	YES 0.07	YES 0.01	YES 0.07	YES 0.01
AotoYamada_05__023	YES 0.01	YES 0.00	YES 0.00	YES 0.45	YES 0.36	YES 0.36
AotoYamada_05__024	YES 0.02	YES 0.01	YES 0.02	YES 0.00	YES 0.02	YES 0.00
AotoYamada_05__025	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
AotoYamada_05__026	YES 0.12	YES 0.01	YES 0.03	YES 0.01	YES 0.04	YES 0.03
AotoYamada_05__027	YES 0.06	YES 0.01	YES 0.03	YES 0.44	YES 0.46	YES 0.47
AotoYamada_05__028	YES 0.02	YES 0.01	YES 0.03	YES 0.48	YES 0.48	YES 0.44
AotoYamada_05__Ex1SimplyTyped	YES 0.02	YES 0.01	YES 0.03	YES 0.44	YES 0.41	YES 0.46
AotoYamada_05__Ex5TermProof	YES 0.34	YES 0.01	YES 0.65	YES 0.49	YES 1.10	YES 1.12
Applicative_05__BTreeMember	YES 0.12	YES 0.02	YES 0.01	YES 0.51	YES 0.53	YES 0.52
Applicative_05__Ex2_6_1Composition	YES 0.01	YES 0.00	YES 0.00	YES 0.00	YES 0.00	YES 0.00
Applicative_05__Ex2_8_1ConstSubstFix	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_05__Ex2PrimRec	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_05__Ex3Lists	YES 0.06	YES 0.01	YES 0.06	YES 0.47	YES 0.50	YES 0.49
Applicative_05__Ex4MapList	MAYBE	YES 0.01	MAYBE	YES 0.00	MAYBE	YES 0.02
Applicative_05__Ex5Folding	YES 0.30	YES 0.02	YES 0.23	YES 0.52	YES 0.71	YES 0.77
Applicative_05__Ex5Sorting	YES 0.91	YES 0.03	YES 2.75	YES 0.50	YES 3.17	YES 3.14
Applicative_05__Ex6_11	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_05__Ex6Folding	YES 0.45	YES 0.01	YES 0.19	YES 0.01	YES 0.20	YES 0.20
Applicative_05__Ex6Recursor	YES 0.07	YES 0.00	YES 0.05	YES 0.00	YES 0.05	YES 0.00
Applicative_05__Ex7_9	MAYBE	YES 0.04	YES 0.53	YES 0.64	YES 1.08	YES 0.62
Applicative_05__Ex7OrdinalRec	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_05__Ex7Sorting	YES 1.22	YES 0.03	YES 1.66	YES 0.46	YES 1.98	YES 2.00
Applicative_05__Ex9Maps	YES 11.29	YES 0.03	YES 5.03	YES 0.01	YES 5.05	YES 0.01
Applicative_05__Hamming	NO 0.00	MAYBE	TIMEOUT	NO 0.00	NO 0.00	NO 0.00
Applicative_05__mapDivMinusHard	MAYBE	MAYBE	MAYBE	YES 0.64	YES 0.65	YES 0.65
Applicative_05__mapDivMinus	MAYBE	YES 0.03	YES 0.05	YES 0.59	YES 0.59	YES 0.60
Applicative_05__ReverseLastInit	YES 0.26	YES 0.01	YES 0.03	YES 0.50	YES 0.49	YES 0.49
Applicative_05__TakeDropWhile	YES 0.05	YES 0.01	YES 0.05	YES 0.44	YES 0.49	YES 0.45
Applicative_05__termMonTypes	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_05__TreeFlatten	YES 0.09	MAYBE	YES 0.06	MAYBE	YES 0.54	YES 0.54
Applicative_05__TreeHeight	YES 0.05	MAYBE	YES 0.05	MAYBE	YES 0.53	YES 0.53
Applicative_05__TreeLevels	YES 0.07	MAYBE	YES 0.09	MAYBE	YES 0.53	YES 0.60
Applicative_05__TreeMap	YES 0.33	MAYBE	YES 0.22	MAYBE	YES 0.23	YES 0.22
Applicative_05__TreeSize	YES 0.06	MAYBE	YES 0.07	MAYBE	YES 0.48	YES 0.52
Applicative_05__TypeEx3	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_05__TypeEx5	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
Applicative_AG01_innermost__#4.10	MAYBE	MAYBE	MAYBE	NO 1.24	NO 1.24	NO 1.26
Applicative_AG01_innermost__#4.13	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_AG01_innermost__#4.15	MAYBE	MAYBE	MAYBE	NO 1.45	NO 1.40	NO 1.39
Applicative_AG01_innermost__#4.17	MAYBE	MAYBE	MAYBE	NO 1.70	NO 1.72	NO 1.74
Applicative_AG01_innermost__#4.19	MAYBE	MAYBE	MAYBE	TIMEOUT	TIMEOUT	TIMEOUT
Applicative_AG01_innermost__#4.22	MAYBE	YES 0.02	YES 0.23	YES 1.29	YES 0.75	YES 0.67
Applicative_AG01_innermost__#4.24	MAYBE	YES 0.03	MAYBE	YES 1.63	MAYBE	YES 0.61
Applicative_AG01_innermost__#4.26	MAYBE	MAYBE	MAYBE	YES 0.88	YES 1.22	YES 0.73
Applicative_AG01_innermost__#4.28	MAYBE	MAYBE	MAYBE	YES 0.40	YES 0.57	YES 0.39
Applicative_AG01_innermost__#4.2	MAYBE	MAYBE	MAYBE	NO 1.38	NO 1.36	NO 1.39
Applicative_AG01_innermost__#4.34	MAYBE	YES 0.07	YES 0.53	YES 0.67	YES 1.19	YES 0.68
Applicative_AG01_innermost__#4.36	MAYBE	YES 0.16	YES 0.93	YES 0.91	YES 1.60	YES 0.92
Applicative_AG01_innermost__#4.3	MAYBE	MAYBE	MAYBE	NO 1.21	NO 1.19	NO 1.27
Applicative_AG01_innermost__#4.5	NO 0.00	MAYBE	MAYBE	NO 0.00	NO 0.00	NO 0.00
Applicative_AG01_innermost__#4.7	MAYBE	MAYBE	MAYBE	NO 1.46	NO 1.42	NO 1.43
Applicative_AG01_innermost__#4.8	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE	MAYBE
Applicative_first_order_05__01	YES 0.12	YES 0.02	YES 0.41	YES 0.49	YES 0.87	YES 0.50
Applicative_first_order_05__02	YES 0.11	YES 0.02	YES 0.21	YES 0.48	YES 0.65	YES 0.46
Applicative_first_order_05__06	YES 0.13	YES 0.02	YES 0.22	YES 0.50	YES 0.71	YES 0.47
Applicative_first_order_05__08	YES 0.42	YES 0.03	YES 0.23	YES 0.52	YES 0.73	YES 0.54
Applicative_first_order_05__11	YES 1.47	YES 0.04	YES 0.24	YES 0.61	YES 0.83	YES 0.61
Applicative_first_order_05__12	YES 0.81	YES 0.05	YES 0.26	YES 0.56	YES 0.72	YES 0.51
Applicative_first_order_05__13	YES 0.52	YES 0.20	YES 0.39	YES 18.35	YES 18.55	YES 17.87
Applicative_first_order_05__17	YES 0.15	YES 0.03	YES 0.24	YES 0.48	YES 0.68	YES 0.54
Applicative_first_order_05__18	YES 0.20	YES 0.02	YES 0.23	YES 0.51	YES 0.70	YES 0.48
Applicative_first_order_05__21	MAYBE	MAYBE	MAYBE	YES 0.57	YES 0.84	YES 0.58
Applicative_first_order_05__29	YES 0.62	YES 0.02	YES 0.23	YES 0.49	YES 0.83	YES 0.49
Applicative_first_order_05__30	YES 0.46	YES 0.52	YES 0.73	YES 0.53	YES 0.71	YES 0.52
Applicative_first_order_05__#3.10	MAYBE	YES 0.25	YES 0.61	YES 0.97	YES 1.45	YES 0.99
Applicative_first_order_05__#3.13	MAYBE	YES 0.16	YES 0.75	YES 0.90	YES 1.42	YES 0.98
Applicative_first_order_05__#3.16	YES 0.39	YES 0.03	YES 0.24	YES 0.50	YES 0.73	YES 0.54
Applicative_first_order_05__#3.18	MAYBE	YES 0.07	YES 0.28	YES 0.64	YES 0.84	YES 0.65
Applicative_first_order_05__31	MAYBE	YES 0.03	YES 0.23	YES 0.04	YES 0.23	YES 0.03
Applicative_first_order_05__#3.22	MAYBE	YES 3.44	YES 3.63	YES 0.65	YES 0.85	YES 0.63
Applicative_first_order_05__#3.25	MAYBE	YES 0.04	YES 0.25	YES 0.39	YES 0.59	YES 0.37
Applicative_first_order_05__#3.27	YES 0.11	YES 0.02	YES 0.23	YES 0.52	YES 0.82	YES 0.46
Applicative_first_order_05__#3.2	MAYBE	YES 0.05	YES 0.25	YES 0.60	YES 0.80	YES 0.62
Applicative_first_order_05__#3.32	MAYBE	YES 0.01	YES 0.22	YES 0.36	YES 0.57	YES 0.40
Applicative_first_order_05__#3.36	MAYBE	YES 0.08	YES 0.28	YES 0.76	YES 1.15	YES 0.70
Applicative_first_order_05__#3.38	MAYBE	YES 0.07	YES 0.51	YES 0.69	YES 1.10	YES 0.73
Applicative_first_order_05__33	MAYBE	MAYBE	MAYBE	TIMEOUT	TIMEOUT	TIMEOUT
Applicative_first_order_05__#3.40	MAYBE	MAYBE	MAYBE	YES 1.51	YES 1.00	YES 0.84
Applicative_first_order_05__#3.45	MAYBE	YES 0.02	YES 0.23	YES 0.57	YES 0.73	YES 0.54
Applicative_first_order_05__#3.48	MAYBE	YES 0.03	YES 0.47	YES 0.55	YES 0.99	YES 0.56
Applicative_first_order_05__#3.52	MAYBE	YES 0.02	YES 0.22	YES 0.54	YES 0.78	YES 0.52
Applicative_first_order_05__#3.55	MAYBE	YES 0.17	YES 1.77	YES 0.94	YES 2.38	YES 0.84
Applicative_first_order_05__#3.57	MAYBE	YES 0.22	YES 0.48	YES 0.74	YES 1.02	YES 0.78
Applicative_first_order_05__#3.6	MAYBE	YES 0.14	YES 0.64	YES 0.78	YES 1.25	YES 0.75
Applicative_first_order_05__#3.8	MAYBE	YES 0.13	YES 0.33	YES 0.67	YES 0.88	YES 0.68
Applicative_first_order_05__hydra	YES 0.46	YES 0.02	YES 1.48	YES 0.55	YES 1.98	YES 0.58
Applicative_first_order_05__minsort	MAYBE	MAYBE	MAYBE	TIMEOUT	TIMEOUT	TIMEOUT
Applicative_first_order_05__motivation	MAYBE	YES 0.05	YES 0.25	YES 0.61	YES 0.83	YES 0.61
Applicative_first_order_05__perfect2	MAYBE	YES 0.08	YES 0.58	YES 0.83	YES 1.25	YES 0.80
Applicative_first_order_05__perfect	MAYBE	YES 0.02	YES 0.46	YES 0.58	YES 1.01	YES 0.59
Total YES	92	124	132	129	137	150
Total NO	9	0	0	16	16	16
Total MAYBE	91	70	58	46	35	21
Total TIMEOUT	6	4	8	7	10	11
Average Runtime	0.32	0.07	0.52	0.58	0.93	0.70