Pairwise comparisons Set 0 Set 1 Set 2 Mean REGED 0.55 (0.007) 0.55 (0.006) 0.63 (0.001) 0.62 (0.001) SIDO 0.36 ( 0.09) 0.64 (0.001) 0.60 (0.002) 0.70 (0.0002) CINA 0.36 ( 0.09) 0.69(0.0003) 0.65 (0.0007) 0.72 (0.0001) MARTI 0.94 (1e-11) 0.96(1e-13) 0.90 (4e-9) 0.95 (2e-12) Mean 0.64 (0.001) 0.75(3e-5) 0.73 (7e-5) 0.70 (3e-11) People's own classifiers (using max in tables) Set 0 Set 1 Set 2 Mean REGED 0.34 ( 0.2) 0.10 ( 0.7) 0.65 (0.006) 0.58 ( 0.02) SIDO 0.38 ( 0.1) 0.40 ( 0.1) 0.51 ( 0.07) 0.57 (0.009) CINA -0.30 ( 0.3) -0.00 ( 1) 0.52 ( 0.05) 0.47 ( 0.05) MARTI 0.66 ( 0.02) 0.94 (7e-006) 0.67 ( 0.02) 0.87 (0.0002) Mean 0.91 (6e-009) 0.84 (4e-007) 0.78 (1e-005) 0.84 (2e-019) Verification with same classifier Borisov Set 0 Set 1 Set 2 Mean REGED 0.28 ( 0.3) 0.43 ( 0.08) 0.77 (0.0002) 0.80 (6e-005) SIDO 0.06 ( 0.8) 0.18 ( 0.5) 0.72 (0.003) 0.62 (0.005) CINA -0.37 ( 0.1) -0.50 ( 0.06) 0.71 (0.003) 0.59 ( 0.01) MARTI 0.80 (0.003) 0.54 ( 0.07) 0.69 ( 0.01) 0.88 (0.0002) Mean 0.96 (5e-012) 0.84 (8e-007) 0.81 (4e-006) 0.88 (7e-023) Verification with same classifier Cawley Set 0 Set 1 Set 2 Mean REGED 0.40 ( 0.1) 0.78 (0.0001) 0.65 (0.004) 0.85 (8e-006) SIDO 0.07 ( 0.8) 0.03 ( 0.9) -0.23 ( 0.4) 0.40 ( 0.09) CINA -0.40 ( 0.1) -0.35 ( 0.2) 0.83 (0.0002) 0.73 (0.0009) MARTI 0.85 (0.0008) 0.92 (2e-005) 0.73 (0.008) 0.88 (0.0001) Mean 0.94 (4e-011) 0.80 (8e-006) 0.74 (7e-005) 0.85 (3e-019) Verification with same classifier Chang Set 0 Set 1 Set 2 Mean REGED 0.73 (0.0005) 0.86 (5e-006) 0.63 (0.005) 0.87 (3e-006) SIDO 0.01 ( 1) -0.31 ( 0.2) -0.39 ( 0.2) -0.09 ( 0.7) CINA -0.40 ( 0.1) -0.66 (0.007) 0.84 (0.0001) 0.67 (0.003) MARTI 0.74 (0.009) 0.30 ( 0.3) 0.52 ( 0.09) 0.63 ( 0.03) Mean 0.82 (3e-006) 0.74 (9e-005) 0.74 (8e-005) 0.76 (2e-013)