1

Table 1: Average Rankings of the algorithms (Friedman)

Algorithm Ranking
Original
3.0
Smote
2.0
Artificial
1.0

Iman and Davenport statistic (distributed according to F-distribution with 2 and 4 degrees of freedom: Infinity. P-value computed by
Iman and Daveport Test: 0.0.

P-value computed by Friedman Test:

Tables of Friedman, Aligned Friedman, Bonferroni-Dunn, Holm, Hochberg and

Hommel Tests

Friedman statistic (distributed according to chi-square with 2 degrees of freedom: 6.0.

0.0497870683796543.

February 13, 2015

Results

Aligned Friedman statistic (distributed according to chi-square with 2 degrees of freedom: 2.020408163265306. P-value computed by
Aligned Friedman Test: 0.3641446567520946.

Table 2: Average Rankings of the algorithms (Aligned Friedman)

Algorithm
Ranking
Original
8.0
Smote
5.0
Artificial
1.9999999999999998

Quade statistic (distributed according to F-distribution with 2 and 4 degrees of freedom: 12.0. P-value computed by Quade Test:
0.02040816326530612.

Table 3: Average Rankings of the algorithms (Quade)

Algorithm Ranking
Original
3.0
Smote
2.0
Artificial
1.0

Original
Smote
Artificial

Original
0.000
5.250
7.021

Smote
-5.250
0.000
1.771

Artificial
-7.021
-1.771
0.000

Table 4: Contrast Estimation

i
2
1

p
0.014305878435429607
0.22067136191984688

Holm/Hochberg/Hommel
0.025
0.05

Holland
0.025320565519103666
0.050000000000000044

Rom
0.025
0.05

Finner
0.025320565519103666
0.050000000000000044

Table 5: Holm / Hochberg / Holland / Rom / Finner / Li Table for = 0.05 (FRIEDMAN)

z = (R0 Ri )/SE
2.449489742783178
1.224744871391589

Bonferroni-Dunns procedure rejects those hypotheses that have a p-value 0.025.

Holms procedure rejects those hypotheses that have a p-value 0.05.
Hochbergs procedure rejects those hypotheses that have a p-value 0.025.
Hommels procedure rejects those hypotheses that have a p-value 0.05.
Hollands procedure rejects those hypotheses that have a p-value 0.050000000000000044.
Roms procedure rejects those hypotheses that have a p-value 0.025.
Finners procedure rejects those hypotheses that have a p-value 0.050000000000000044.
Lis procedure rejects those hypotheses that have a p-value 0.041017296741060694.

algorithm
Original
Smote

Li
0.041017296741060694
0.05

i
2
1

p
0.007290358091535623
0.17971249487899987

Holm/Hochberg/Hommel
0.025
0.05

Holland
0.025320565519103666
0.050000000000000044

Rom
0.025
0.05

Finner
0.025320565519103666
0.050000000000000044

Table 6: Holm / Hochberg / Holland / Rom / Finner / Li Table for = 0.05 (ALIGNED FRIEDMAN)

z = (R0 Ri )/SE
2.6832815729997477
1.3416407864998738

Bonferroni-Dunns procedure rejects those hypotheses that have a p-value 0.025.

Holms procedure rejects those hypotheses that have a p-value 0.05.
Hochbergs procedure rejects those hypotheses that have a p-value 0.025.
Hommels procedure rejects those hypotheses that have a p-value 0.05.
Hollands procedure rejects those hypotheses that have a p-value 0.050000000000000044.
Roms procedure rejects those hypotheses that have a p-value 0.025.
Finners procedure rejects those hypotheses that have a p-value 0.050000000000000044.
Lis procedure rejects those hypotheses that have a p-value 0.0431730265853158.

algorithm
Original
Smote

Li
0.0431730265853158
0.05

i
2
1

p
0.023342202012890823
0.25683925795785667

Holm/Hochberg/Hommel
0.025
0.05

Holland
0.025320565519103666
0.050000000000000044

Rom
0.025
0.05

Finner
0.025320565519103666
0.050000000000000044

Table 7: Holm / Hochberg / Holland / Rom / Finner / Li Table for = 0.05 (QUADE)

z = (R0 Ri )/SE
2.2677868380553634
1.1338934190276817

Bonferroni-Dunns procedure rejects those hypotheses that have a p-value 0.025.

Holms procedure rejects those hypotheses that have a p-value 0.05.
Hochbergs procedure rejects those hypotheses that have a p-value 0.025.
Hommels procedure rejects those hypotheses that have a p-value 0.05.
Hollands procedure rejects those hypotheses that have a p-value 0.050000000000000044.
Roms procedure rejects those hypotheses that have a p-value 0.025.
Finners procedure rejects those hypotheses that have a p-value 0.050000000000000044.
Lis procedure rejects those hypotheses that have a p-value 0.03911372326537597.

algorithm
Original
Smote

Li
0.03911372326537597
0.05

algorithm
Original
Smote

algorithm
Original
Smote

i
1
2

i
1
2

unadjusted p
0.014305878435429607
0.22067136191984688

unadjusted p
0.014305878435429607
0.22067136191984688

pHolm
0.028611756870859213
0.22067136191984688

pHoch
0.028611756870859213
0.22067136191984688

pHoll
0.028407098713049916
0.22067136191984682

pRom
0.028611756870859213
0.22067136191984688

pF inn
0.028407098713049916
0.22067136191984682

Table 9: Adjusted p-values (FRIEDMAN)

pBonf
0.028611756870859213
0.44134272383969375

Table 8: Adjusted p-values (FRIEDMAN)

pLi
0.0180257765227235
0.22067136191984688

pHomm
0.028611756870859213
0.22067136191984688

algorithm
Original
Smote

algorithm
Original
Smote

i
1
2

i
1
2

pHolm
0.014580716183071246
0.17971249487899987

pHoch
0.014580716183071246
0.17971249487899987

unadjusted p
0.007290358091535623
0.17971249487899987

pHoll
0.014527566861968544
0.17971249487899987

pRom
0.014580716183071246
0.17971249487899987

pF inn
0.014527566861968544
0.17971249487899987

Table 11: Adjusted p-values (ALIGNED FRIEDMAN)

pBonf
0.014580716183071246
0.35942498975799975

Table 10: Adjusted p-values (ALIGNED FRIEDMAN)

unadjusted p
0.007290358091535623
0.17971249487899987

pLi
0.008809271508587149
0.17971249487899987

pHomm
0.014580716183071246
0.17971249487899987

10

i
1
2

i
1
2

algorithm
Original
Smote

algorithm
Original
Smote

unadjusted p
0.023342202012890823
0.25683925795785667

unadjusted p
0.023342202012890823
0.25683925795785667

pHolm
0.046684404025781646
0.25683925795785667

pHoch
0.046684404025781646
0.25683925795785667

pHoll
0.04613954563097111
0.25683925795785667

pRom
0.046684404025781646
0.25683925795785667

pF inn
0.04613954563097111
0.25683925795785667

Table 13: Adjusted p-values (QUADE)

pBonf
0.046684404025781646
0.5136785159157133

Table 12: Adjusted p-values (QUADE)

pLi
0.03045285369603861
0.25683925795785667

pHomm
0.046684404025781646
0.25683925795785667