Ranking report for experiment loss_black
Accuracy
Raw results
| EDFT | PLT | SCTT | FoT | LGT++ |
camera_motion | 0.563 (0.239) | 0.529 (0.257) | 0.536 (0.244) | 0.4 (0.212) | 0.332 (0.188) |
illum_change | 0.57 (0.193) | 0.506 (0.231) | 0.554 (0.226) | 0.442 (0.231) | 0.303 (0.128) |
occlusion | 0.694 (0.231) | 0.6 (0.283) | 0.645 (0.239) | 0.485 (0.221) | 0.2 (0.111) |
size | 0.395 (0.223) | 0.445 (0.226) | 0.504 (0.267) | 0.292 (0.179) | 0.317 (0.157) |
motion | 0.592 (0.214) | 0.52 (0.26) | 0.479 (0.245) | 0.345 (0.229) | 0.3 (0.144) |
empty | 0.708 (0.259) | 0.63 (0.256) | 0.621 (0.278) | 0.465 (0.289) | 0.29 (0.232) |
Ranks
| EDFT | PLT | SCTT | FoT | LGT++ |
camera_motion | 1 | 2.5 | 2.5 | 4 | 5 |
illum_change | 1 | 2.5 | 2.5 | 4 | 5 |
occlusion | 1 | 3 | 2 | 4 | 5 |
size | 3 | 1.5 | 1.5 | 5 | 4 |
motion | 1 | 2 | 3 | 4 | 5 |
empty | 1 | 2 | 3 | 4 | 5 |
Average | 1.33 | 2.25 | 2.42 | 4.17 | 4.83 |
Robustness
Raw results
| EDFT | LGT++ | SCTT | FoT | PLT |
camera_motion | 1.33 (1.38) | 2.17 (1.91) | 4.25 (3.89) | 6.33 (7.36) | 7.08 (5.48) |
illum_change | 0.333 (0.477) | 1.8 (1.47) | 2.33 (1.72) | 3.67 (1.72) | 3.33 (1.72) |
occlusion | 1 (1.01) | 0.867 (1.4) | 1.17 (2.62) | 1.17 (2.2) | 1.17 (2.2) |
size | 1.25 (1.3) | 0.992 (1.04) | 1.62 (1.87) | 2.25 (2.23) | 3.12 (3.31) |
motion | 0.923 (1.07) | 1.38 (1.44) | 3 (2.97) | 6.15 (6.91) | 3.85 (3.26) |
empty | 0 (0) | 0.0267 (0.162) | 0 (0) | 0 (0) | 0 (0) |
Ranks
| EDFT | LGT++ | SCTT | FoT | PLT |
camera_motion | 1 | 2 | 3.5 | 4 | 4.5 |
illum_change | 1 | 2.5 | 3.33 | 4 | 4.5 |
occlusion | 2 | 2.67 | 4 | 3.25 | 3.25 |
size | 2 | 1.5 | 2.5 | 4.5 | 4.5 |
motion | 1 | 2 | 3 | 5 | 4 |
empty | 3 | 3 | 3 | 3 | 3 |
Average | 1.67 | 2.28 | 3.22 | 3.96 | 3.96 |
Combined ranking (weight = 0.5)
EDFT | SCTT | PLT | LGT++ | FoT |
1.5 | 2.82 | 3.1 | 3.56 | 4.06 |
Ranking AR-plot for loss_black
Generated on 2013-12-17 15:44:11