Ranking report for experiment skipping
Accuracy
Raw results
| FoT | EDFT | PLT | SCTT | LGT++ |
camera_motion | 0.665 (0.21) | 0.614 (0.228) | 0.597 (0.218) | 0.601 (0.255) | 0.478 (0.148) |
illum_change | 0.726 (0.136) | 0.626 (0.169) | 0.613 (0.221) | 0.586 (0.271) | 0.506 (0.108) |
occlusion | 0.689 (0.179) | 0.764 (0.187) | 0.749 (0.142) | 0.667 (0.241) | 0.412 (0.143) |
size | 0.552 (0.246) | 0.375 (0.222) | 0.442 (0.194) | 0.526 (0.256) | 0.419 (0.144) |
motion | 0.679 (0.203) | 0.633 (0.226) | 0.607 (0.192) | 0.538 (0.274) | 0.494 (0.163) |
empty | 0.697 (0.18) | 0.707 (0.274) | 0.678 (0.269) | 0.655 (0.271) | 0.55 (0.0841) |
Ranks
| FoT | EDFT | PLT | SCTT | LGT++ |
camera_motion | 1 | 3 | 3 | 3.5 | 5 |
illum_change | 1 | 3 | 3.5 | 3 | 5 |
occlusion | 3.5 | 1 | 2 | 3.5 | 5 |
size | 1 | 5 | 3.5 | 2 | 3.5 |
motion | 1 | 2.5 | 2.5 | 4 | 5 |
empty | 2.5 | 2.33 | 3 | 2.5 | 5 |
Average | 1.67 | 2.81 | 2.92 | 3.08 | 4.75 |
Robustness
Raw results
| PLT | LGT++ | FoT | EDFT | SCTT |
camera_motion | 0.417 (0.864) | 1.38 (2.18) | 1.25 (1.64) | 1.75 (2.05) | 3.83 (3.47) |
illum_change | 1 (1.43) | 1.91 (2.77) | 1.33 (1.91) | 1.33 (1.91) | 2.33 (2.08) |
occlusion | 0.167 (0.375) | 0.189 (0.421) | 0.333 (0.474) | 0.5 (0.503) | 1.17 (2.2) |
size | 0.125 (0.332) | 0.717 (1.37) | 0.875 (1.62) | 1.62 (1.94) | 1.38 (1.87) |
motion | 0.462 (0.845) | 1.51 (2.28) | 1.23 (1.85) | 1.54 (2.07) | 3.31 (3.65) |
empty | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) |
Ranks
| PLT | LGT++ | FoT | EDFT | SCTT |
camera_motion | 1 | 2.5 | 2.5 | 4 | 5 |
illum_change | 2.5 | 3 | 2.5 | 2.5 | 4.5 |
occlusion | 1.5 | 1.5 | 4 | 4.5 | 4 |
size | 1 | 2.5 | 2.5 | 4.5 | 4.5 |
motion | 1 | 3 | 2.5 | 3.5 | 5 |
empty | 3 | 3 | 3 | 3 | 3 |
Average | 1.67 | 2.58 | 2.83 | 3.67 | 4.33 |
Combined ranking (weight = 0.5)
FoT | PLT | EDFT | LGT++ | SCTT |
2.25 | 2.29 | 3.24 | 3.67 | 3.71 |
Ranking AR-plot for skipping
Generated on 2013-12-17 15:44:20