Ranking report for experiment grayscale
Accuracy
Raw results
| FoT | PLT | SCTT | EDFT | AIF | LT-FLO | Matrioska | IVT | GSDT | Struck | TLD | ORIA | PJS-S | DFT | CCMS | MIL | LGT++ | RDET | LGT | CT | HT | STMT | Meanshift | CACTuS-FL |
camera_motion | 0.661 (0.218) | 0.622 (0.202) | 0.654 (0.224) | 0.591 (0.23) | 0.579 (0.211) | 0.581 (0.202) | 0.588 (0.21) | 0.62 (0.246) | 0.613 (0.172) | 0.584 (0.226) | 0.542 (0.199) | 0.539 (0.279) | 0.536 (0.216) | 0.524 (0.262) | 0.517 (0.215) | 0.528 (0.193) | 0.494 (0.193) | 0.499 (0.179) | 0.45 (0.18) | 0.475 (0.156) | 0.444 (0.198) | 0.417 (0.255) | 0.413 (0.222) | 0.394 (0.204) |
illum_change | 0.772 (0.101) | 0.618 (0.219) | 0.588 (0.239) | 0.646 (0.174) | 0.671 (0.159) | 0.659 (0.15) | 0.596 (0.177) | 0.715 (0.153) | 0.603 (0.159) | 0.608 (0.219) | 0.583 (0.158) | 0.677 (0.205) | 0.445 (0.217) | 0.593 (0.193) | 0.454 (0.235) | 0.447 (0.15) | 0.456 (0.152) | 0.468 (0.129) | 0.401 (0.16) | 0.427 (0.145) | 0.513 (0.207) | 0.234 (0.214) | 0.259 (0.216) | 0.414 (0.192) |
occlusion | 0.644 (0.225) | 0.721 (0.182) | 0.674 (0.225) | 0.69 (0.228) | 0.514 (0.239) | 0.578 (0.235) | 0.741 (0.189) | 0.473 (0.199) | 0.607 (0.146) | 0.722 (0.168) | 0.652 (0.215) | 0.419 (0.312) | 0.595 (0.171) | 0.612 (0.265) | 0.549 (0.187) | 0.546 (0.153) | 0.447 (0.152) | 0.492 (0.133) | 0.466 (0.15) | 0.517 (0.114) | 0.426 (0.171) | 0.434 (0.249) | 0.337 (0.164) | 0.357 (0.168) |
size | 0.558 (0.24) | 0.447 (0.196) | 0.525 (0.261) | 0.415 (0.237) | 0.468 (0.229) | 0.454 (0.194) | 0.417 (0.218) | 0.424 (0.228) | 0.462 (0.189) | 0.404 (0.227) | 0.552 (0.211) | 0.42 (0.228) | 0.409 (0.189) | 0.362 (0.221) | 0.482 (0.2) | 0.407 (0.208) | 0.416 (0.197) | 0.39 (0.19) | 0.364 (0.192) | 0.356 (0.163) | 0.334 (0.192) | 0.459 (0.199) | 0.359 (0.18) | 0.318 (0.226) |
motion | 0.704 (0.197) | 0.621 (0.19) | 0.605 (0.252) | 0.625 (0.219) | 0.596 (0.22) | 0.61 (0.208) | 0.572 (0.205) | 0.627 (0.242) | 0.605 (0.165) | 0.542 (0.244) | 0.549 (0.202) | 0.56 (0.271) | 0.543 (0.227) | 0.54 (0.27) | 0.529 (0.211) | 0.496 (0.184) | 0.57 (0.167) | 0.498 (0.166) | 0.504 (0.168) | 0.449 (0.151) | 0.505 (0.169) | 0.328 (0.224) | 0.377 (0.262) | 0.398 (0.221) |
empty | 0.696 (0.203) | 0.709 (0.258) | 0.652 (0.284) | 0.7 (0.263) | 0.764 (0.13) | 0.655 (0.249) | 0.642 (0.29) | 0.56 (0.234) | 0.627 (0.213) | 0.607 (0.296) | 0.602 (0.265) | 0.613 (0.198) | 0.712 (0.156) | 0.706 (0.258) | 0.692 (0.247) | 0.544 (0.21) | 0.631 (0.0853) | 0.526 (0.188) | 0.562 (0.151) | 0.433 (0.127) | 0.435 (0.276) | 0.425 (0.336) | 0.397 (0.241) | 0.303 (0.0925) |
Ranks
| FoT | PLT | SCTT | EDFT | AIF | LT-FLO | Matrioska | IVT | GSDT | Struck | TLD | ORIA | PJS-S | DFT | CCMS | MIL | LGT++ | RDET | LGT | CT | HT | STMT | Meanshift | CACTuS-FL |
camera_motion | 1 | 3 | 2 | 8.33 | 8.25 | 8 | 8 | 4 | 8.5 | 9.75 | 11 | 8.33 | 13 | 15 | 16 | 14 | 18 | 17 | 20.5 | 19 | 20.5 | 22.5 | 23 | 23.5 |
illum_change | 1 | 9.4 | 10 | 5.5 | 4 | 5.5 | 11 | 2 | 9 | 9.4 | 12.5 | 3 | 16.2 | 9.6 | 18 | 17 | 17.5 | 16.7 | 22 | 17.7 | 16.5 | 24 | 23 | 21 |
occlusion | 6.5 | 3 | 5.5 | 4.5 | 14.5 | 10 | 1 | 19.5 | 10 | 2 | 6 | 20 | 9 | 8.33 | 12.5 | 12.5 | 20 | 17 | 17 | 14.5 | 20.5 | 20.5 | 23.5 | 23.5 |
size | 4 | 11.6 | 3 | 13.3 | 4.5 | 8.5 | 13.5 | 9.5 | 10.7 | 12.8 | 2 | 12.2 | 12.4 | 19.2 | 4.5 | 12.6 | 14.4 | 18 | 17.8 | 20.3 | 23.5 | 11.5 | 20 | 23.5 |
motion | 1 | 5 | 5.5 | 3.5 | 6.33 | 5 | 10.7 | 3.5 | 7.25 | 14 | 14.3 | 8.5 | 12.3 | 12.5 | 15.3 | 18.3 | 11.3 | 18 | 18 | 21 | 18.5 | 24 | 23 | 22 |
empty | 5 | 3.4 | 10 | 4 | 2 | 11 | 10.2 | 16.5 | 11.5 | 11 | 14.3 | 11.3 | 4.2 | 4 | 6.25 | 17.5 | 11.5 | 19.5 | 16.5 | 21 | 20.8 | 21.5 | 21.5 | 24 |
Average | 3.08 | 5.9 | 6 | 6.52 | 6.6 | 8 | 9.07 | 9.17 | 9.49 | 9.82 | 10 | 10.6 | 11.2 | 11.4 | 12.1 | 15.3 | 15.5 | 17.7 | 18.6 | 18.9 | 20 | 20.7 | 22.3 | 22.9 |
Robustness
Raw results
| PLT | LGT | LGT++ | FoT | GSDT | RDET | EDFT | MIL | Struck | DFT | LT-FLO | CT | HT | Matrioska | ORIA | IVT | PJS-S | Meanshift | SCTT | STMT | CACTuS-FL | CCMS | TLD | AIF |
camera_motion | 0.333 (0.852) | 0.878 (1.15) | 0.561 (0.86) | 1.25 (1.54) | 1.36 (2.39) | 1.36 (1.67) | 1.33 (1.6) | 1.59 (2.13) | 3.5 (10.5) | 1.17 (1.41) | 1.74 (2.12) | 2.21 (2.53) | 5.13 (7.74) | 1.08 (1.39) | 2.17 (2.21) | 1.83 (2.04) | 2.01 (2.56) | 3.17 (2.31) | 2.83 (2.92) | 7.33 (13.5) | 4.75 (6.9) | 3.83 (2.71) | 7.83 (11.4) | 3.49 (4.95) |
illum_change | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0.422 (0.583) | 0 (0) | 0.333 (0.477) | 0.489 (0.757) | 0.333 (0.477) | 0.667 (0.477) | 0.244 (0.57) | 0.4 (0.809) | 0.0444 (0.208) | 0.333 (0.477) | 1.42 (2.09) | 0.667 (0.953) | 0.578 (0.839) | 2.33 (1.91) | 1 (0.826) | 10.3 (7.85) | 3 (3.6) | 5 (2.18) | 1.33 (1.26) | 1.42 (0.657) |
occlusion | 0 (0) | 0.356 (1.03) | 0.256 (0.696) | 0.667 (1.11) | 0.889 (1.93) | 0.9 (1.94) | 0.833 (1.07) | 0.756 (1.72) | 0 (0) | 0.333 (0.474) | 1.01 (1.92) | 0.867 (1.79) | 3.33 (7.65) | 0.167 (0.375) | 0.7 (1.59) | 0.833 (1.47) | 0.722 (1.41) | 0.833 (1.87) | 1.33 (2.57) | 0.333 (0.75) | 0.5 (0.768) | 0.833 (1.07) | 2 (3.63) | 2.5 (4.95) |
size | 0 (0) | 0.375 (0.609) | 0.325 (0.505) | 0.875 (1.06) | 0.592 (1.22) | 0.95 (0.906) | 0.625 (0.861) | 0.942 (1.06) | 1.5 (3.25) | 0.875 (1.54) | 1.21 (1.54) | 0.992 (1.16) | 1.64 (2.46) | 1.5 (2.3) | 0.983 (1.8) | 1.88 (1.91) | 1.3 (1.52) | 1.25 (1.65) | 1.75 (1.65) | 5.88 (14.1) | 1.38 (2.61) | 1.75 (1.49) | 4 (4.2) | 1.94 (2.05) |
motion | 0.0769 (0.267) | 0.205 (0.527) | 0.185 (0.415) | 0.615 (1.01) | 0.821 (1.3) | 0.769 (1.01) | 0.538 (0.932) | 0.897 (1.25) | 2.23 (3.61) | 0.769 (1.12) | 1.22 (1.45) | 1.13 (1.38) | 0.836 (1.55) | 1.54 (2.51) | 2.07 (2.31) | 1.23 (1.85) | 1.21 (1.56) | 2.38 (2.31) | 1.54 (1.5) | 4.62 (6.29) | 5.31 (6.64) | 2 (2.08) | 3.08 (3.39) | 1.59 (2.04) |
empty | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0.0133 (0.115) | 0 (0) | 0 (0) | 0.2 (0.403) | 0 (0) | 0.0267 (0.162) | 0 (0) | 1.43 (2.14) | 0.2 (0.403) | 0.0133 (0.115) | 0 (0) | 0.08 (0.273) | 0 (0) | 0 (0) | 1.2 (1.61) | 0.4 (0.805) | 0 (0) | 0 (0) | 0.12 (0.327) |
Ranks
| PLT | LGT | LGT++ | FoT | GSDT | RDET | EDFT | MIL | Struck | DFT | LT-FLO | CT | HT | Matrioska | ORIA | IVT | PJS-S | Meanshift | SCTT | STMT | CACTuS-FL | CCMS | TLD | AIF |
camera_motion | 1 | 8.17 | 13 | 8.33 | 7.25 | 10 | 9.22 | 10 | 10.5 | 8.33 | 12.6 | 14.7 | 16.5 | 8.33 | 15.1 | 13.2 | 13.2 | 20.7 | 17.7 | 9 | 19.7 | 22 | 20 | 19.2 |
illum_change | 3.5 | 3.5 | 3.5 | 3.5 | 12 | 3.5 | 12 | 12 | 12 | 16.2 | 10 | 12 | 3.5 | 12 | 13.6 | 12.8 | 12.8 | 20.7 | 19.2 | 24 | 19.4 | 23 | 19.2 | 20 |
occlusion | 1.5 | 12.4 | 9.62 | 15 | 13 | 12.5 | 17.1 | 11.5 | 1.5 | 14.1 | 15.9 | 13 | 13.6 | 12.4 | 11.3 | 15.3 | 14.1 | 11.5 | 15.5 | 11.7 | 15.2 | 17.1 | 18.4 | 16.9 |
size | 1 | 7.75 | 6.4 | 12.8 | 7.75 | 13.2 | 10.1 | 13.1 | 10.6 | 9.56 | 13.2 | 13.4 | 13.9 | 13.4 | 11.1 | 20.5 | 13.2 | 13.4 | 20 | 12.3 | 11.2 | 20.5 | 23 | 20.5 |
motion | 1 | 2.5 | 2.5 | 6.5 | 9.33 | 11.1 | 6.5 | 11.4 | 12.1 | 10.7 | 14.6 | 14 | 6.5 | 11.6 | 19 | 13.2 | 14 | 20.6 | 17.5 | 21.2 | 24 | 18.5 | 22 | 15.2 |
empty | 9 | 9 | 9 | 9 | 9 | 9.5 | 9 | 9 | 20.5 | 9 | 9.5 | 9 | 23.5 | 20.5 | 9.5 | 9 | 17 | 9 | 9 | 23.5 | 20.5 | 9 | 9 | 20 |
Average | 2.83 | 7.21 | 7.34 | 9.19 | 9.72 | 9.97 | 10.7 | 11.2 | 11.2 | 11.3 | 12.6 | 12.7 | 12.9 | 13 | 13.3 | 14 | 14.1 | 16 | 16.5 | 17 | 18.3 | 18.4 | 18.6 | 18.6 |
Combined ranking (weight = 0.5)
PLT | FoT | EDFT | GSDT | LT-FLO | Struck | Matrioska | SCTT | DFT | LGT++ | IVT | ORIA | AIF | PJS-S | LGT | MIL | RDET | TLD | CCMS | CT | HT | STMT | Meanshift | CACTuS-FL |
4.37 | 6.13 | 8.59 | 9.6 | 10.3 | 10.5 | 11 | 11.2 | 11.4 | 11.4 | 11.6 | 11.9 | 12.6 | 12.6 | 12.9 | 13.2 | 13.8 | 14.3 | 15.2 | 15.8 | 16.5 | 18.8 | 19.1 | 20.6 |
Ranking AR-plot for grayscale
Generated on 2013-12-17 15:43:14