Ranking report for experiment baseline
Accuracy
Raw results
| FoT | SCTT | LT-FLO | AIF | PLT | EDFT | DFT | TLD | Matrioska | IVT | CCMS | ASAM | Struck | GSDT | ORIA | PJS-S | LGT++ | SwATrack | LGT | MIL | HT | Meanshift | RDET | CT | STMT | MORP | CACTuS-FL |
camera_motion | 0.64 (0.237) | 0.65 (0.226) | 0.604 (0.199) | 0.606 (0.191) | 0.584 (0.207) | 0.575 (0.236) | 0.582 (0.256) | 0.613 (0.205) | 0.595 (0.21) | 0.603 (0.222) | 0.576 (0.201) | 0.566 (0.235) | 0.58 (0.238) | 0.608 (0.18) | 0.542 (0.276) | 0.552 (0.219) | 0.533 (0.151) | 0.544 (0.187) | 0.517 (0.184) | 0.53 (0.18) | 0.488 (0.2) | 0.482 (0.236) | 0.487 (0.182) | 0.474 (0.159) | 0.407 (0.255) | 0.236 (0.219) | 0.387 (0.203) |
illum_change | 0.773 (0.105) | 0.584 (0.257) | 0.702 (0.125) | 0.626 (0.185) | 0.647 (0.171) | 0.64 (0.176) | 0.615 (0.183) | 0.633 (0.164) | 0.607 (0.148) | 0.685 (0.178) | 0.492 (0.208) | 0.571 (0.224) | 0.599 (0.251) | 0.596 (0.179) | 0.673 (0.206) | 0.511 (0.214) | 0.541 (0.106) | 0.483 (0.172) | 0.513 (0.181) | 0.467 (0.15) | 0.541 (0.212) | 0.43 (0.238) | 0.472 (0.14) | 0.432 (0.138) | 0.228 (0.199) | 0.277 (0.143) | 0.429 (0.19) |
occlusion | 0.576 (0.28) | 0.66 (0.211) | 0.596 (0.22) | 0.63 (0.222) | 0.722 (0.178) | 0.667 (0.251) | 0.691 (0.253) | 0.642 (0.176) | 0.721 (0.199) | 0.511 (0.187) | 0.627 (0.16) | 0.716 (0.208) | 0.723 (0.163) | 0.585 (0.166) | 0.432 (0.305) | 0.589 (0.188) | 0.411 (0.12) | 0.568 (0.12) | 0.446 (0.138) | 0.488 (0.194) | 0.431 (0.165) | 0.34 (0.163) | 0.474 (0.134) | 0.511 (0.12) | 0.424 (0.266) | 0.42 (0.285) | 0.385 (0.164) |
size | 0.562 (0.25) | 0.525 (0.24) | 0.47 (0.204) | 0.49 (0.208) | 0.434 (0.185) | 0.402 (0.23) | 0.403 (0.215) | 0.532 (0.217) | 0.394 (0.22) | 0.458 (0.202) | 0.491 (0.198) | 0.412 (0.215) | 0.435 (0.229) | 0.471 (0.188) | 0.424 (0.227) | 0.404 (0.196) | 0.5 (0.109) | 0.463 (0.203) | 0.42 (0.201) | 0.413 (0.198) | 0.368 (0.22) | 0.413 (0.18) | 0.375 (0.187) | 0.365 (0.166) | 0.466 (0.202) | 0.2 (0.197) | 0.353 (0.234) |
motion | 0.695 (0.201) | 0.619 (0.249) | 0.632 (0.207) | 0.599 (0.209) | 0.614 (0.178) | 0.616 (0.221) | 0.623 (0.224) | 0.6 (0.216) | 0.581 (0.207) | 0.611 (0.211) | 0.582 (0.201) | 0.562 (0.241) | 0.542 (0.254) | 0.593 (0.173) | 0.564 (0.274) | 0.574 (0.22) | 0.575 (0.137) | 0.51 (0.195) | 0.583 (0.155) | 0.508 (0.172) | 0.538 (0.169) | 0.524 (0.234) | 0.492 (0.177) | 0.465 (0.15) | 0.317 (0.219) | 0.224 (0.205) | 0.422 (0.216) |
empty | 0.649 (0.24) | 0.714 (0.21) | 0.656 (0.241) | 0.704 (0.261) | 0.71 (0.258) | 0.7 (0.262) | 0.694 (0.259) | 0.557 (0.25) | 0.64 (0.303) | 0.607 (0.253) | 0.705 (0.249) | 0.696 (0.255) | 0.625 (0.261) | 0.595 (0.204) | 0.614 (0.19) | 0.733 (0.177) | 0.564 (0.127) | 0.621 (0.218) | 0.558 (0.18) | 0.481 (0.257) | 0.47 (0.217) | 0.566 (0.223) | 0.519 (0.2) | 0.458 (0.159) | 0.408 (0.336) | 0.49 (0.267) | 0.343 (0.0934) |
Ranks
| FoT | SCTT | LT-FLO | AIF | PLT | EDFT | DFT | TLD | Matrioska | IVT | CCMS | ASAM | Struck | GSDT | ORIA | PJS-S | LGT++ | SwATrack | LGT | MIL | HT | Meanshift | RDET | CT | STMT | MORP | CACTuS-FL |
camera_motion | 2 | 1 | 5.5 | 4.67 | 9.75 | 12 | 10.5 | 8.33 | 8.75 | 7 | 11 | 11.7 | 12.7 | 8.33 | 12 | 15 | 18 | 16.5 | 20 | 19 | 22 | 22 | 22 | 24 | 25 | 27 | 26 |
illum_change | 1 | 11.5 | 3 | 8 | 8 | 6 | 11 | 9.33 | 12.3 | 3 | 18 | 11.4 | 10.3 | 10.4 | 3 | 19.2 | 15.5 | 21 | 17.5 | 21 | 16.5 | 24 | 21 | 24 | 27 | 22 | 24 |
occlusion | 12.2 | 6.5 | 11.2 | 9.67 | 3 | 7.33 | 3 | 9.5 | 2.75 | 17 | 10 | 3.67 | 2.75 | 13 | 21.2 | 12.3 | 24 | 14.5 | 20 | 18.8 | 22 | 25.5 | 21.3 | 17 | 23.4 | 23.2 | 24.3 |
size | 5 | 4.5 | 6.67 | 5.5 | 12 | 18 | 18.6 | 5 | 16.5 | 11.7 | 6.33 | 17 | 12 | 12 | 13.5 | 16.6 | 5 | 8.33 | 18.9 | 16.4 | 20.2 | 18.5 | 23.5 | 24.5 | 12.6 | 27 | 26 |
motion | 1 | 3 | 3 | 10.3 | 6.75 | 5.5 | 7.67 | 11.4 | 10.7 | 9.67 | 13.7 | 17.5 | 15.7 | 11 | 10.9 | 12.7 | 13.4 | 20.5 | 12.1 | 22 | 19.5 | 20 | 23 | 24 | 26 | 27 | 25 |
empty | 6.14 | 2 | 9 | 6.5 | 5.57 | 6 | 6.4 | 19.8 | 12.8 | 16 | 6.75 | 6.14 | 15.6 | 16.5 | 12.5 | 2 | 18.5 | 14 | 18.5 | 22.7 | 23.5 | 15.7 | 22.7 | 23.5 | 25 | 18 | 27 |
Average | 4.56 | 4.75 | 6.4 | 7.44 | 7.51 | 9.14 | 9.53 | 10.6 | 10.6 | 10.7 | 11 | 11.2 | 11.5 | 11.9 | 12.2 | 13 | 15.7 | 15.8 | 17.8 | 20 | 20.6 | 21 | 22.2 | 22.8 | 23.2 | 24 | 25.4 |
Robustness
Raw results
| PLT | LGT++ | LGT | CCMS | EDFT | FoT | GSDT | RDET | Matrioska | HT | Struck | CT | Meanshift | DFT | MIL | AIF | ASAM | IVT | SwATrack | ORIA | SCTT | PJS-S | LT-FLO | CACTuS-FL | STMT | TLD | MORP |
camera_motion | 0 (0) | 0.117 (0.339) | 0.35 (0.574) | 0.5 (0.647) | 1.08 (1.39) | 1.42 (2.3) | 1.11 (2.11) | 1.52 (1.56) | 1.25 (1.69) | 4.39 (8.05) | 3.5 (9.86) | 1.98 (2.48) | 1.42 (1.44) | 1.58 (1.9) | 1.57 (1.91) | 1.17 (1.69) | 1.58 (1.85) | 1.83 (2.16) | 2.75 (4.83) | 2.16 (2.14) | 2.33 (2.63) | 1.71 (1.96) | 1.58 (1.87) | 4.67 (6.76) | 6.75 (12.1) | 7.58 (12) | 42.2 (19.5) |
illum_change | 0 (0) | 0 (0) | 0 (0) | 0.667 (0.477) | 0.333 (0.477) | 0 (0) | 0.444 (0.624) | 0.0222 (0.149) | 0 (0) | 0 (0) | 0.333 (0.477) | 0.222 (0.517) | 1.33 (0.953) | 0.667 (0.477) | 0.889 (0.959) | 0.556 (0.624) | 1.67 (2.38) | 1 (1.43) | 2.67 (2.38) | 1.6 (2.3) | 1.33 (0.953) | 0.4 (0.618) | 0.311 (0.633) | 2 (2.86) | 9.33 (7.45) | 2 (2.18) | 29 (21.1) |
occlusion | 0 (0) | 0.0778 (0.269) | 0.189 (0.517) | 0.333 (0.474) | 0.5 (0.503) | 1.17 (2.2) | 0.833 (1.93) | 0.856 (1.75) | 0.167 (0.375) | 3.27 (7.44) | 0 (0) | 0.811 (1.73) | 0.167 (0.375) | 0.5 (0.503) | 0.689 (1.55) | 0.678 (1.51) | 0.333 (0.75) | 0.833 (1.47) | 0.5 (1.12) | 0.656 (1.48) | 1.17 (2.2) | 0.622 (1.25) | 0.9 (1.68) | 0.167 (0.375) | 0.667 (1.11) | 1 (1.84) | 9.5 (13.8) |
size | 0 (0) | 0.0583 (0.235) | 0.133 (0.341) | 0.125 (0.332) | 0.375 (0.699) | 0.875 (1.27) | 0.642 (1.33) | 0.933 (0.905) | 1.75 (2.17) | 1.38 (2.98) | 1.88 (3.19) | 0.883 (1.08) | 0.25 (0.435) | 0.375 (0.699) | 0.925 (0.997) | 1.07 (1.37) | 1 (1.33) | 1.25 (1.72) | 0.75 (1.3) | 1.04 (1.77) | 0.875 (1.27) | 1.18 (1.32) | 1.24 (1.44) | 1.75 (2.87) | 5.62 (13.1) | 3.62 (3.62) | 13.9 (12.7) |
motion | 0 (0) | 0.0564 (0.231) | 0.0769 (0.267) | 0.308 (0.463) | 0.385 (0.838) | 0.462 (0.845) | 0.81 (1.37) | 0.559 (0.92) | 1.54 (2.63) | 0.308 (0.745) | 2.38 (3.88) | 0.764 (1.18) | 1.15 (1.1) | 0.846 (1.03) | 0.779 (1.04) | 0.677 (1.25) | 1.69 (2.06) | 1 (1.71) | 3.15 (4.57) | 2.05 (2.34) | 1.15 (1.52) | 0.795 (1.03) | 1.11 (1.39) | 5.15 (6.65) | 4.46 (6.14) | 3.23 (3.71) | 22.2 (19.6) |
empty | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0.587 (1.12) | 0.2 (0.403) | 0.0133 (0.115) | 0 (0) | 0 (0) | 0 (0) | 0.08 (0.273) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0.107 (0.352) | 0.0533 (0.226) | 0.4 (0.805) | 1.4 (1.76) | 0.2 (0.403) | 2.4 (2.82) |
Ranks
| PLT | LGT++ | LGT | CCMS | EDFT | FoT | GSDT | RDET | Matrioska | HT | Struck | CT | Meanshift | DFT | MIL | AIF | ASAM | IVT | SwATrack | ORIA | SCTT | PJS-S | LT-FLO | CACTuS-FL | STMT | TLD | MORP |
camera_motion | 1 | 2 | 3 | 10.7 | 10.7 | 11.4 | 9.8 | 16.5 | 11.5 | 14.6 | 9.33 | 16.7 | 16.5 | 16.5 | 14.3 | 12.3 | 16.5 | 16.7 | 16.5 | 20.9 | 17.2 | 16.5 | 16.2 | 23 | 16.7 | 25 | 27 |
illum_change | 4 | 4 | 4 | 18.2 | 14.6 | 4 | 15.3 | 4 | 4 | 4 | 14.6 | 10 | 21.5 | 18.2 | 18.9 | 16 | 16 | 16 | 21.3 | 16 | 21.5 | 14.6 | 14.7 | 16.5 | 26 | 20.6 | 27 |
occlusion | 1.5 | 5 | 10 | 17.8 | 19.4 | 18.3 | 15.8 | 15.8 | 11.7 | 18.1 | 1.5 | 15.4 | 11.7 | 19.4 | 12.8 | 14 | 12.1 | 18.1 | 12.1 | 12.3 | 18.3 | 15.8 | 18.1 | 11.7 | 17.8 | 18.3 | 27 |
size | 1 | 2.5 | 3.5 | 3 | 6.5 | 15.9 | 9.62 | 17 | 22 | 13.9 | 17.3 | 17.2 | 6.5 | 6.5 | 16.9 | 17.2 | 17.2 | 17.2 | 12.5 | 16.6 | 15.9 | 18.6 | 18.6 | 17.3 | 17.3 | 25 | 27 |
motion | 1 | 2.5 | 2.5 | 6.5 | 5.5 | 7.83 | 11.9 | 10.4 | 15.7 | 5.5 | 16.2 | 13.3 | 19.6 | 15.2 | 13.7 | 9.62 | 19.2 | 13.7 | 23.2 | 21 | 15.9 | 15 | 17.2 | 26 | 24 | 21.4 | 27 |
empty | 9.5 | 9.5 | 9.5 | 9.5 | 9.5 | 9.5 | 9.5 | 9.5 | 9.5 | 23.5 | 23 | 10.5 | 9.5 | 9.5 | 9.5 | 19.5 | 9.5 | 9.5 | 9.5 | 9.5 | 9.5 | 21 | 19.5 | 23.5 | 26 | 23 | 27 |
Average | 3 | 4.25 | 5.42 | 10.9 | 11 | 11.2 | 12 | 12.2 | 12.4 | 13.3 | 13.7 | 13.9 | 14.2 | 14.2 | 14.4 | 14.8 | 15.1 | 15.2 | 15.9 | 16.1 | 16.4 | 16.9 | 17.4 | 19.7 | 21.3 | 22.2 | 27 |
Combined ranking (weight = 0.5)
PLT | FoT | LGT++ | EDFT | SCTT | CCMS | AIF | Matrioska | LGT | DFT | LT-FLO | GSDT | Struck | IVT | ASAM | ORIA | PJS-S | SwATrack | TLD | HT | MIL | RDET | Meanshift | CT | STMT | CACTuS-FL | MORP |
5.26 | 7.85 | 9.99 | 10.1 | 10.6 | 11 | 11.1 | 11.5 | 11.6 | 11.9 | 11.9 | 11.9 | 12.6 | 13 | 13.2 | 14.1 | 15 | 15.8 | 16.4 | 16.9 | 17.2 | 17.2 | 17.6 | 18.3 | 22.2 | 22.5 | 25.5 |
Ranking AR-plot for baseline
Generated on 2013-12-17 15:40:39