Ranking report for experiment region_noise
Accuracy
Raw results
| PLT | FoT | CCMS | LT-FLO | SCTT | TLD | EDFT | AIF | Matrioska | GSDT | IVT | DFT | Struck | LGT++ | PJS-S | SwATrack | ORIA | LGT | Meanshift | MIL | HT | RDET | CT | STMT | CACTuS-FL | MORP |
camera_motion | 0.574 (0.17) | 0.606 (0.195) | 0.562 (0.179) | 0.564 (0.159) | 0.581 (0.17) | 0.578 (0.149) | 0.553 (0.19) | 0.564 (0.156) | 0.564 (0.168) | 0.581 (0.158) | 0.558 (0.201) | 0.539 (0.194) | 0.546 (0.187) | 0.522 (0.141) | 0.52 (0.187) | 0.525 (0.183) | 0.502 (0.22) | 0.508 (0.17) | 0.494 (0.178) | 0.509 (0.164) | 0.485 (0.197) | 0.492 (0.175) | 0.467 (0.156) | 0.402 (0.248) | 0.397 (0.193) | 0.216 (0.207) |
illum_change | 0.614 (0.142) | 0.713 (0.0799) | 0.491 (0.162) | 0.641 (0.105) | 0.599 (0.131) | 0.663 (0.0939) | 0.625 (0.151) | 0.584 (0.145) | 0.561 (0.138) | 0.583 (0.15) | 0.657 (0.134) | 0.607 (0.154) | 0.555 (0.165) | 0.53 (0.106) | 0.527 (0.139) | 0.471 (0.17) | 0.624 (0.158) | 0.509 (0.172) | 0.42 (0.175) | 0.46 (0.142) | 0.548 (0.212) | 0.483 (0.14) | 0.428 (0.138) | 0.21 (0.172) | 0.433 (0.193) | 0.289 (0.193) |
occlusion | 0.672 (0.127) | 0.54 (0.143) | 0.615 (0.131) | 0.547 (0.161) | 0.6 (0.172) | 0.558 (0.151) | 0.637 (0.166) | 0.577 (0.163) | 0.664 (0.145) | 0.544 (0.126) | 0.472 (0.161) | 0.619 (0.166) | 0.64 (0.142) | 0.413 (0.117) | 0.558 (0.171) | 0.553 (0.109) | 0.416 (0.235) | 0.445 (0.131) | 0.415 (0.137) | 0.502 (0.121) | 0.42 (0.159) | 0.464 (0.138) | 0.507 (0.12) | 0.418 (0.261) | 0.378 (0.158) | 0.422 (0.297) |
size | 0.447 (0.177) | 0.513 (0.215) | 0.482 (0.189) | 0.452 (0.168) | 0.495 (0.201) | 0.504 (0.191) | 0.396 (0.179) | 0.463 (0.175) | 0.395 (0.167) | 0.453 (0.183) | 0.391 (0.188) | 0.374 (0.168) | 0.377 (0.211) | 0.499 (0.113) | 0.375 (0.172) | 0.448 (0.206) | 0.416 (0.191) | 0.419 (0.191) | 0.418 (0.146) | 0.404 (0.169) | 0.375 (0.219) | 0.384 (0.178) | 0.373 (0.154) | 0.466 (0.199) | 0.351 (0.236) | 0.186 (0.191) |
motion | 0.586 (0.146) | 0.644 (0.16) | 0.559 (0.174) | 0.583 (0.17) | 0.565 (0.17) | 0.573 (0.15) | 0.579 (0.176) | 0.556 (0.175) | 0.528 (0.182) | 0.574 (0.148) | 0.559 (0.193) | 0.574 (0.173) | 0.494 (0.214) | 0.564 (0.126) | 0.536 (0.178) | 0.483 (0.191) | 0.515 (0.212) | 0.568 (0.143) | 0.497 (0.188) | 0.489 (0.15) | 0.539 (0.17) | 0.495 (0.161) | 0.458 (0.135) | 0.316 (0.205) | 0.434 (0.212) | 0.212 (0.197) |
empty | 0.642 (0.196) | 0.584 (0.149) | 0.656 (0.213) | 0.611 (0.191) | 0.604 (0.201) | 0.565 (0.2) | 0.626 (0.228) | 0.629 (0.227) | 0.58 (0.225) | 0.552 (0.171) | 0.555 (0.178) | 0.618 (0.222) | 0.553 (0.241) | 0.579 (0.0878) | 0.64 (0.144) | 0.605 (0.186) | 0.584 (0.157) | 0.545 (0.172) | 0.569 (0.171) | 0.502 (0.18) | 0.467 (0.21) | 0.486 (0.183) | 0.427 (0.128) | 0.372 (0.288) | 0.343 (0.102) | 0.421 (0.284) |
Ranks
| PLT | FoT | CCMS | LT-FLO | SCTT | TLD | EDFT | AIF | Matrioska | GSDT | IVT | DFT | Struck | LGT++ | PJS-S | SwATrack | ORIA | LGT | Meanshift | MIL | HT | RDET | CT | STMT | CACTuS-FL | MORP |
camera_motion | 5.25 | 1 | 6.5 | 6.8 | 5.5 | 4.75 | 8.67 | 7 | 7.5 | 5.75 | 9.5 | 13.5 | 11.5 | 16.5 | 16 | 13.5 | 18 | 17.2 | 20.5 | 18 | 22 | 20.5 | 23 | 24 | 25 | 26 |
illum_change | 7.5 | 1 | 17.5 | 5 | 10 | 4 | 5 | 10 | 12.5 | 10 | 3 | 7.5 | 14 | 15 | 15 | 20.5 | 4.25 | 16.5 | 23 | 20.5 | 15 | 19 | 22.5 | 25.5 | 23 | 25.5 |
occlusion | 1.5 | 12.3 | 5 | 11.8 | 7 | 9.75 | 4.33 | 12.3 | 1.5 | 12 | 17.5 | 5.5 | 3.5 | 22.8 | 9.5 | 12.5 | 23 | 18.5 | 22.5 | 15.5 | 22 | 18.5 | 15.5 | 23.5 | 24 | 19.3 |
size | 7.5 | 3 | 3.33 | 10 | 5.75 | 3.67 | 18 | 8.33 | 16.7 | 11.4 | 14.3 | 22.5 | 18.8 | 3 | 21.5 | 8 | 11.8 | 14.8 | 13.5 | 14.2 | 20 | 20.5 | 22 | 10 | 23 | 26 |
motion | 2 | 1 | 8.33 | 3.5 | 9.86 | 8.5 | 6 | 10.7 | 15.5 | 9 | 7.83 | 9.33 | 19 | 9.71 | 15.5 | 20.3 | 16 | 9.2 | 19.8 | 21.5 | 15 | 18.5 | 23 | 25 | 24 | 26 |
empty | 2.5 | 12.5 | 1 | 7.5 | 7.8 | 16.3 | 6.86 | 6.67 | 9.86 | 16.5 | 16 | 10.2 | 12.6 | 13.1 | 3.5 | 9 | 11 | 16 | 10.5 | 21 | 21.8 | 21.5 | 23.5 | 25 | 26 | 23 |
Average | 4.38 | 5.14 | 6.94 | 7.43 | 7.65 | 7.83 | 8.14 | 9.17 | 10.6 | 10.8 | 11.4 | 11.4 | 13.2 | 13.4 | 13.5 | 14 | 14 | 15.4 | 18.3 | 18.5 | 19.3 | 19.8 | 21.6 | 22.2 | 24.2 | 24.3 |
Robustness
Raw results
| PLT | LGT++ | LGT | CCMS | FoT | RDET | GSDT | HT | Struck | CT | MIL | EDFT | LT-FLO | Matrioska | PJS-S | IVT | AIF | CACTuS-FL | DFT | ORIA | SwATrack | SCTT | Meanshift | STMT | TLD | MORP |
camera_motion | 0.0778 (0.269) | 0.128 (0.382) | 0.289 (0.501) | 0.444 (0.764) | 1.66 (2.26) | 1.58 (1.74) | 1.14 (2.11) | 4.7 (8.67) | 4.14 (10.3) | 2.41 (2.86) | 1.71 (2.2) | 1.37 (1.66) | 1.58 (2.05) | 1.24 (1.52) | 1.7 (2) | 2.08 (2.63) | 1.29 (1.76) | 3.92 (7.32) | 1.72 (1.62) | 2.25 (2.25) | 2.59 (4.23) | 2.54 (2.81) | 2.52 (3.37) | 7.02 (12.8) | 7.82 (11.9) | 42.2 (19.4) |
illum_change | 0 (0) | 0.0889 (0.288) | 0.0222 (0.149) | 0.733 (0.963) | 0.0222 (0.149) | 0 (0) | 0.489 (0.661) | 0 (0) | 0.356 (0.857) | 0.0889 (0.288) | 0.556 (0.841) | 0.333 (0.564) | 0.444 (0.725) | 0.2 (0.405) | 0.267 (0.495) | 0.644 (0.933) | 0.889 (0.804) | 2.33 (3.34) | 0.689 (0.763) | 1.42 (2.07) | 2.78 (2.58) | 1.11 (0.959) | 1.38 (1.27) | 9.84 (8) | 1.6 (2) | 29.3 (20.3) |
occlusion | 0.0111 (0.105) | 0.0222 (0.148) | 0.111 (0.35) | 0.244 (0.432) | 0.933 (2.05) | 0.833 (1.9) | 0.689 (1.38) | 3.78 (8.31) | 0.0667 (0.251) | 0.911 (1.92) | 0.678 (1.64) | 0.556 (0.823) | 0.878 (1.95) | 0.422 (0.653) | 0.589 (1.24) | 0.911 (1.76) | 0.7 (1.52) | 0.333 (0.75) | 0.467 (0.603) | 0.656 (1.5) | 0.489 (1.06) | 1.13 (2.09) | 0.4 (0.859) | 0.667 (1.11) | 1.36 (3.04) | 10 (13.9) |
size | 0.0167 (0.129) | 0.0417 (0.201) | 0.1 (0.301) | 0.158 (0.534) | 0.875 (1.38) | 0.917 (0.856) | 0.7 (1.42) | 1.16 (2.39) | 1.57 (3.32) | 0.808 (0.955) | 0.817 (1.02) | 1.03 (1.08) | 1.01 (1.45) | 1.56 (2.15) | 1.23 (1.33) | 1.57 (1.83) | 1.21 (1.53) | 1.5 (2.88) | 1.04 (1.36) | 1.22 (2.02) | 0.808 (1.52) | 1.21 (1.41) | 1.59 (2.22) | 5.99 (14.1) | 3.8 (4.07) | 14 (13.7) |
motion | 0.0359 (0.187) | 0.0718 (0.296) | 0.0872 (0.283) | 0.359 (0.613) | 0.636 (1.15) | 0.497 (0.833) | 0.851 (1.48) | 0.349 (0.82) | 2.48 (3.89) | 0.708 (1.08) | 0.892 (1.31) | 0.667 (0.998) | 1.08 (1.35) | 1.49 (2.59) | 0.841 (1.19) | 1.29 (1.81) | 0.872 (1.42) | 5.15 (7.41) | 1.06 (1.22) | 2.12 (2.44) | 2.85 (4.08) | 1.3 (1.46) | 1.84 (1.94) | 4.42 (6.2) | 3.31 (3.59) | 21.9 (19.5) |
empty | 0 (0) | 0 (0) | 0 (0) | 0 (0) | 0.0267 (0.162) | 0 (0) | 0.0133 (0.115) | 1.07 (2.57) | 0.213 (0.444) | 0.0133 (0.115) | 0 (0) | 0 (0) | 0.04 (0.197) | 0.0667 (0.251) | 0.0533 (0.226) | 0 (0) | 0.08 (0.273) | 0 (0) | 0 (0) | 0.0133 (0.115) | 0.0133 (0.115) | 0 (0) | 0.0133 (0.115) | 1.43 (1.8) | 0.0133 (0.115) | 2.33 (2.69) |
Ranks
| PLT | LGT++ | LGT | CCMS | FoT | RDET | GSDT | HT | Struck | CT | MIL | EDFT | LT-FLO | Matrioska | PJS-S | IVT | AIF | CACTuS-FL | DFT | ORIA | SwATrack | SCTT | Meanshift | STMT | TLD | MORP |
camera_motion | 1.5 | 1.5 | 3.5 | 3.5 | 13.8 | 15 | 13.5 | 14.4 | 13.5 | 18.1 | 13.8 | 13.7 | 13.8 | 13.3 | 14 | 16 | 13.3 | 15.5 | 17.1 | 18.7 | 14.1 | 18.6 | 16.8 | 14.4 | 25 | 26 |
illum_change | 3 | 6.83 | 4 | 16.5 | 4 | 3 | 14.6 | 3 | 10.5 | 6.83 | 14.1 | 13.9 | 14.1 | 9.62 | 13.6 | 14.9 | 19 | 16.4 | 17.1 | 16.4 | 22 | 20.5 | 21 | 25 | 19.5 | 26 |
occlusion | 2 | 2 | 8.2 | 14.8 | 15 | 14.8 | 15.4 | 15.9 | 2.5 | 15 | 13.5 | 17.2 | 15 | 15.4 | 14.6 | 17.3 | 14.6 | 13.7 | 17.3 | 13.5 | 14.1 | 17.7 | 14.8 | 15.4 | 15 | 26 |
size | 1.5 | 2.5 | 3 | 3 | 11.9 | 15.4 | 10.8 | 13.8 | 11.9 | 14.7 | 14.2 | 15.4 | 14.4 | 17.3 | 16.7 | 17.8 | 15.5 | 14.6 | 15.2 | 14.2 | 12.4 | 15.6 | 15.6 | 15.5 | 24 | 26 |
motion | 1.5 | 2 | 2.5 | 5.5 | 8.88 | 7.67 | 9.5 | 4.5 | 13.9 | 11.5 | 12.5 | 11.5 | 16.8 | 13.6 | 13.1 | 15.5 | 12.1 | 22.6 | 16.8 | 21.2 | 22.2 | 16.6 | 22 | 22.2 | 23.5 | 26 |
empty | 10 | 10 | 10 | 10 | 11.5 | 10 | 11.5 | 24 | 23.5 | 11.5 | 10 | 10 | 11.5 | 17 | 17 | 10 | 17 | 10 | 10 | 11.5 | 11.5 | 10 | 11.5 | 24.5 | 11.5 | 26 |
Average | 3.25 | 4.14 | 5.2 | 8.87 | 10.8 | 11 | 12.6 | 12.6 | 12.6 | 12.9 | 13 | 13.6 | 14.3 | 14.4 | 14.8 | 15.2 | 15.3 | 15.5 | 15.6 | 15.9 | 16.1 | 16.5 | 16.9 | 19.5 | 19.8 | 26 |
Combined ranking (weight = 0.5)
PLT | CCMS | FoT | LGT++ | LGT | LT-FLO | EDFT | GSDT | SCTT | AIF | Matrioska | Struck | IVT | DFT | TLD | PJS-S | ORIA | SwATrack | RDET | MIL | HT | CT | Meanshift | CACTuS-FL | STMT | MORP |
3.81 | 7.91 | 7.99 | 8.75 | 10.3 | 10.8 | 10.9 | 11.7 | 12.1 | 12.2 | 12.5 | 12.9 | 13.3 | 13.5 | 13.8 | 14.2 | 15 | 15 | 15.4 | 15.7 | 16 | 17.3 | 17.6 | 19.8 | 20.8 | 25.2 |
Ranking AR-plot for region_noise
Generated on 2013-12-17 15:42:12