conf thres vs MOT metrics
HOTA: exp193-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA OWTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-04-FRCNN 48.721 46.822 51.587 59.895 61.341 59.018 73.129 81.221 55.412 67.151 70.458 47.314
MOT17-05-FRCNN 34.533 31.4 38.63 53.39 38.064 52.004 52.517 74.943 45.27 55.282 60.894 33.664
MOT17-09-FRCNN 45.387 43.126 47.957 63.477 53.072 53.716 73.071 82.544 55.159 60.065 74.711 44.875
MOT17-10-FRCNN 41.962 43.154 41.206 59.038 53.222 48.81 64.169 77.204 49.271 61.579 67.517 41.576
MOT17-11-FRCNN 44.197 35.006 56.323 64.51 41.063 65.268 76.605 82.809 60.175 58.295 72.303 42.149
MOT17-13-FRCNN 41.378 40.003 43.588 53.979 53.175 53.341 61.634 78.136 48.315 57.004 69.812 39.796
COMBINED 45.169 42.256 49.204 59.231 53.688 57.527 70.298 80.129 53.774 62.632 69.674 43.638
CLEAR: exp193-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-04-FRCNN 34.437 80.589 34.884 66.264 67.863 36.145 40.964 22.892 21.574 31513 16044 14923 213 30 34 19 531
MOT17-05-FRCNN -20.442 72.742 -16.828 61.718 44.001 24.06 65.414 10.526 -37.265 4269 2648 5433 250 32 87 14 275
MOT17-09-FRCNN 28 81.25 28.939 74.272 62.098 50 50 0 14.074 3955 1370 2414 50 13 13 0 80
MOT17-10-FRCNN 31.646 74.285 34.021 72.474 65.335 40.351 56.14 3.5088 13.009 9305 3534 4937 305 23 32 2 457
MOT17-11-FRCNN -16.257 82.663 -15.6 70.75 45.035 36 40 24 -28.523 6676 2760 8148 62 27 30 18 98
MOT17-13-FRCNN 30.819 74.904 32.898 67.205 66.204 36.364 49.091 14.545 13.953 7824 3818 3994 242 40 54 16 364
COMBINED 24.084 78.697 25.282 67.803 61.458 34.091 51.653 14.256 9.6407 63542 30174 39849 1122 165 250 69 1805
Identity: exp193-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-04-FRCNN 55.528 54.873 56.198 26096 21461 20340
MOT17-05-FRCNN 40.243 48.345 34.467 3344 3573 6358
MOT17-09-FRCNN 53.84 59.117 49.427 3148 2177 3221
MOT17-10-FRCNN 52.635 55.511 50.042 7127 5712 7115
MOT17-11-FRCNN 47.139 60.598 38.573 5718 3718 9106
MOT17-13-FRCNN 53.64 54.046 53.241 6292 5350 5526
COMBINED 52.484 55.193 50.029 51725 41991 51666
Count: exp193-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-04-FRCNN 46436 47557 250 83
MOT17-05-FRCNN 9702 6917 250 133
MOT17-09-FRCNN 6369 5325 135 26
MOT17-10-FRCNN 14242 12839 188 57
MOT17-11-FRCNN 14824 9436 346 75
MOT17-13-FRCNN 11818 11642 232 110
COMBINED 103391 93716 1401 484
HOTA: exp194-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA OWTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-04-FRCNN 50.392 45.268 56.493 50.979 72.783 61.442 80.658 83.316 53.612 67.291 74.795 50.33
MOT17-05-FRCNN 39.464 39.211 40.216 48.792 55.821 52.029 57.559 75.87 44.23 62.225 63.754 39.671
MOT17-09-FRCNN 50.905 50.854 51.073 62.506 66.688 56.213 76.854 83.401 56.499 65.937 78.059 51.47
MOT17-10-FRCNN 46.734 48.068 45.678 54.355 67.878 51.402 71.664 78.349 49.814 66.595 70.81 47.157
MOT17-11-FRCNN 52.931 45.914 61.441 61.794 59.517 68.206 80.528 83.618 61.572 69.841 74.315 51.902
MOT17-13-FRCNN 43.95 39.592 49.186 43.292 70.677 55.223 71.395 79.886 46.087 58.533 73.967 43.295
COMBINED 48.848 44.798 53.826 52.069 68.194 59.815 77.333 81.731 52.848 66.037 73.388 48.463
CLEAR: exp194-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-04-FRCNN 43.825 82.651 43.977 57.009 81.393 26.506 42.169 31.325 33.934 27112 20445 6198 72 22 35 26 411
MOT17-05-FRCNN 23.146 73.875 24.722 56.065 64.142 19.549 64.662 15.789 8.4989 3878 3039 2168 109 26 86 21 250
MOT17-09-FRCNN 50.779 81.694 51.324 72.526 77.379 46.154 50 3.8462 37.503 3862 1463 1129 29 12 13 1 61
MOT17-10-FRCNN 52.917 75.237 53.61 66.843 83.474 33.333 57.895 8.7719 36.365 8582 4257 1699 89 19 33 5 380
MOT17-11-FRCNN 31.03 83.542 31.359 67.592 65.102 37.333 29.333 33.333 19.906 6378 3058 3419 31 28 22 25 62
MOT17-13-FRCNN 46.195 76.536 46.976 54.114 88.347 29.091 41.818 29.091 33.497 6300 5342 831 91 32 46 32 260
COMBINED 42.946 80.259 43.395 59.875 78.417 28.719 48.554 22.727 31.126 56112 37604 15444 421 139 235 110 1424
Identity: exp194-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-04-FRCNN 59.263 50.386 71.936 23962 23595 9348
MOT17-05-FRCNN 48.708 45.641 52.216 3157 3760 2889
MOT17-09-FRCNN 62.97 60.995 65.077 3248 2077 1743
MOT17-10-FRCNN 61.522 55.394 69.176 7112 5727 3169
MOT17-11-FRCNN 59.907 61.053 58.804 5761 3675 4036
MOT17-13-FRCNN 58.968 47.543 77.619 5535 6107 1596
COMBINED 59.024 52.046 68.163 48775 44941 22781
Count: exp194-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-04-FRCNN 33310 47557 158 83
MOT17-05-FRCNN 6046 6917 161 133
MOT17-09-FRCNN 4991 5325 67 26
MOT17-10-FRCNN 10281 12839 130 57
MOT17-11-FRCNN 9797 9436 169 75
MOT17-13-FRCNN 7131 11642 127 110
COMBINED 71556 93716 812 484
HOTA: exp195-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA OWTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-04-FRCNN 46.697 39.076 56.05 41.895 78.274 59.99 83.93 84.652 48.427 59.931 77.513 46.454
MOT17-05-FRCNN 38.313 37.001 40.031 40.878 67.082 48.534 63.868 77.891 40.404 55.148 68.87 37.981
MOT17-09-FRCNN 50.259 55.368 45.777 60.052 78.725 51.236 75.295 83.754 52.425 64.623 78.897 50.985
MOT17-10-FRCNN 45.051 44.35 45.889 47.74 73.195 51.186 73.462 79.588 46.8 61.812 73.504 45.434
MOT17-11-FRCNN 55.179 50.386 60.733 58.842 71.829 66.331 83.227 84.749 59.756 69.888 78.246 54.684
MOT17-13-FRCNN 39.431 30.936 50.48 32.406 76.17 55.472 75.705 81.504 40.419 50.583 76.729 38.812
COMBINED 46.413 40.735 53.273 44.18 75.571 58.269 80.269 83.061 48.452 60.217 76.367 45.986
CLEAR: exp195-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-04-FRCNN 38.552 84.25 38.674 46.098 86.128 18.072 44.578 37.349 31.291 21923 25634 3531 58 15 37 31 381
MOT17-05-FRCNN 35.434 75.506 36.273 48.605 79.763 14.286 63.91 21.805 23.529 3362 3555 853 58 19 85 29 185
MOT17-09-FRCNN 63.718 82.132 64.451 70.366 92.245 46.154 46.154 7.6923 51.145 3747 1578 315 39 12 12 2 67
MOT17-10-FRCNN 52.333 76.452 52.777 59 90.459 26.316 52.632 21.053 38.44 7575 5264 799 57 15 30 12 287
MOT17-11-FRCNN 47.923 84.223 48.241 65.081 79.444 29.333 29.333 41.333 37.655 6141 3295 1589 30 22 22 31 63
MOT17-13-FRCNN 36.961 78.422 37.356 39.95 93.903 18.182 36.364 45.455 28.34 4651 6991 302 46 20 40 50 148
COMBINED 42.386 81.641 42.693 50.577 86.513 21.281 46.694 32.025 33.1 47399 46317 7389 288 103 226 155 1131
Identity: exp195-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-04-FRCNN 55.192 42.366 79.155 20148 27409 5306
MOT17-05-FRCNN 49.281 39.656 65.077 2743 4174 1472
MOT17-09-FRCNN 61.298 54.028 70.827 2877 2448 1185
MOT17-10-FRCNN 58.577 48.392 74.194 6213 6626 2161
MOT17-11-FRCNN 62.915 57.228 69.858 5400 4036 2330
MOT17-13-FRCNN 51.485 36.695 86.251 4272 7370 681
COMBINED 56.097 44.446 76.026 41653 52063 13135
Count: exp195-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-04-FRCNN 25454 47557 120 83
MOT17-05-FRCNN 4215 6917 122 133
MOT17-09-FRCNN 4062 5325 56 26
MOT17-10-FRCNN 8374 12839 87 57
MOT17-11-FRCNN 7730 9436 122 75
MOT17-13-FRCNN 4953 11642 100 110
COMBINED 54788 93716 607 484
HOTA: exp197-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA OWTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-04-FRCNN 39.05 28.933 52.846 30.088 81.817 56.082 81.84 85.667 39.853 48.374 80.263 38.826
MOT17-05-FRCNN 34.488 27.632 43.121 28.664 77.358 46.741 76.819 81.637 35.152 44.163 76.817 33.925
MOT17-09-FRCNN 51.433 53.083 49.924 55.978 82.298 53.791 79.524 84.737 52.862 64.476 80.854 52.131
MOT17-10-FRCNN 39.938 34.124 46.784 35.657 77.096 49.429 79.729 81.273 40.837 52.655 76.322 40.187
MOT17-11-FRCNN 55.225 50.7 60.334 54.132 82.266 64.047 85.972 86.292 57.139 67.076 82.285 55.193
MOT17-13-FRCNN 28.908 18.149 46.085 18.535 81.211 48.208 84.083 84.579 29.222 35.011 81.25 28.446
COMBINED 40.689 31.837 52.206 33.202 80.867 55.52 82.442 84.683 41.601 50.544 79.872 40.371
CLEAR: exp197-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-04-FRCNN 29.375 84.914 29.457 33.116 90.051 10.843 36.145 53.012 24.379 15749 31808 1740 39 9 30 44 352
MOT17-05-FRCNN 31.329 79.27 31.531 34.292 92.548 7.5188 47.368 45.113 24.22 2372 4545 191 14 10 63 60 109
MOT17-09-FRCNN 62.667 83.149 63.061 65.54 96.356 30.769 57.692 11.538 51.622 3490 1835 132 21 8 15 3 69
MOT17-10-FRCNN 40.112 78.68 40.361 43.306 93.634 17.544 31.579 50.877 30.879 5560 7279 378 32 10 18 29 199
MOT17-11-FRCNN 53.995 85.543 54.144 59.972 91.142 20 33.333 46.667 45.325 5659 3777 550 14 15 25 35 56
MOT17-13-FRCNN 20.383 82.708 20.521 21.672 94.957 10 28.182 61.818 16.636 2523 9119 134 16 11 31 68 84
COMBINED 34.244 83.324 34.389 37.724 91.878 13.017 37.603 49.38 27.953 35353 58363 3125 136 63 182 239 869
Identity: exp197-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-04-FRCNN 43.292 29.607 80.508 14080 33477 3409
MOT17-05-FRCNN 47.595 32.615 88.022 2256 4661 307
MOT17-09-FRCNN 65.363 54.911 80.729 2924 2401 698
MOT17-10-FRCNN 51.318 37.526 81.138 4818 8021 1120
MOT17-11-FRCNN 63.471 52.618 79.965 4965 4471 1244
MOT17-13-FRCNN 32.813 20.151 88.295 2346 9296 311
COMBINED 47.489 33.494 81.576 31389 62327 7089
Count: exp197-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-04-FRCNN 17489 47557 82 83
MOT17-05-FRCNN 2563 6917 94 133
MOT17-09-FRCNN 3622 5325 37 26
MOT17-10-FRCNN 5938 12839 71 57
MOT17-11-FRCNN 6209 9436 69 75
MOT17-13-FRCNN 2657 11642 65 110
COMBINED 38478 93716 418 484
Different metrics peak differently for different conf-thres values, but the general guideline is that you should be aiming for maximum HOTA for best tracking results. In order to understand this you need some MOT metric background: MOTA and IDF1 overemphasize detection and association respectively. HOTA explicitly measures both types of errors and combines these in a balanced way. HOTA also incorporates measuring the localization accuracy of tracking results which isn’t present in either MOTA or IDF1. The crowdhuman model gives maximum HOTA performance around 0.45, so this values is model specific.