-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Evaluation of the params evolved for first half of MOT17 on the complete MOT17
Mike edited this page Jan 8, 2023
·
2 revisions
There seems to be large discrepancies between the first and second half of MOT17 given the performance decrease on all main metrics.
HOTA: MOT17-half-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA OWTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-02-FRCNN 43.035 36.407 51.252 38.327 75.368 54.832 76.884 80.718 44.253 55.848 76.006 42.448
MOT17-04-FRCNN 65.82 60.701 71.944 65.303 77.945 75.641 83.252 81.852 68.483 86.003 76.833 66.079
MOT17-05-FRCNN 33.401 36.131 30.952 38.492 75.789 41.06 56.225 82.801 34.507 41.978 78.276 32.859
MOT17-09-FRCNN 59.366 63.818 55.255 68.402 82.92 65.168 75.418 86.302 61.455 72.783 83.184 60.544
MOT17-10-FRCNN 40.901 49.361 34.245 52.66 75.811 39.029 63.52 80.573 42.394 53.703 75.568 40.582
MOT17-11-FRCNN 65.775 62.772 69.408 72.108 77.103 78.28 80.643 86.856 70.681 77.077 84.122 64.839
MOT17-13-FRCNN 43.317 38.081 49.742 40.828 72.761 55.16 71.991 80.055 44.984 56.735 74.802 42.439
COMBINED 55.567 51.305 60.891 55.303 76.895 66.256 78.148 82.202 57.891 71.112 77.475 55.094
CLEAR: MOT17-half-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT ML Frag
MOT17-02-FRCNN 45.639 77.746 46.054 48.454 95.281 19.048 54.762 26.19 34.856 4200 4468 208 36 8 23 11 183
MOT17-04-FRCNN 73.752 79.424 73.855 78.818 94.076 56.452 25.806 17.742 57.534 18389 4942 1158 24 35 16 11 239
MOT17-05-FRCNN 39.899 80.592 41.559 46.173 90.914 17.647 61.765 20.588 30.937 1641 1913 164 59 12 42 14 119
MOT17-09-FRCNN 72.174 85.272 72.626 77.559 94.021 41.176 58.824 0 60.752 1887 546 120 11 7 10 0 32
MOT17-10-FRCNN 60.685 77.487 62.817 66.14 95.217 36.364 50 13.636 45.795 4559 2334 229 147 16 22 6 351
MOT17-11-FRCNN 70.564 85.172 70.992 82.257 87.955 60.976 29.268 9.7561 58.367 4038 871 553 21 25 12 4 55
MOT17-13-FRCNN 47.36 76.354 48.081 52.096 92.844 23.529 43.529 32.941 35.042 4411 4056 340 61 20 37 28 261
COMBINED 61.787 79.596 62.403 67.162 93.384 34.262 45.125 20.613 48.084 39125 19130 2772 359 123 162 74 1240
Identity: MOT17-half-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-02-FRCNN 57.128 43.09 84.732 3735 4933 673
MOT17-04-FRCNN 84.178 77.352 92.326 18047 5284 1500
MOT17-05-FRCNN 43.889 33.089 65.152 1176 2378 629
MOT17-09-FRCNN 74.234 67.735 82.113 1648 785 359
MOT17-10-FRCNN 49.379 41.84 60.234 2884 4009 1904
MOT17-11-FRCNN 77.053 74.557 79.721 3660 1249 931
MOT17-13-FRCNN 57.785 45.105 80.383 3819 4648 932
COMBINED 69.832 60.027 83.464 34969 23286 6928
Count: MOT17-half-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-02-FRCNN 4408 8668 54 42
MOT17-04-FRCNN 19547 23331 74 62
MOT17-05-FRCNN 1805 3554 59 68
MOT17-09-FRCNN 2007 2433 24 17
MOT17-10-FRCNN 4788 6893 94 44
MOT17-11-FRCNN 4591 4909 89 41
MOT17-13-FRCNN 4751 8467 100 85
COMBINED 41897 58255 494 359
HOTA: MOT17-pedestrian HOTA DetA AssA DetRe DetPr AssRe AssPr LocA OWTA HOTA(0) LocA(0) HOTALocA(0)
MOT17-02-FRCNN 38.833 35.768 42.32 37.446 77.318 46.451 71.949 81.8 39.789 49.139 77.777 38.219
MOT17-04-FRCNN 61.737 58.717 65.384 63.479 76.748 69.684 80.762 81.252 64.388 82.263 75.661 62.241
MOT17-05-FRCNN 36.433 39.31 33.862 41.974 75.747 46.65 55.442 82.282 37.69 46.23 77.725 35.932
MOT17-09-FRCNN 54.856 61.348 49.081 66.608 80.776 61.704 66.708 85.477 57.163 69.001 81.404 56.169
MOT17-10-FRCNN 40.928 50.16 33.671 53.696 75.783 37.38 67.082 80.796 42.474 53.632 75.951 40.734
MOT17-11-FRCNN 59.904 60.046 59.994 70.886 74.511 69.452 76.373 86.929 65.196 71.08 83.732 59.517
MOT17-13-FRCNN 44.768 42.152 47.867 45.296 74.032 53.142 70.616 80.64 46.522 58.674 75.441 44.264
COMBINED 53.065 51.35 55.3 55.614 76.39 61.179 75.609 82.092 55.383 68.734 77.105 52.997
CLEAR: MOT17-pedestrian MOTA MOTP MODA CLR_Re CLR_Pr MTR PTR MLR sMOTA CLR_TP CLR_FN CLR_FP IDSW MT PT
ML Frag
MOT17-02-FRCNN 43.652 79.046 44.072 46.252 95.499 16.129 50 33.871 33.961 8594 9987 405 78 10 31
21 405
MOT17-04-FRCNN 70.162 78.954 70.301 76.506 92.498 49.398 34.94 15.663 54.06 36384 11173 2951 66 41 29
13 565
MOT17-05-FRCNN 45.453 79.778 46.856 51.135 92.278 22.556 57.895 19.549 35.113 3537 3380 296 97 30 77
26 216
MOT17-09-FRCNN 70.291 84.233 70.892 76.676 92.986 50 50 0 58.202 4083 1242 308 32 13 13
0 81
MOT17-10-FRCNN 61.648 77.562 63.284 67.069 94.658 31.579 59.649 8.7719 46.599 8611 4228 486 210 18 34
5 660
MOT17-11-FRCNN 64.667 85.504 65.102 80.119 84.215 45.333 38.667 16 53.053 7560 1876 1417 41 34 29
12 121
MOT17-13-FRCNN 51.855 77.367 53.041 57.112 93.346 27.273 43.636 29.091 38.929 6649 4993 474 138 30 48
32 356
COMBINED 60.927 79.646 61.516 67.159 92.249 32.234 47.802 19.963 47.257 75418 36879 6337 662 176 261
109 2404
Identity: MOT17-pedestrian IDF1 IDR IDP IDTP IDFN IDFP
MOT17-02-FRCNN 50.392 37.398 77.22 6949 11632 2050
MOT17-04-FRCNN 79.591 72.711 87.909 34579 12978 4756
MOT17-05-FRCNN 48.13 37.401 67.493 2587 4330 1246
MOT17-09-FRCNN 66.447 60.62 73.514 3228 2097 1163
MOT17-10-FRCNN 50.72 43.329 61.152 5563 7276 3534
MOT17-11-FRCNN 71.135 69.404 72.953 6549 2887 2428
MOT17-13-FRCNN 59.558 47.999 78.45 5588 6054 1535
COMBINED 67.037 57.921 79.558 65043 47254 16712
Count: MOT17-pedestrian Dets GT_Dets IDs GT_IDs
MOT17-02-FRCNN 8999 18581 85 62
MOT17-04-FRCNN 39335 47557 117 83
MOT17-05-FRCNN 3833 6917 108 133
MOT17-09-FRCNN 4391 5325 39 26
MOT17-10-FRCNN 9097 12839 141 57
MOT17-11-FRCNN 8977 9436 161 75
MOT17-13-FRCNN 7123 11642 161 110
COMBINED 81755 112297 812 546