-
Notifications
You must be signed in to change notification settings - Fork 585
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
support fp16 training and testing (#230)
* support fp16 of vid training * support fp16 of sot training * support fp16 of mot training * fix a bug for reid fp16 testing * support fp16 of mot testing * add configs for fp16 training & testing * add template for fp16 readme * add readme for fp16 configs * modify readme for fp16 configs * modify readme for fp16 configs * modify readme for fp16 configs * add metafile for fp16 configs * update based on 1-st comments
- Loading branch information
Showing
23 changed files
with
316 additions
and
62 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,32 @@ | ||
# Mixed Precision Training | ||
|
||
## Introduction | ||
|
||
<!-- [OTHERS] --> | ||
|
||
```latex | ||
@article{micikevicius2017mixed, | ||
title={Mixed precision training}, | ||
author={Micikevicius, Paulius and Narang, Sharan and Alben, Jonah and Diamos, Gregory and Elsen, Erich and Garcia, David and Ginsburg, Boris and Houston, Michael and Kuchaiev, Oleksii and Venkatesh, Ganesh and others}, | ||
journal={arXiv preprint arXiv:1710.03740}, | ||
year={2017} | ||
} | ||
``` | ||
|
||
## Results and Models on VID task | ||
|
||
| Method | Backbone | Style | Lr schd | Mem (GB) | Inf time (fps) | box AP@50 | Config | Download | | ||
| :-------: | :-------------: | :-----: | :-----: | :------: | :------------: | :----: | :------: | :--------: | | ||
| SELSA | R-50-DC5 | pytorch | 7e | 2.71 | - | 78.7 | [config](selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid.py) | [model](https://download.openmmlab.com/mmtracking/fp16/selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid_20210728_193846-dce6eb09.pth) | [log](https://download.openmmlab.com/mmtracking/fp16/selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid_20210728_193846.log.json) | | ||
|
||
## Results and Models on MOT task | ||
|
||
| Method | Detector | ReID | Train Set | Test Set | Public | Inf time (fps) | MOTA | IDF1 | FP | FN | IDSw. | Config | Download | | ||
| :-------: | :-------------: | :----: | :-------: | :------: | :----: | :------------: | :--: | :--: |:--:|:--:| :---: | :----: | :------: | | ||
| Tracktor | R50-FasterRCNN-FPN | R50 | half-train | half-val | N | - | 64.7 | 66.6 | 10710 | 45270 | 1152 | [config](tracktor_faster-rcnn_r50_fpn_fp16_4e_mot17-private-half.py) | [detector](https://download.openmmlab.com/mmtracking/fp16/faster-rcnn_r50_fpn_fp16_4e_mot17-half_20210730_002436-f4ba7d61.pth) | [detector_log](https://download.openmmlab.com/mmtracking/fp16/faster-rcnn_r50_fpn_fp16_4e_mot17-half_20210730_002436.log.json) | [reid](https://download.openmmlab.com/mmtracking/fp16/reid_r50_fp16_8x32_6e_mot17_20210731_033055-4747ee95.pth) | [reid_log](https://download.openmmlab.com/mmtracking/fp16/reid_r50_fp16_8x32_6e_mot17_20210731_033055.log.json) | | ||
|
||
## Results and Models on SOT task | ||
|
||
| Method | Backbone | Style | Lr schd | Mem (GB) | Inf time (fps) | Success | Norm precision | Config | Download | | ||
| :-------: | :-------------: | :-----: | :-----: | :------: | :------------: | :----: | :----: | :------: | :--------: | | ||
| SiameseRPN++ | R-50 | - | 20e | - | - | 49.1 | 57.0 | [config](siamese_rpn_r50_fp16_1x_lasot.py) | [model](https://download.openmmlab.com/mmtracking/fp16/siamese_rpn_r50_fp16_1x_lasot_20210731_110245-6733c67e.pth) | [log](https://download.openmmlab.com/mmtracking/fp16/siamese_rpn_r50_fp16_1x_lasot_20210731_110245.log.json) | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,50 @@ | ||
Collections: | ||
- Name: FP16 | ||
Metadata: | ||
Training Techniques: | ||
- Mixed Precision Training | ||
Training Resources: 8x TITAN Xp GPUs | ||
Paper: https://arxiv.org/abs/1710.03740 | ||
README: configs/fp16/README.md | ||
|
||
Models: | ||
- Name: selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid | ||
In Collection: FP16 | ||
Config: configs/fp16/selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid.py | ||
Metadata: | ||
Training Memory (GB): 2.71 | ||
Epochs: 7 | ||
Results: | ||
- Task: Video Object Detection | ||
Dataset: ILSVRC | ||
Metrics: | ||
box AP@0.5: 78.7 | ||
Weights: https://download.openmmlab.com/mmtracking/fp16/selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid_20210728_193846-dce6eb09.pth | ||
|
||
- Name: tracktor_faster-rcnn_r50_fpn_fp16_4e_mot17-private-half | ||
In Collection: FP16 | ||
Config: configs/fp16/tracktor_faster-rcnn_r50_fpn_fp16_4e_mot17-private-half.py | ||
Metadata: | ||
Training Data: MOT17-half-train | ||
Results: | ||
- Task: Multiple Object Tracking | ||
Dataset: MOT17-half-val | ||
Metrics: | ||
MOTA: 64.7 | ||
IDF1: 66.6 | ||
Weights: | ||
- https://download.openmmlab.com/mmtracking/fp16/faster-rcnn_r50_fpn_fp16_4e_mot17-half_20210730_002436-f4ba7d61.pth | ||
- https://download.openmmlab.com/mmtracking/fp16/reid_r50_fp16_8x32_6e_mot17_20210731_033055-4747ee95.pth | ||
|
||
- Name: siamese_rpn_r50_fp16_1x_lasot | ||
In Collection: FP16 | ||
Config: configs/fp16/siamese_rpn_r50_fp16_1x_lasot.py | ||
Metadata: | ||
Epochs: 20 | ||
Results: | ||
- Task: Single Object Tracking | ||
Dataset: LaSOT | ||
Metrics: | ||
Success: 49.1 | ||
Norm precision: 57.0 | ||
Weights: https://download.openmmlab.com/mmtracking/fp16/siamese_rpn_r50_fp16_1x_lasot_20210731_110245-6733c67e.pth |
2 changes: 2 additions & 0 deletions
2
configs/fp16/selsa_faster_rcnn_r50_dc5_fp16_1x_imagenetvid.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
_base_ = ['../vid/selsa/selsa_faster_rcnn_r50_dc5_1x_imagenetvid.py'] | ||
fp16 = dict(loss_scale=512.) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,3 @@ | ||
_base_ = ['../sot/siamese_rpn/siamese_rpn_r50_1x_lasot.py'] | ||
optimizer_config = dict(type='SiameseRPNFp16OptimizerHook') | ||
fp16 = dict(loss_scale=512.) |
11 changes: 11 additions & 0 deletions
11
configs/fp16/tracktor_faster-rcnn_r50_fpn_fp16_4e_mot17-private-half.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
_base_ = [ | ||
'../mot/tracktor/tracktor_faster-rcnn_r50_fpn_4e_mot17-private-half.py' | ||
] | ||
model = dict( | ||
pretrains=dict( | ||
detector= # noqa: E251 | ||
'https://download.openmmlab.com/mmtracking/fp16/faster-rcnn_r50_fpn_fp16_4e_mot17-half_20210730_002436-f4ba7d61.pth', # noqa: E501 | ||
reid= # noqa: E251 | ||
'https://download.openmmlab.com/mmtracking/fp16/reid_r50_fp16_8x32_6e_mot17_20210731_033055-4747ee95.pth' # noqa: E501 | ||
)) | ||
fp16 = dict(loss_scale=512.) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,8 @@ | ||
from .sot_lr_updater import SiameseRPNLrUpdaterHook | ||
from .sot_optimizer_hook import SiameseRPNOptimizerHook | ||
from .sot_optimizer_hook import (SiameseRPNFp16OptimizerHook, | ||
SiameseRPNOptimizerHook) | ||
|
||
__all__ = ['SiameseRPNOptimizerHook', 'SiameseRPNLrUpdaterHook'] | ||
__all__ = [ | ||
'SiameseRPNOptimizerHook', 'SiameseRPNLrUpdaterHook', | ||
'SiameseRPNFp16OptimizerHook' | ||
] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.