Skip to content

Commit

Permalink
Merge pull request #90 from ModelTC/docs-dev
Browse files Browse the repository at this point in the history
[Feature]: update support matrix, fix docs
  • Loading branch information
zhiwei-dong committed May 10, 2022
2 parents 95947bd + f857ba5 commit 4336493
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 4 deletions.
4 changes: 3 additions & 1 deletion docs/source/get_started/support_matrix.rst
Original file line number Diff line number Diff line change
Expand Up @@ -26,4 +26,6 @@ Algorithm
4. `PACT <https://arxiv.org/pdf/1805.06085.pdf>`_
5. `APoT <https://arxiv.org/pdf/1909.13144v2.pdf>`_
6. `AdaRound <https://arxiv.org/pdf/2004.10568.pdf>`_
7. `QIL <https://arxiv.org/pdf/1808.05779.pdf>`_
7. `QIL <https://arxiv.org/pdf/1808.05779.pdf>`_
8. `BRECQ <https://arxiv.org/pdf/2102.05426.pdf>`_
9. `QDrop <https://arxiv.org/pdf/2203.05740.pdf>`_
4 changes: 2 additions & 2 deletions docs/source/user_guide/PTQ/advanced.rst
Original file line number Diff line number Diff line change
Expand Up @@ -23,15 +23,15 @@ MQBench provides a simple API for advanced PTQ, learn our step-by-step instructi
# configuration
ptq_reconstruction_config = {
'pattern': 'block', #? 'layer' for Adaround or 'block' for BRECQ
'pattern': 'block', #? 'layer' for Adaround or 'block' for BRECQ and QDROP
'scale_lr': 4.0e-5, #? learning rate for learning step size of activation
'warm_up': 0.2, #? 0.2 * max_count iters without regularization to floor or ceil
'weight': 0.01, #? loss weight for regularization item
'max_count': 20000, #? optimization iteration
'b_range': [20,2], #? beta decaying range
'keep_gpu': True, #? calibration data restore in gpu or cpu
'round_mode': 'learned_hard_sigmoid', #? ways to reconstruct the weight, currently only support learned_hard_sigmoid
'prob': 0.5, #? dropping probability of QDROP
'prob': 1.0, #? dropping probability of QDROP, 1.0 for Adaround and BRECQ
}
# backend options
Expand Down
2 changes: 1 addition & 1 deletion docs/source/user_guide/QAT/detection.rst
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ Getting Started
# Prepare your float pretrained model.
cd eod/scripts
# Follow the prompts to set config in train_quant.sh.
sh train_quant.sh
sh train_qat.sh
**We have several examples of qat config in EOD repository:**
Expand Down

0 comments on commit 4336493

Please sign in to comment.