Skip to content

Refactor Quantization Aware Training of TF backend #203

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
zehao-intel wants to merge 76 commits into from
Closed

Refactor Quantization Aware Training of TF backend #203

zehao-intel wants to merge 76 commits into from

Conversation

@zehao-intel
Copy link
Contributor

@zehao-intel zehao-intel commented Dec 1, 2022

Signed-off-by: zehao-intel zehao.huang@intel.com

Type of Change

feature or bug fix or documentation or validation or others
API changed or not： Changed.

Description

detail description
JIRA ticket: https://jira.devtools.intel.com/browse/ILITV-2304

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR : refactor tf qat

How has this PR been tested?

how to reproduce the test (including hardware information): extension, preci

Dependency Change?

any library dependency introduced or removed: tfmot removed

@chensuyue chensuyue added enhancement New feature or request extension test labels Dec 5, 2022
@chensuyue chensuyue added this to the v2.0 milestone Dec 5, 2022
ftian1
ftian1 reviewed Dec 6, 2022
View reviewed changes
chensuyue and others added 24 commits December 9, 2022 14:44
@chensuyue @zehao-intel
fix cifar-10 download random issue (#140)
79b1ed1 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@yuwenzho @zehao-intel
fix topological sort assert error (#138)
8252f6c 
Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Refactor Quantization Aware Training of TF backend
06c6812 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@WenjiaoYue @zehao-intel
fix build error (#143)
2103fe5 
Signed-off-by: Yue, Wenjiao <wenjiao.yue@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue @zehao-intel
setup separate spell check job and fix the check path (#145)
d89d3aa 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue @zehao-intel
Update pull_request_template.md (#148)
99d99da 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@changwangss @zehao-intel
add docstring for dataset __init__ (#161)
311d3ae 
Signed-off-by: changwa1 <chang1.wang@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@qgao007 @zehao-intel
add three doc: framework_yaml.md, user_yaml.md, and pythonic_style.md (…
bffd67a 
…#159)

Signed-off-by: Gao, Qun <qun.gao@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@yiliu30 @chensuyue @zehao-intel
fixed docstring typo in experimental/metric (#156)
2dc7252 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@mengniwang95 @zehao-intel
Add dataloader doc_string (#154)
00a49d3 
Signed-off-by: mengniwa <mengni.wang@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@PenghuiCheng @zehao-intel
Update adaptor document (#152)
63704c9 
Signed-off-by: Cheng, Penghui <penghui.cheng@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@xin3he @zehao-intel
fix pydocstyle (#155)
1115879 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@XinyuYe-Intel @zehao-intel
fixed docstring issue (#153)
41cb7bf 
Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@sywangyi @WenjiaoYue @zehao-intel
add DocString for SelfKnowledgeDistillation (#158)
424b299 
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: WenjiaoYue <108783334+WenjiaoYue@users.noreply.github.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue @zehao-intel
Publication update (#165)
e48a8a0 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue @WenjiaoYue @zehao-intel
support pydocstyle check (#151)
3029b21 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: WenjiaoYue <108783334+WenjiaoYue@users.noreply.github.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@lvliang-intel @zehao-intel
Fix Time_series_LSTM tuning issue (#163)
6cf6217 
* Fix Time_series_LSTM tuning issue

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>

* fix pylint issue

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@lvliang-intel @zehao-intel
Enable dilated contraction fusion for ITEX (#146)
bcebb1d 
Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@ChendaLi-Intel @zehao-intel
Enable QDQ-adapted _QuantizedFusedBatchNorm+LeakyRelu fusion (#160)
dabb48d 
Signed-off-by: Li, Chenda <chenda.li@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue @zehao-intel
fix pylint issue (#169)
92eaaf4 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@changwangss @zehao-intel
fix ipex quantization (#168)
896f5e6 
Signed-off-by: Wang, Chang1 <chang1.wang@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@XuehaoSun @zehao-intel
Fix Model-Test pipeline status (#167)
e9eceb0 
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@PenghuiCheng @zehao-intel
Improved new API (#142)
0b81f31 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@WenjiaoYue @zehao-intel
IO docs refine (#135)
1faae25 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
lvliang-intel and others added 23 commits December 9, 2022 14:44
@lvliang-intel @zehao-intel
Fix Seq2seqAttn model tuning issue (#172)
870bc7f 
* Fix Seq2seqAttn model tuning issue

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@yiliu30 @zehao-intel
[Strategy] Adjust the hints for import hyperopt and sigopt (#213)
c47c39b 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@lvliang-intel @zehao-intel
Support QuantizedConv + BiasAdd + Activation + Dequantize fusion (#207)
bbd6d67 
Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@Lfish99 @zehao-intel
Neural Coder debug for HuggingFace run_qa.py (#220)
1b1f42a 
* Update interface.py

* Update eval_func.py

Signed-off-by: zehao-intel <zehao.huang@intel.com>
@XuehaoSun @zehao-intel
modify model test condition (#209)
27c4938 
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@NeoZhangJianyu @zehao-intel
Jianyuzh add vgg19 tfhub example (#183)
063666e 
* add example

* Update README.md

* Update pip_set_env.sh

* Update README.md

* Update lpot_dict.txt

* Update README.md

Signed-off-by: zehao-intel <zehao.huang@intel.com>
@xin3he @yuwenzho @zehao-intel
New Export with API 2.0 (#195)
40a0c6e 
Signed-off-by: Xin He <xin3.he@intel.com>
Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@WenjiaoYue @zehao-intel
Neural Coder enable VS Code extension (#205)
913631b 
Signed-off-by: Yue, Wenjiao <wenjiao.yue@intel.com>
Signed-off-by: mengfeil <kai.yao@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@lvliang-intel @zehao-intel
Support 'Square', 'Sum', 'SparseSegmentSqrtN' BF16 ops in TensorFlow …
7e17e3b 
…backend (#223)

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@lvliang-intel @zehao-intel
Support Conv2D + BiasAdd + Relu + Sum fusion (#221)
0540f69 
Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue @zehao-intel
update azure pipeline (#229)
7e8c755 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@xin3he @zehao-intel
Add export examples for new API (#225)
19d0cf7 
Signed-off-by: Xin He <xin3.he@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@yiliu30 @zehao-intel
Added optimization level for new API & support sub-parameter setting …
926964e 
…for strategy (#222)

Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@yiliu30 @zehao-intel
Add optimization level(conservative tuning) for tuning strategy (#227)
635e31e 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@kaikaiyao @zehao-intel
Neural Coder update documentation for INC2.0 (#232)
79eaff0 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@yuwei-work @zehao-intel
Enable BigDL Nano API in Neural Coder (#238)
b9ddba7 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@kaikaiyao @zehao-intel
Neural Coder release note for INC 2.0 (#240)
667d039 
* Create v0.4.md

* Update v0.4.md

* Update v0.4.md

* Update inc_dict.txt

Signed-off-by: zehao-intel <zehao.huang@intel.com>
@kaikaiyao @zehao-intel
fix some typos in rls note readme (#241)
768f7b5 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
use newapi
cc0e26e 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix model conversion
0aadbd2 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix adaptor
d2a4416 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
update example config
320bc85 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
remove resnetv2 qat example
81ce97c 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel zehao-intel closed this Dec 9, 2022
@chensuyue chensuyue deleted the zehao/refactor_qat branch February 7, 2023 02:23
yiliu30 pushed a commit that referenced this pull request Oct 27, 2025
@skavulya
Add support for FP8 static quantization for optimum-habana deepseek v…
825aaad 
…3/r1 (#203)
This was referenced Dec 9, 2025
Merged
Merged
xin3he pushed a commit that referenced this pull request Jan 6, 2026
@skavulya @xin3he
Add support for FP8 static quantization for optimum-habana deepseek v…
8679b38 
…3/r1 (#203)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ftian1 ftian1 ftian1 left review comments

@lvliang-intel lvliang-intel Awaiting requested review from lvliang-intel

@ChendaLi-Intel ChendaLi-Intel Awaiting requested review from ChendaLi-Intel

Assignees

No one assigned

Labels

enhancement New feature or request extension test

Projects

None yet

Milestone

v2.0

Development

Successfully merging this pull request may close these issues.