Skip to content

Refine TF NLP models with INC User NewAPI #199

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 41 commits into from
Dec 21, 2022
Merged

Refine TF NLP models with INC User NewAPI #199

merged 41 commits into from
Dec 21, 2022

Conversation

ChendaLi-Intel
Copy link
Contributor

Type of Change

Examples
API not changed

Description

JIRA ticket: https://jira.devtools.intel.com/browse/ILITV-2454

Expected Behavior & Potential Risk

Pre-CI Test pass
Extension Test pass

How has this PR been tested?

Pre-CI Test
Extension Test

ChendaLi-Intel and others added 5 commits November 28, 2022 15:48
@ChendaLi-Intel
Update distilbert_base
5717b13 
Signed-off-by: Li, Chenda <chenda.li@intel.com>
@ChendaLi-Intel
Update distilbert_base
5f5139a 
Signed-off-by: Li, Chenda <chenda.li@intel.com>
@ChendaLi-Intel
Update bert_base_mrpc
1952588 
Signed-off-by: Li, Chenda <chenda.li@intel.com>
@ChendaLi-Intel
Add words to ignore when doing the spell check
c7779e2 
Signed-off-by: Li, Chenda <chenda.li@intel.com>
@chensuyue
Merge branch 'master' into chenda/inc_newapi
0f7bbc8
@ChendaLi-Intel
Copy link
Contributor Author

Please pull master after the PR below is merged into master and launch the Extension Test.
#186

@ChendaLi-Intel
Merge branch 'master' of https://github.com/intel/neural-compressor i…
f7d101a 
…nto chenda/inc_newapi

Signed-off-by: Li, Chenda <chenda.li@intel.com>
@ChendaLi-Intel
Copy link
Contributor Author

ChendaLi-Intel commented Dec 2, 2022 •
edited
Loading

distilbert_base:
https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3584/

bert_base_mrpc:
https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3585/

ftian1
ftian1 requested changes Dec 5, 2022
View reviewed changes
@zehao-intel
merge and solve conflict
336e5fe 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel zehao-intel changed the title Refactor distilbert_base, bert_base_mrpc with INC User NewAPI Refine TF NLP models with INC User NewAPI Dec 6, 2022
@zehao-intel
add code for transformer_lt and transformer_lt_mlperf
83d7d4c 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
refine 4 nlp models
40ec6ec 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Merge branch 'master' into chenda/inc_newapi
383687b
@zehao-intel
fix spell
5ed6059 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Merge branch 'master' into chenda/inc_newapi
3ca3912
zehao-intel and others added 9 commits December 9, 2022 10:15
@zehao-intel
remove unnecessary common.Model
63a41ed 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Merge branch 'chenda/inc_newapi' of https://github.com/intel/neural-c…
816b59e 
…ompressor into chenda/inc_newapi

merge
@zehao-intel
fix iteration=None in tf_utils.util.iterator_sess_run
d8d5315 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
update example config
cc909e4 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Merge branch 'master' into chenda/inc_newapi
20b33de 
merge master
@zehao-intel
remove old api tf nlp examples
300eb57 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
remove old api image recognition examples
adf18a2 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue
support removed model test
7c96dec 
Signed-off-by: chensuyue <suyue.chen@intel.com>
@chensuyue
add default benchmark config
c27adfc 
Signed-off-by: chensuyue <suyue.chen@intel.com>
@chensuyue
Copy link
Contributor

extension test
please rebase and check tuning issue.

@zehao-intel
fix
f272307 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix issues
58d102d 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix transformer_lt example config
4dde5c9 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix transformer_lt benchmark config args
88de8ac 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Copy link
Contributor

Extension: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3750/

@chensuyue
Copy link
Contributor

Extension: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3750/

Re-test bert_base_mrpc

@chensuyue
Copy link
Contributor

Extension: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3750/

Please check perf gap of 'transformer_lt_mlperf'.

@zehao-intel
update topology to scripts
fbc839c 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Merge branch 'chenda/inc_newapi' of https://github.com/intel/neural-c…
57b92c2 
…ompressor into chenda/inc_newapi

merge
@zehao-intel
Copy link
Contributor

Rebuild: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3766/

@zehao-intel
remove topology and args check
7fe5a1c 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue
Copy link
Contributor

extension test

@zehao-intel
Copy link
Contributor

zehao-intel commented Dec 15, 2022 •
edited by chensuyue
Loading

Distillbert

@chensuyue
Copy link
Contributor

Retest after copy data into workspace: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3848/

@chensuyue
Copy link
Contributor

Retest after copy data into workspace: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3848/

retest distillbert with spr-base: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3859/

@zehao-intel
fix bert_base import
aca1a38 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix distillbert
13929ec 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
Copy link
Contributor

zehao-intel commented Dec 20, 2022 •
edited
Loading

DistillBert Base: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3863/
Bert Base MRPC: https://inteltf-jenk.sh.intel.com/job/intel-lpot-validation-top-mr-extension/3865/

@zehao-intel
fix config
b0ad837 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
fix bert latency issue
2f3af90 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@zehao-intel
solve conflicts
93a5017 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
@chensuyue
Copy link
Contributor

Final issue, please update this page: https://github.com/intel/neural-compressor/blob/chenda/inc_newapi/examples/README.md

@lvliang-intel
Merge branch 'master' of https://github.com/intel/neural-compressor i…
bfc6d27 
…nto chenda/inc_newapi

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
@lvliang-intel
Merge branch 'chenda/inc_newapi' of https://github.com/intel/neural-c…
88b519d 
…ompressor into chenda/inc_newapi

Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
@lvliang-intel
remove yolo_v3 utils
801ae60 
Signed-off-by: Lv, Liang1 <liang1.lv@intel.com>
@chensuyue chensuyue merged commit 3ea8fcc into master Dec 21, 2022
@chensuyue chensuyue deleted the chenda/inc_newapi branch December 21, 2022 04:22
VincyZhang pushed a commit that referenced this pull request Feb 12, 2023
@airMeng
SparseLib Code format (#199)
e0062b0 
* SparseLib code reformat

* workaround for benchmark code format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ftian1 ftian1 ftian1 requested changes

+1 more reviewer

@zehao-intel zehao-intel zehao-intel left review comments

Reviewers whose approvals may not affect merge requirements
Assignees
No one assigned
Labels
examples extension test
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@ChendaLi-Intel @chensuyue @zehao-intel @ftian1 @lvliang-intel