Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add models from Hugging Face/transformers from MLAgility - part 1 #615

Merged
merged 63 commits into from
Jul 26, 2023
Merged

Add models from Hugging Face/transformers from MLAgility - part 1 #615

merged 63 commits into from
Jul 26, 2023

Conversation

jcwchen
Copy link
Member

@jcwchen jcwchen commented Jun 22, 2023 •
edited
Loading

Follow-up work after: Add models from Hugging Face/transformers from MLAgility. Add more state-of-art models from MLAgility and create test_data_set for them:

  • popular_on_huggingface/openai_clip-vit-large-patch14
  • popular_on_huggingface/distilbert-base-uncased.py
  • popular_on_huggingface/distilbert-base-multilingual-cased

@jcwchen
popular_on_huggingface/bert-base-uncased.py
b326b3c 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
add transformers models
510f609 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
remove gpt1 and gpt2 for now
fede10e 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
config
97de789 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen jcwchen mentioned this pull request Jun 23, 2023
Open
@jcwchen jcwchen closed this Jul 10, 2023
@jcwchen jcwchen reopened this Jul 10, 2023
@jcwchen
get model name from build_dir
3af24e7 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
find_model_hash_name
543ba43 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
subprocess.PIPE
8e41e92 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
new models
5dda38a 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
7 models
22f6123 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
only keep 4
7dbf731 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
remove 4
2ce4161 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
remove albert-base-v2
ee483be 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
del model and sess
e1690be 
Signed-off-by: jcwchen <jacky82226@gmail.com>
github-advanced-security[bot]
github-advanced-security bot found potential problems Jul 13, 2023
View reviewed changes
workflow_scripts/check_model.py Fixed Show fixed Hide fixed
workflow_scripts/ort_test_dir_utils.py Fixed Show fixed Hide fixed
@jcwchen
check_path
d466f26 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
drop models in CI
777f0a6 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
add bert_generation
94cd553 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
--binary
c865e0f 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
Merge branch 'jcw/add-hgf' of https://github.com/jcwchen/models into …
6426b71 
…jcw/add-hgf
@jcwchen
disable bert_generation.py
f29974b 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
no binary
da253f3 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
cancel in progress
5d1fc5f 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
binary
fcffd4a 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
minimal
8272854 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
--mini
db26881 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
manually check
ebfbc04 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
not using conda
abefcb0 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
final_model_path
9dfe0ed 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
git-lfst pull dir
63f2b00 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
git diff
288d29a 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
Merge branch 'new-models' into jcw/add-hgf
22ede0b 
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
@jcwchen
use onnx.load to compare
7c34b5a 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
test_utils.pull_lfs_file(final_model_path)
35a3ca8 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
only test changed models
20817c2 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
test_utils
a1483a8 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
get_cpu_info
d126f3b 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
ext names
4495108 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
test_utils.get_changed_models()
5acb493 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
compare 2
0a2ae7c 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
fix init
1ddb303 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
transformers==4.29.2
cd3e260 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
test
8ad0a61 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
initializer
251d682 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
update bert-generation
c9b2756 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
fixed numpy
c5178b0 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
print(f"initializer {k}")
9dafea5 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
update bert from mac
3774ffa 
Signed-off-by: Chun-Wei Chen <jacky82226@gmail.com>
@jcwchen
remove bert-generation
1de728d 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
mlagility_subdir_count number
450e2ad 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen
remove unused onnx
3cd5bba 
Signed-off-by: jcwchen <jacky82226@gmail.com>
@jcwchen jcwchen merged commit c021460 into onnx:new-models Jul 26, 2023
@jcwchen jcwchen deleted the jcw/add-hgf branch July 26, 2023 20:47
@jcwchen jcwchen changed the title Add models from Hugging Face/transformers from MLAgility Add models from Hugging Face/transformers from MLAgility - part 1 Aug 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ramkrishna2910 ramkrishna2910 ramkrishna2910 approved these changes

Assignees
No one assigned
Labels
new-model
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jcwchen @ramkrishna2910