Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update ML Decoder #2045

Draft
wants to merge 37 commits into
base: main
Choose a base branch
from
Draft

Update ML Decoder #2045

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
8997ccf
Update ml_decoder.py
fffffgggg54 Nov 27, 2023
69f3634
Update ml_decoder.py
fffffgggg54 Nov 27, 2023
92f0b7f
Update beit.py
fffffgggg54 Dec 8, 2023
d10f002
Update beit.py
fffffgggg54 Dec 8, 2023
f59c1f1
Update beit.py
fffffgggg54 Dec 8, 2023
318369a
Update davit.py
fffffgggg54 Dec 10, 2023
08b7837
Merge branch 'davit_head_update' into ml-decoder
fffffgggg54 Dec 10, 2023
03606ab
Update edgenext.py
fffffgggg54 Dec 10, 2023
4f8898a
Update edgenext.py
fffffgggg54 Dec 10, 2023
c0206b8
Update edgenext.py
fffffgggg54 Dec 10, 2023
babdb21
Merge branch 'edgenext_head_update' into ml-decoder
fffffgggg54 Dec 10, 2023
13b33c6
Merge branch 'huggingface:main' into ml-decoder
fffffgggg54 Dec 14, 2023
95bd9dc
vectorize GroupFC
fffffgggg54 Dec 14, 2023
1448b7d
Update ml_decoder.py
fffffgggg54 Dec 14, 2023
ab3eacb
Update ml_decoder.py
fffffgggg54 Dec 14, 2023
b4afe6c
Update ml_decoder.py
fffffgggg54 Dec 14, 2023
dd8d231
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
51c85bd
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
36d69a4
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
4161159
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
aa19600
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
6b99c91
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
db24aea
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
09749be
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
2a05a28
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
50fe44f
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
565a57a
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
95a24fc
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
7ebfb85
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
b2917f1
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
e0c9f14
Update ml_decoder.py
fffffgggg54 Dec 17, 2023
0124d0f
Update ml_decoder.py
fffffgggg54 Dec 19, 2023
5a39bb3
Update ml_decoder.py
fffffgggg54 Dec 25, 2023
b680c48
Update ml_decoder.py
fffffgggg54 Dec 25, 2023
3b506e9
Update ml_decoder.py
fffffgggg54 Dec 26, 2023
4f1b76b
tests
fffffgggg54 Dec 26, 2023
1bf6fbd
Update ml_decoder.py
fffffgggg54 Jul 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions tests/test_layers.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,3 +76,18 @@ def test_hard_swish_grad():
def test_hard_mish_grad():
for _ in range(100):
_run_act_layer_grad('hard_mish')


MLDECODER_EXCLUDE_FILTERS = [
'*efficientnet_l2*', '*resnext101_32x48d', '*in21k', '*152x4_bitm', '*101x3_bitm', '*50x3_bitm',
'*nfnet_f3*', '*nfnet_f4*', '*nfnet_f5*', '*nfnet_f6*', '*nfnet_f7*', '*efficientnetv2_xl*',
'*resnetrs350*', '*resnetrs420*', 'xcit_large_24_p8*', '*huge*', '*giant*', '*gigantic*',
'*enormous*', 'maxvit_xlarge*', 'regnet*1280', 'regnet*2560']

def test_ml_decoder():
for modelName in timm.list_models(pretrained=False, exclude_filters = MLDECODER_EXCLUDE_FILTERS):
model = timm.create_model(modelName, num_classes=1000)
model = add_ml_decoder_head(model)
model.eval()
with torch.set_grad_enabled(False):
model(torch.randn([1,*model.default_cfg['input_size']]))
Loading