Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tests] Cast Hubert model tests to fp16 #13755

Merged
merged 1 commit into from
Sep 26, 2021
Merged

[Tests] Cast Hubert model tests to fp16 #13755

merged 1 commit into from
Sep 26, 2021

Conversation

anton-l
Copy link
Member

@anton-l anton-l commented Sep 26, 2021

Problem
Some Hubert integration tests are flaky, throwing GPU OOM on model loads (GPUs are 16GB). CI logs: https://github.com/huggingface/transformers/actions/runs/1274012618

FAILED tests/test_modeling_hubert.py::HubertModelIntegrationTest::test_inference_ctc_batched
FAILED tests/test_modeling_hubert.py::HubertModelIntegrationTest::test_inference_emotion_recognition
FAILED tests/test_modeling_hubert.py::HubertModelIntegrationTest::test_inference_intent_classification
FAILED tests/test_modeling_hubert.py::HubertModelIntegrationTest::test_inference_keyword_spotting
FAILED tests/test_modeling_hubert.py::HubertModelIntegrationTest::test_inference_speaker_identification

Solution
Cast models and reference tensors to fp16.

cc @patrickvonplaten

@anton-l anton-l merged commit e0d31a8 into huggingface:master Sep 26, 2021
stas00 pushed a commit to stas00/transformers that referenced this pull request Oct 12, 2021
Albertobegue pushed a commit to Albertobegue/transformers that referenced this pull request Jan 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant