Skip to content

Add mark step after optimizer step#195

Merged
michaelbenayoun merged 2 commits intomainfrom
add_missing_mark_steps
Aug 24, 2023
Merged

Add mark step after optimizer step#195
michaelbenayoun merged 2 commits intomainfrom
add_missing_mark_steps

Conversation

@michaelbenayoun
Copy link
Member

There was no XLA barrier call after the optimizer step. This PR fixes that.

It (partially or fully) addresses the third point in #193.

Fixes: #166

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@michaelbenayoun michaelbenayoun merged commit 87b2c33 into main Aug 24, 2023
@michaelbenayoun michaelbenayoun deleted the add_missing_mark_steps branch August 24, 2023 15:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Vision Transformer funetuning ended up with std::bad_alloc error

2 participants