Skip to content
This repository was archived by the owner on Jun 4, 2025. It is now read-only.

Integrate SparseML with Masked LM training #16

Merged
merged 2 commits into from
Oct 8, 2021
Merged

Integrate SparseML with Masked LM training #16

merged 2 commits into from
Oct 8, 2021

Conversation

@natuan
Copy link

@natuan natuan commented Oct 5, 2021

This change includes:

@natuan natuan requested review from a team, bfineran, markurtz and spacemanidol October 5, 2021 04:52
@markurtz markurtz merged commit 2368115 into master Oct 8, 2021
KSGulin pushed a commit that referenced this pull request Mar 9, 2022
@natuan @KSGulin
Integrate SparseML with Masked LM training (#16)
f0e30f7 
* Integrate SparseML with Masked LM training

* Move teacher's logits out of compute_loss
@dbogunowicz dbogunowicz deleted the bert_mlm_PR branch December 5, 2023 10:26
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

@spacemanidol spacemanidol Awaiting requested review from spacemanidol

@bfineran bfineran Awaiting requested review from bfineran

1 more reviewer

@markurtz markurtz markurtz approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@natuan @markurtz