Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set clamped vs unclamped FAPE for each sample in batch independently #223

Merged
merged 1 commit into from Sep 30, 2022
Merged

Set clamped vs unclamped FAPE for each sample in batch independently #223

merged 1 commit into from Sep 30, 2022

Conversation

ar-nowaczynski
Copy link

Previously, whether to use clamped vs unclamped FAPE backbone loss was decided once for all samples in the mini-batch.

Now, clamped vs unclamped FAPE backbone loss is decided for each sample in the mini-batch independently. This brings substantial improvements to training convergence and stability.

@gahdritz
Copy link
Collaborator

Thanks Arkadiusz!

@gahdritz gahdritz merged commit 55c5623 into aqlaboratory:main Sep 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants