Skip to content

Add pre-training page for ESM-2#578

Merged
pstjohn merged 2 commits into
NVIDIA-BioNeMo:mainfrom
pstjohn:pstjohn/esm-2-pretraining
Jan 8, 2025
Merged

Add pre-training page for ESM-2#578
pstjohn merged 2 commits into
NVIDIA-BioNeMo:mainfrom
pstjohn:pstjohn/esm-2-pretraining

Conversation

@pstjohn
Copy link
Copy Markdown
Collaborator

@pstjohn pstjohn commented Jan 7, 2025

Description

Adds a page to the ESM-2 model card describing the training recipes for ESM-2 pre-training, including a plot of validation loss vs. step.

Type of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Refactor
  • Documentation update
  • Other (please describe):

CI Pipeline Configuration

Configure CI behavior by checking relevant boxes below. This will automatically apply labels.

Note

By default, the notebooks validation tests are skipped unless explicitly enabled.

Pre-submit Checklist

  • I have tested these changes locally
  • I have updated the documentation accordingly
  • I have added/updated tests as needed
  • All existing tests pass successfully

Signed-off-by: Peter St. John <pstjohn@nvidia.com>
Signed-off-by: Peter St. John <pstjohn@nvidia.com>
@pstjohn pstjohn added this to the 25.01 Release milestone Jan 8, 2025
@pstjohn
Copy link
Copy Markdown
Collaborator Author

pstjohn commented Jan 8, 2025

/build-ci

@pstjohn pstjohn enabled auto-merge (squash) January 8, 2025 16:05
@pstjohn pstjohn merged commit d6a8fc6 into NVIDIA-BioNeMo:main Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants