Skip to content

Evo2#694

Merged
dorotat-nv merged 149 commits into
mainfrom
evo2
Mar 6, 2025
Merged

Evo2#694
dorotat-nv merged 149 commits into
mainfrom
evo2

Conversation

@jstjohn
Copy link
Copy Markdown
Collaborator

@jstjohn jstjohn commented Feb 19, 2025

Description

This provides an implementation of Evo2 supporting pre-training, fine-tuning and preprocessing of data for Evo2 from fasta files. This makes use of the new Hyena/Evo2 model support in NVIDIA-NeMo/NeMo#12263.

Known issues

  • FP8 settings are not exact matches for Savanna so fine-tuning with/without FP8 works well with some checkpoints but not others.

Type of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Refactor
  • Documentation update
  • Other (please describe):

Pre-submit Checklist

  • I have tested these changes locally
  • I have updated the documentation accordingly
  • I have added/updated tests as needed
  • All existing tests pass successfully

cspades and others added 30 commits November 16, 2024 10:46
… debt in tokenizer and config, remove unused args in infer.py.
…d add transcript splicing script for preprocessing.
Signed-off-by: John St John <jstjohn@nvidia.com>
@trvachov
Copy link
Copy Markdown
Collaborator

trvachov commented Mar 5, 2025

👀

… different submodules

Signed-off-by: John St John <jstjohn@nvidia.com>
@jstjohn
Copy link
Copy Markdown
Collaborator Author

jstjohn commented Mar 5, 2025

👀

weird issue with duplicated pycaches. I think I have a fix for it that I added to run_pytest.sh.

jstjohn added 3 commits March 5, 2025 04:30
Signed-off-by: John St John <jstjohn@nvidia.com>
Signed-off-by: John St John <jstjohn@nvidia.com>
Signed-off-by: John St John <jstjohn@nvidia.com>
Comment thread docs/docs/user-guide/examples/bionemo-evo2/.gitignore Outdated
Copy link
Copy Markdown
Collaborator

@dorotat-nv dorotat-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

left a few comments but LGTM

Comment thread sub-packages/bionemo-evo2/README.md
@jstjohn jstjohn added this pull request to the merge queue Mar 5, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 5, 2025
@jstjohn jstjohn added this pull request to the merge queue Mar 5, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 5, 2025
@jstjohn jstjohn added this pull request to the merge queue Mar 5, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 5, 2025
@jstjohn jstjohn added this pull request to the merge queue Mar 5, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Mar 5, 2025
@jstjohn jstjohn added this pull request to the merge queue Mar 6, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to no response for status checks Mar 6, 2025
@jstjohn jstjohn added this pull request to the merge queue Mar 6, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to no response for status checks Mar 6, 2025
@dorotat-nv dorotat-nv added this pull request to the merge queue Mar 6, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to no response for status checks Mar 6, 2025
@dorotat-nv dorotat-nv merged commit 65c453a into main Mar 6, 2025
@dorotat-nv dorotat-nv deleted the evo2 branch March 6, 2025 13:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants