Skip to content

Update README and min_compute: Llama3, python 3.9 #232

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
May 17, 2024
Merged

Update README and min_compute: Llama3, python 3.9 #232

merged 1 commit into from
May 17, 2024

Conversation

@dbobrenko
Copy link
Collaborator

@dbobrenko dbobrenko commented May 17, 2024

Changes

  • Update README minimum python version from 3.8 to 3.9;
  • Update README miner model with casperhansen/llama-3-70b-instruct-awq;
  • Increase minimum VRAM requirements from 24 to 80 GB;
  • Increase recommended VRAM requirements from 36 to 80 GB;
  • Increase minimum storage requirements from 24 GB to 40 GB;
  • Change recommended GPU from NVIDIA A10 to NVIDIA A100.

Notes

  • This PR is intended for Llama3 upgrade preparation and does not include the model upgrade itself.

p-ferreira
p-ferreira approved these changes May 17, 2024
View reviewed changes
Copy link
Contributor

@p-ferreira p-ferreira left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@p-ferreira p-ferreira changed the base branch from pre-staging to staging May 17, 2024 18:26
@p-ferreira p-ferreira merged commit 64b958c into macrocosm-os:staging May 17, 2024
@p-ferreira p-ferreira mentioned this pull request May 17, 2024
Merged
@dbobrenko dbobrenko deleted the feature/llama3-prepare branch May 18, 2024 18:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@p-ferreira p-ferreira p-ferreira approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

2.3.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@dbobrenko @p-ferreira