Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21th June Updates #4

Open
pippo-sci opened this issue Jun 21, 2024 · 0 comments
Open

21th June Updates #4

pippo-sci opened this issue Jun 21, 2024 · 0 comments

Comments

@pippo-sci
Copy link
Contributor

Fine-Tuning Update:

  • Last weekend I ran 5 fine tuning versions. Sadly Llama2 don't hold a full epoch of training and Caleuche ran out of VRAM
  • I uploaded the models to Ollama and try to generate from there
  • I have adapters and merged models for 3 the versions (Adapters run on top on base LLM, and merged is a new LLM) I'm checking latency to decide which version to run questions and upload to a table on Postgres during the weekend so Ale-Nico's evaluation framework can run next week
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant