Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

adding model builders for code-llama2 7b, 13b, and 70b #847

Merged
merged 15 commits into from
Apr 26, 2024
Merged

adding model builders for code-llama2 7b, 13b, and 70b #847

merged 15 commits into from
Apr 26, 2024

Commits on Apr 23, 2024

  1. adding model builders for code-llama2 7b, 13b, and 70b

    Salman Mohammadi committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    d38fec2 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Added lora and qlora code-llama models. Added a lora and qlora base l… 

    …lama 70B. Small documentation fixes for consistency
    @SalmanMohammadi
    SalmanMohammadi committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    366ddc9 View commit details
    Browse the repository at this point in the history

  2. updating __init__.py

    @SalmanMohammadi
    SalmanMohammadi committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    8c11e2a View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. refacting code_llama2 into own folder. adding recipes for code_llama2… 

    … for ease of use.
    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    ba0dd40 View commit details
    Browse the repository at this point in the history

  2. removing unused imports in llama2/__init__.py

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    329fed5 View commit details
    Browse the repository at this point in the history

  3. Updating README.md, fixing mis-copied files

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b88bade View commit details
    Browse the repository at this point in the history

  4. adding missing import in torchtune/models/__init__.py

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    36e1754 View commit details
    Browse the repository at this point in the history

  5. adding code_llama2 recipes to _recipe_registry.py

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    257b5de View commit details
    Browse the repository at this point in the history

  6. Fixing bug in lora and qlora code_llama2 recipes using the wrong mode… 

    …l reference
    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    7890051 View commit details
    Browse the repository at this point in the history

  7. missing profiler configs in lora_code_llama2_7b

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    2e06912 View commit details
    Browse the repository at this point in the history

  8. Fixing typos in recipe docs, removing references to instruct models, … 

    …and a typo to refernce to qlora config for code_llama2 in recipe registry
    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    ff4f6f5 View commit details
    Browse the repository at this point in the history

  9. git not picking up case change in filename...

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    64907b4 View commit details
    Browse the repository at this point in the history

  10. updating reference to codellama huggingface repo

    @SalmanMohammadi
    SalmanMohammadi committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    c8d9584 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. updating docs, removing qlora 70b and models

    @SalmanMohammadi
    SalmanMohammadi committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    83153e5 View commit details
    Browse the repository at this point in the history

  2. Updating typos in docstrings, fixing recipe config errors

    @SalmanMohammadi
    SalmanMohammadi committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    98ef8b8 View commit details
    Browse the repository at this point in the history