Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix LoftQ docs and tests #1532

Merged

Commits on Mar 4, 2024

  1. WIP Fix LoftQ docs and tests

    Relates to huggingface#1525
    
    Unfortunately, the docs I wrote about how to use LoftQ were incorrect,
    based on a misunderstanding I had. In reality, it is quite a bit more
    involved to get LoftQ working, requiring a complete roundtrip first
    loading a non-quantized model with LoftQ, saving the LoRA weights and
    the modified base model, loading the just stored base model again but
    this time with quantization, and finally loading the LoftQ-initialized
    adapter on top. The docs now link to the example which demosthenes how
    to move through these steps.
    BenjaminBossan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    cd2f7be View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Configuration menu
    Copy the full SHA
    d4e8ca7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a503c71 View commit details
    Browse the repository at this point in the history
  3. fix tests

    pacman100 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    8a69692 View commit details
    Browse the repository at this point in the history
  4. Update test_gpu_examples.py

    pacman100 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    ed98c63 View commit details
    Browse the repository at this point in the history
  5. fixes and quality

    pacman100 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    d4372c5 View commit details
    Browse the repository at this point in the history
  6. Small adjustments to tests, docs

    Add reco to use all-linear and nf4.
    BenjaminBossan committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    1b31024 View commit details
    Browse the repository at this point in the history