Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: Add Nested quantization check #3916

Merged
merged 5 commits into from
Jan 29, 2024
Merged

fix: Add Nested quantization check #3916

merged 5 commits into from
Jan 29, 2024

Commits on Jan 25, 2024

  1. add tests for get_quantization, clean up config_uses_llm tests

    @jeffkinnison
    jeffkinnison committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    651c145 View commit details
    Browse the repository at this point in the history

  2. add quantization detection

    @jeffkinnison
    jeffkinnison committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    2e6b3af View commit details
    Browse the repository at this point in the history

  3. detect quantization with util

    @jeffkinnison
    jeffkinnison committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    ce58a9a View commit details
    Browse the repository at this point in the history

  4. use model config obj for check

    @jeffkinnison
    jeffkinnison committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    831ebf5 View commit details
    Browse the repository at this point in the history

  5. put ECD on GPU to recreate the 8-bit tensors

    @jeffkinnison
    jeffkinnison committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    318aa19 View commit details
    Browse the repository at this point in the history