Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Support Llama-2 with GQA #147

Merged
merged 8 commits into from
Jul 21, 2023
Merged

[Feature] Support Llama-2 with GQA #147

merged 8 commits into from
Jul 21, 2023

Commits on Jul 19, 2023

  1. add GQA for llama2

    @lzhangzz
    lzhangzz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8d0dd86 View commit details
    Browse the repository at this point in the history

  2. fix model conversion

    @lzhangzz
    lzhangzz committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    ee9dd3c View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. fix lint & remove dev log

    @lzhangzz
    lzhangzz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    493eb6a View commit details
    Browse the repository at this point in the history

  2. update news

    @lzhangzz
    lzhangzz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    6e283d6 View commit details
    Browse the repository at this point in the history

  3. minor

    @lzhangzz
    lzhangzz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    5b1621d View commit details
    Browse the repository at this point in the history

  4. fix allocation size

    @lzhangzz
    lzhangzz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    46420dc View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into llama2

    @lzhangzz
    lzhangzz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    3d90af7 View commit details
    Browse the repository at this point in the history

  6. fix split_dim for w_qkv.bias

    @lzhangzz
    lzhangzz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    277ac1f View commit details
    Browse the repository at this point in the history