Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flash Attention Implementation & Fuller Config Options #139

Merged
merged 9 commits into from
Apr 9, 2024
Merged

Flash Attention Implementation & Fuller Config Options #139

merged 9 commits into from
Apr 9, 2024

Commits on Apr 8, 2024

  1. add torch_dtype and attn_implementation for model loading step

    @benjaminye
    benjaminye committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    3394b82 View commit details
    Browse the repository at this point in the history

  2. added README instruction

    @benjaminye
    benjaminye committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    557719f View commit details
    Browse the repository at this point in the history

  3. rename infer_test_set for greater clarity

    @benjaminye
    benjaminye committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    bc83065 View commit details
    Browse the repository at this point in the history

  4. enrich inference config parameters

    @benjaminye
    benjaminye committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    075c145 View commit details
    Browse the repository at this point in the history

  5. ruff formatting

    @benjaminye
    benjaminye committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    050e968 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Revert "rename infer_test_set for greater clarity" 

    This reverts commit bc83065.
    @benjaminye
    benjaminye committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    b0e0f56 View commit details
    Browse the repository at this point in the history

  2. use getter instead of validator to handle type casting in pydantic model

    @benjaminye
    benjaminye committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    3837366 View commit details
    Browse the repository at this point in the history

  3. adding flash attention to example config

    @benjaminye
    benjaminye committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    a938550 View commit details
    Browse the repository at this point in the history

  4. fix lint

    @benjaminye
    benjaminye committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0f683f6 View commit details
    Browse the repository at this point in the history