Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DIOPI] Wx/align standard flash attention interface definition #1268

Merged
merged 46 commits into from
Jun 27, 2024
Merged

[DIOPI] Wx/align standard flash attention interface definition #1268

merged 46 commits into from
Jun 27, 2024

Commits on Jun 19, 2024

  1. draft[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    3dd5825 View commit details
    Browse the repository at this point in the history

  2. update[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    97e0945 View commit details
    Browse the repository at this point in the history

  3. update[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    b058698 View commit details
    Browse the repository at this point in the history

  4. draft[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    07a42e4 View commit details
    Browse the repository at this point in the history

  5. update[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    f4b5000 View commit details
    Browse the repository at this point in the history

  6. update

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    0da8086 View commit details
    Browse the repository at this point in the history

  7. update

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    16a014a View commit details
    Browse the repository at this point in the history

  8. update config[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    67c0916 View commit details
    Browse the repository at this point in the history

  9. fix[skip ci]

    @POI-WX
    POI-WX committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    5ee6921 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. update

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    6fce4fa View commit details
    Browse the repository at this point in the history

  2. fix

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    e24f279 View commit details
    Browse the repository at this point in the history

  3. impl varlen fa on camb

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    dc67b0d View commit details
    Browse the repository at this point in the history

  4. fix dtype cast

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    29f9324 View commit details
    Browse the repository at this point in the history

  5. fix

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    34e9b92 View commit details
    Browse the repository at this point in the history

  6. fix

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    dc50f89 View commit details
    Browse the repository at this point in the history

  7. fix bug of backward

    @POI-WX
    POI-WX committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    08d2186 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. fix and add test cases about long max_seq_len

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    fdecd5d View commit details
    Browse the repository at this point in the history

  2. fix

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    4f30583 View commit details
    Browse the repository at this point in the history

  3. support gqa

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    bd24fb5 View commit details
    Browse the repository at this point in the history

  4. add test cases for gqa

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    fc6c665 View commit details
    Browse the repository at this point in the history

  5. fix bug of generating data for gqa

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    3c2275d View commit details
    Browse the repository at this point in the history

  6. impl diopiFlashAttention on camb

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    d85e9aa View commit details
    Browse the repository at this point in the history

  7. modify description

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    a6406d5 View commit details
    Browse the repository at this point in the history

  8. modify from int to int32_t

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    5bd3003 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' of https://github.com/DeepLink-org/DIOPI into wx/… 

    …align_standard_flash_attention_interface_definition
    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    96bfff0 View commit details
    Browse the repository at this point in the history

  10. update

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    6be9e97 View commit details
    Browse the repository at this point in the history

  11. add definition of diopiFlashAttentionV2 for ascend

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    e50ea88 View commit details
    Browse the repository at this point in the history

  12. add definition of diopiFlashAttentionVarLenV2 for ascend

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    4eba0ce View commit details
    Browse the repository at this point in the history

  13. update[skip ci]

    @POI-WX
    POI-WX committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    a60311b View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. add diopiFlashAttentionV2 on ascend

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    bf58bda View commit details
    Browse the repository at this point in the history

  2. add diopiFlashAttentionVarLenV2 on ascend

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    daaa68f View commit details
    Browse the repository at this point in the history

  3. add test cases

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    23359d0 View commit details
    Browse the repository at this point in the history

  4. update

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b9282ef View commit details
    Browse the repository at this point in the history

  5. fix

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    f732065 View commit details
    Browse the repository at this point in the history

  6. update

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    3a5420d View commit details
    Browse the repository at this point in the history

  7. fix

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    dec6c76 View commit details
    Browse the repository at this point in the history

  8. update

    @POI-WX
    POI-WX committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    9204df7 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. fix

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    8a9a395 View commit details
    Browse the repository at this point in the history

  2. fix attention mask

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    196a8fe View commit details
    Browse the repository at this point in the history

  3. update

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    7e297ee View commit details
    Browse the repository at this point in the history

  4. fix bug

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    4cf1785 View commit details
    Browse the repository at this point in the history

  5. improve code comments

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    305daeb View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' of https://github.com/DeepLink-org/DIOPI into wx/… 

    …align_standard_flash_attention_interface_definition
    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    98a3388 View commit details
    Browse the repository at this point in the history

  7. update[skip ci]

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    0dac35f View commit details
    Browse the repository at this point in the history

  8. add diopiCustomizedFlashAttention and diopiCustomizedFlashAttentionVa… 

    …rLen for ascend
    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    1dcf563 View commit details
    Browse the repository at this point in the history

  9. fix clamp

    @POI-WX
    POI-WX committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    1e617fd View commit details
    Browse the repository at this point in the history