Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… #5663

Merged
merged 3 commits into from
Apr 30, 2024
Merged

[Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… #5663

merged 3 commits into from
Apr 30, 2024

Commits on Apr 30, 2024

  1. refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… 

    …ator
    @SunflowerAries
    SunflowerAries committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    f7b243f View commit details
    Browse the repository at this point in the history

  2. refactor decode_kv_cache_memcpy

    @SunflowerAries
    SunflowerAries committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    8d2b8b9 View commit details
    Browse the repository at this point in the history

  3. enable alibi in pagedattention

    @SunflowerAries
    SunflowerAries committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    b237fa5 View commit details
    Browse the repository at this point in the history