New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Using vineyard blob to support llm file storage. #1942

Closed

vegetableysm opened this issue Jul 18, 2024 · 0 comments · Fixed by #1963

Assignees

Labels

llm

Collaborator

vegetableysm commented Jul 18, 2024

Describe your problem

Use hash to generate blob name and use blob to store kv cache.

Points:

Synchronization problem
File operator.

vegetableysm added the llm label

vegetableysm self-assigned this

vegetableysm mentioned this issue

Integration RDMA module with llm cache. #1963

Merged

sighingnow closed this as completed in #1963

sighingnow closed this as completed in

87c8c02

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment