Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support RWKV models (100% RNN) #26

Closed
BlinkDL opened this issue May 1, 2023 · 3 comments
Closed

Support RWKV models (100% RNN) #26

BlinkDL opened this issue May 1, 2023 · 3 comments
Assignees
@Hzfengsy
Labels
feature request New feature or request

Comments

@BlinkDL
Copy link

BlinkDL commented May 1, 2023

RWKV Raven 7B Gradio DEMO: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B

CPU INT4: https://github.com/saharNooby/rwkv.cpp

100% CUDA version: https://github.com/harrisonvanderbyl/rwkv-cpp-cuda

ONNX convertor: https://github.com/harrisonvanderbyl/rwkv-onnx

Github project: https://github.com/BlinkDL/ChatRWKV

Please let me know if you have any questions :)
@junrushao junrushao added the feature request New feature or request label May 1, 2023
@junrushao
Copy link
Member

CC @Hzfengsy

@Hzfengsy
Copy link
Member

The WIP PR: #142

@Hzfengsy
Copy link
Member

finished at #142

masahi pushed a commit to masahi/mlc-llm that referenced this issue Oct 20, 2023
@elvin-n
Fix decode of the first answer token (mlc-ai#26)
6f24ef8
@renillhuang renillhuang mentioned this issue Dec 25, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Hzfengsy Hzfengsy

Labels
feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@junrushao @Hzfengsy @BlinkDL