We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
在上次对话结束后保存储存kv_cache的faiss,然后可以在下次对话中载入上次会话的kv_cache faiss
The text was updated successfully, but these errors were encountered:
你好,faiss 本身作为可选项,目前没有计划拓展。你可以自行对 kv cache 进行操作实现 save/load。https://github.com/facebookresearch/faiss/wiki/Index-IO,-cloning-and-hyper-parameter-tuning#io-and-deep-copying-indexes
Sorry, something went wrong.
好像用torch.save就可以保存past_key_values,我实现了一下
好厉害,非常感谢
No branches or pull requests
在上次对话结束后保存储存kv_cache的faiss,然后可以在下次对话中载入上次会话的kv_cache faiss
The text was updated successfully, but these errors were encountered: