This repository contains example code to go along with this blog post. This code contains all of the resources to launch and run an example workflow of using an LLM to maintain context with individual users while keeping that context private from other users.
Check out the complete example in the notebook.
This solution leverages txtai and HuggingFace Transformers. The rest of the requirements can be found in requirements.txt.
For more information feel free to reach out to us here.