A simple web interface for a chatbot.
Front-end:
- allow markdown for pretty stuff like code input (easy: <90m)
- light/dark theme (easy: <90m)
- pretty response rendering like in generative UI (medium: 1-3h)
Back-end:
- [IN PROGRESS]
Conversationobject actually contains the message history (easy: <90m); - should route methods open and close a Redis client every time?
- Serve all routes (medium: 1-3h)
- Support other model providers like Together, possibly do this through Vercel AI SDK? (medium: 1-3h)
- Better usage of persistence layer, don't get/set every time you operate on conversation history (easy: <90m);
- Serve LM directly, not through 3rd party API (hard: >3h);
- IAM, with conversations stored per user and retrieved on login (hard: >3h);