Proposal: Add Conversational Mode

[abieler]

What about a conversational mode?
I think it could be useful to have a restricted mode (and significantly smaller system prompt) for conversations. I can achieve this roughly through .crush.md file, but it then still feels kind of slow to get answers and the system prompt eats through a lot of tokens.

I'd love to not have to leave my terminal for a quick chat with an LLM

[kujtimiihoxha]

This is a great idea, have been thinking about this lately too, will add this to my list

[Gallardo994]

This is a great thing that would benefit my workflow too. In a lot of scenarios I want the model to spit out ideas instead of immediately implementing them

[athrunsun]

It's really an awesome idea - I can chat with my choice of LLM(s) while also being able to referencing the source files.