Add local Ollama/Qwen support through the OpenAI-compatible provider

[punyaslokdutta]

Summary

• add OpenAI-compatible local runtime support for self-hosted endpoints like Ollama
• add Qwen model options in Mike's model picker and document the Docker-plus-native-Ollama setup
• make the OpenAI-compatible path stream local model output incrementally so Mike surfaces answers instead of appearing blank while Ollama is still generating

What changed

• made the OpenAI adapter configurable via OPENAI_COMPAT_BASE_URL, OPENAI_COMPAT_MODEL, and OPENAI_COMPAT_ENDPOINT_MODE
• added support for chat-completions style OpenAI-compatible backends used by Ollama and vLLM
• treated env-configured OpenAI-compatible runtimes as available even without a hosted OpenAI API key
• added Qwen 3 8B and 14B options to the model picker
• documented the local Docker app stack plus native Ollama workflow for testing Mike locally

Validation

• npm run build --prefix backend
• local Docker stack rebuilt with the Ollama-compatible env path
• verified local Supabase keys were wired into the Docker env files for the local dev stack

Notes

• frontend lint still reports existing repo-wide issues unrelated to this branch
• this branch is intentionally scoped to local inference enablement first; broader benchmark work can build on top

Screenshot

[BaileySimrell]

Personally I would love to see Vercel AI Gateway support. https://vercel.com/ai-gateway

[willchen96]

Thank you for this Punyaslok. There are many great ideas here. But I have decided to keep the main repo as it is without large structural changes as proposed in this repo. I plan to instead have an official Mike-Local version that provides local LLM support. Mike-Local will possibly be a React native app which is more suitable for a local desktop version.

As for Vercel AI Gateway Support I will likely implement in a PR.