Skip to content

v0.4.0 - cloud providers

Choose a tag to compare

@katrohit katrohit released this 28 Jul 08:59
· 11 commits to main since this release
240368a

Adds cloud LLM backends (Mistral, Groq, OpenRouter, Cerebras, or any OpenAI-compatible API) alongside the local llama.cpp model.

  • ai --setup picks a backend and saves it to ~/.ai-sh/config.json
  • install.sh asks local vs. cloud and hands off to ai --setup
  • Config honors AI_SH_* env overrides and conventional provider keys (MISTRAL_API_KEY, ...)

Note: the v0.3.0 binary predates --setup, so the cloud path in the current installer failed against it. This release fixes that.