Skip to content

Release v2.6

Choose a tag to compare

View all tags
@github-actions github-actions released this 26 May 21:36
v2.6
1421276

docs: update README for v2.6 (OpenAI-compatible API, Custom API Provider sidebar)

llama.cpp fix, generic OpenAI-compatible API, Ollama Docker hint, provider prefix dropdown

  • Fix llama.cpp/LM Studio thinking models (Qwen3.5, Gemma 4): auto-append /v1 to
    LLAMA_CPP_BASE_URL in resolve_model_config, set streaming=False to avoid
    'No generations found in stream' from reasoning_content chunks

  • Add localhost bypass in _ensure_credentials so local model users aren't
    incorrectly prompted for OPENAI_API_KEY

  • Add generic OpenAI-compatible provider via CUSTOM_API_BASE_URL + CUSTOM_API_KEY:
    fetch_custom_api_models() auto-discovers models, resolve_model_config routes
    them through ChatOpenAI with the custom base URL

  • Log actionable Docker hint when Ollama is unreachable at localhost/127.0.0.1
    (use host.docker.internal instead)

  • Add get_model_display_names() and format_func to model selectbox so the
    dropdown shows [provider] model_name labels without changing underlying keys

Assets 2
Loading