v1.3.0
- Embeddings now auto-load on demand:
/api/embedand/api/embeddingsload an unloaded embedding model and return the vector instead of400 "No models loaded", matching how chat/generate already JIT-load. - Added
--default-context-length/OLLAMA_CONTEXT_LENGTH: a server-widenum_ctxfallback applied when a request omits it; a per-requestnum_ctxstill wins. Also honored on/api/embed. - Thinking now defaults on for reasoning-capable models when
thinkis omitted, matching Ollama; explicitthink:falsestill wins. options.min_pis now forwarded on the default chat/generate path instead of being dropped with a warning./api/generatewith asystemprompt now routes through the chat endpoint as a real system turn, so the system instruction takes effect (was concatenated into the completion prompt);raw:trueis guarded against chat templating./api/shownow sources capabilities (vision/tools/thinking) from LM Studio's realcapabilities, surfacesdescription/display_name, and adds loaded tuning (flash_attention/eval_batch_size/parallel) to verbosemodel_info./api/psentries now includedetails.parent_model./api/embednow defaultstruncatetotrueand estimatesprompt_eval_countfrom the input length when LM Studio omits usage (was a constant10).- Structured-output
formatnow sendsstrictas a boolean instead of a string. num_ctxreload is now skipped when all loaded instances already match the requested size (was: only when exactly one matched).- Changed
/api/copy: now returns an empty200body and upserts (overwrites) an existing destination instead of returning{"status":"success"}and failing with400on a duplicate. /api/pullnow accepts and ignoresinsecureinstead of rejecting it with400; failed downloads surface LM Studio'serror_message./api/createreturns a clearer400for unsupportedfiles/quantize;/api/deleteexplains its alias-only limit in the404body.- Upstream
429and502now pass through unchanged instead of being remapped to500/503. done_reasonnow passes through finish reasons the proxy doesn't recognize instead of dropping the field.[native chat]Dropped the non-Ollamaresponse_idfrom--use-native-chatoutput;tools/tool_choice/formatare documented as not forwarded on that path.
Full Changelog: v1.2.0...v1.3.0