Repository navigation
v2.17.0
Compatibility Notes
- [orchestration, prompt-registry]
LlamaGuard38BandLlamaGuard38BFilterConfigare now marked as deprecated and will be removed on 2027-09-20.
Migrate usages before that date.
New Features
- [context-registry] Add tabular context registry package.
- [core] Add
gemini-3.8-flashto the model types. - [core] Add
gpt-6-astra,gpt-6-luna,gpt-6.1-sol,gemini-3.6-flash, andnvidia--llama-nemotron-embed-1bto the model types. - [langchain] Add reasoning content support to the Orchestration LangChain client.
Reasoning blocks from model responses are surfaced inAIMessage.additional_kwargs.reasoning_content(preserving thesignaturefor encrypted thinking), for both non-streaming and streaming responses.
On subsequent turns, reasoning is forwarded back to the Orchestration service inreasoning_contentfromadditional_kwargs.reasoning_content.
Reasoning placed directly in messagecontentis treated as output only and is not forwarded. - [orchestration] Update generated client to latest spec (rel-1.13.2).
Add optionalprovider_specific_fieldsproperty toLlmChoiceandLlmChoiceStreamingresponse types. - [orchestration] Update the generated client to spec v1.23.
Adds the IBM Granite Guardian 4.1 content filter.
Adds input filter target selectors.
Adds thedrop_unsupported_paramsoption onLLMModelDetails. - [prompt-registry] Update generated client to latest spec.
AdddeleteOrchestrationConfigsByScenario,deleteOrchestrationConfigHistory,deletePromptTemplatesByScenario, anddeletePromptTemplateHistoryAPI functions. - [tabular-orchestration] Add experimental Tabular AI Orchestration package with
TabularOrchestrationClientfor predictions with Tabular Foundation Models.
Fixed Issues
- [langchain] Additional
additional_kwargsproperties (includingtool_calls,intermediate_results, andreasoning_content) are now correctly placed on theAIMessageinstead of the generation object. - [langchain] Avoid retrying irrecoverable orchestration request and unsupported-model errors.
- [orchestration] Preserve
prompt_tokens_detailsandcompletion_tokens_detailsin streamed token usage to fix missing cache and reasoning token details inOrchestrationStreamResponse.getTokenUsage()andgetIntermediateResults(). - [orchestration] Fix missing prompt template or messages not being detected when no prompt is configured.
Improvements
-
[core] Remove deprecated models
cohere--command-a-reasoning(retirement date: 2026-10-30),mistralai--mistral-medium-instruct(retirement date: 2026-11-30) — usemistralai--mistral-mediuminstead,gemini-2.5-flash-lite(retirement date: 2026-10-20) — usegemini-3.5-flash-liteinstead,sap-rpt-1.5(retirement date: 2026-12-31) — usesap-rpt-1.6instead,sap-rpt-1.5-large(retirement date: 2026-12-31) — usesap-rpt-1.6-largeinstead,sap-rpt-1-small(retirement date: 2026-12-31) — usesap-rpt-1.6instead andsap-rpt-1-large(retirement date: 2026-12-31) — usesap-rpt-1.6-largeinstead.