Skip to content

feat: add timeout param to all chat model providers#785

Merged
radu-mocanu merged 1 commit intomainfrom
feat/chat-timeout-param
Apr 20, 2026
Merged

feat: add timeout param to all chat model providers#785
radu-mocanu merged 1 commit intomainfrom
feat/chat-timeout-param

Conversation

@radu-mocanu
Copy link
Copy Markdown
Collaborator

@radu-mocanu radu-mocanu commented Apr 20, 2026

Summary

  • add timeout: float | None = None to UiPathChatOpenAI, UiPathChatVertex, UiPathChatBedrockConverse, UiPathChatBedrock
  • add get_default_timeout() helper reading UIPATH_TIMEOUT_SECONDS, defaulting to 300s (up from 120s)
  • fix openai: pass timeout to super().__init__() so the openai sdk enforces it per-request (httpx client-level alone was silently ignored)
  • fix vertex: set HttpOptions.timeout (ms) so google-genai sdk enforces it per-request (same override pattern)
  • add test-llm-models sample for comparing models side-by-side with timeout testing
  • add tests/chat/test_timeout.py covering all three providers

@radu-mocanu radu-mocanu force-pushed the feat/chat-timeout-param branch from f9f4ef1 to 49f03e0 Compare April 20, 2026 15:08
@radu-mocanu radu-mocanu requested a review from ionmincu April 20, 2026 15:09
@radu-mocanu radu-mocanu force-pushed the feat/chat-timeout-param branch 2 times, most recently from ec99e3a to a81a04b Compare April 20, 2026 15:16
@radu-mocanu radu-mocanu force-pushed the feat/chat-timeout-param branch from a81a04b to bc3a744 Compare April 20, 2026 15:17
@radu-mocanu radu-mocanu merged commit f7c6fe8 into main Apr 20, 2026
60 of 62 checks passed
@radu-mocanu radu-mocanu deleted the feat/chat-timeout-param branch April 20, 2026 15:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants