Skip to content

docs(proxy): cover long inference timeouts - #11065

Merged
mudler merged 1 commit into
masterfrom
docs/reverse-proxy-timeouts-11046
Jul 29, 2026
Merged

docs(proxy): cover long inference timeouts#11065
mudler merged 1 commit into
masterfrom
docs/reverse-proxy-timeouts-11046

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Fixes #11046.

Document the reverse-proxy settings needed by long-running inference and multimodal requests:

  • add a valid Nginx location example with read/send/connect timeouts
  • raise the request body limit and document buffering controls
  • explain why an edge-generated HTML 504 can occur while LocalAI is still running
  • distinguish proxy timeouts from the optional LocalAI busy watchdog and its 5-minute default
  • mention direct private-network access for bulk jobs

Verification:

  • confirmed LOCALAI_WATCHDOG_BUSY_TIMEOUT and its 5m default against core/cli/run.go
  • git diff --check
  • repository pre-commit hook (docs-only path; code coverage checks correctly skipped)

Hugo and Nginx executables are not installed on this host, so syntax/render validation is delegated to CI.

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator Author

@mudler DCO is ACTION_REQUIRED here as well. The commit is bot-authored and repository policy forbids me from adding a human Signed-off-by; please provide maintainer-side attestation if you want this merged. All other CI checks are still running.

@localai-org-maint-bot
localai-org-maint-bot force-pushed the docs/reverse-proxy-timeouts-11046 branch 21 times, most recently from fa8afa1 to da3dc8d Compare July 29, 2026 12:02
Document the reverse-proxy settings needed for long-running and multimodal requests, and distinguish edge-generated 504 responses from the optional LocalAI busy watchdog.

Assisted-by: Codex:gpt-5 [Codex]
@localai-org-maint-bot
localai-org-maint-bot force-pushed the docs/reverse-proxy-timeouts-11046 branch from da3dc8d to 7ea4054 Compare July 29, 2026 14:09
@mudler
mudler merged commit ecdb321 into master Jul 29, 2026
0 of 20 checks passed
@mudler
mudler deleted the docs/reverse-proxy-timeouts-11046 branch July 29, 2026 14:37
@localai-bot localai-bot added the kind/documentation Improvements or additions to documentation label Aug 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Docs: reverse-proxy guide should cover upstream timeouts (OpenResty/nginx 504 on long vision/Responses)

3 participants