Skip to content

Update Docker Compose files to set up a volume for ClickHouse#3455

Merged
GabrielBianconi merged 17 commits intomainfrom
gb/volumex
Oct 5, 2025
Merged

Update Docker Compose files to set up a volume for ClickHouse#3455
GabrielBianconi merged 17 commits intomainfrom
gb/volumex

Conversation

@GabrielBianconi
Copy link
Copy Markdown
Member

@GabrielBianconi GabrielBianconi commented Sep 8, 2025

Builds on top of #3454


Important

Add persistent clickhouse-data volume to ClickHouse services in Docker Compose files for data retention across container restarts.

  • Docker Compose Updates:
    • Add clickhouse-data volume to clickhouse service in docker-compose.yml files across multiple directories, including examples/babyai, examples/chess-puzzles, and tensorzero-core/tests/e2e.
    • Ensures ClickHouse data is stored in /var/lib/clickhouse for persistence.
  • Environment Variables:
    • Standardize environment variable format in docker-compose.yml files, changing from - VAR=value to VAR: value format in docs/gateway/guides/multimodal-inference.mdx and docs/gateway/guides/prompt-templates-schemas.mdx.
  • Health Checks:
    • Maintain existing health checks for ClickHouse and other services to ensure service readiness.

This description was created by Ellipsis for 8ba3684. You can customize this summary. It will automatically update as commits are pushed.

@GabrielBianconi GabrielBianconi marked this pull request as ready for review September 8, 2025 23:57
Copilot AI review requested due to automatic review settings September 8, 2025 23:57
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Updates multiple Docker Compose files across the project to consistently configure persistent storage for ClickHouse by adding named volumes. This ensures ClickHouse data persists across container restarts and recreations.

  • Adds clickhouse-data volume mounting to /var/lib/clickhouse for all ClickHouse services
  • Defines the clickhouse-data volume in the volumes section of each compose file
  • Updates documentation examples to reflect the new volume configuration

Reviewed Changes

Copilot reviewed 38 out of 38 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
ui/fixtures/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
ui/fixtures/docker-compose.unit.yml Adds volume mount and volume definition for ClickHouse data persistence
ui/fixtures/docker-compose.e2e.yml Adds volume mount and volume definition for ClickHouse data persistence
ui/fixtures/docker-compose.e2e.ci.yml Adds volume mount and volume definition for ClickHouse data persistence
tensorzero-core/tests/optimization/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
tensorzero-core/tests/load/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
tensorzero-core/tests/e2e/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
tensorzero-core/tests/e2e/docker-compose.live.yml Adds volume mount and volume definition for ClickHouse data persistence
tensorzero-core/tests/e2e/docker-compose.clickhouse.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/tutorial/04-email-data-extraction/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/tutorial/03-weather-rag/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/tutorial/02-email-copilot/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/tutorial/01-simple-chatbot/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/readme/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/quickstart/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/multimodal-vision-finetuning/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/mcp-model-context-protocol/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/integrations/openai-codex/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/integrations/cursor/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/integrations/crewai/example/tensorzero/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/haiku-hidden-preferences/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/tool-use/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/prompts-templates-schemas/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/opentelemetry-otlp/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/multimodal-inference/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/metrics-feedback/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/episodes/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/datasets-datapoints/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/guides/batch-inference/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/gsm8k-custom-recipe-dspy/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/evaluations/tutorial/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/dynamic_evaluations/simple-agentic-rag/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/data-extraction-ner/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/chess-puzzles/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
examples/babyai/docker-compose.yml Adds volume mount and volume definition for ClickHouse data persistence
docs/quickstart.mdx Updates documentation example to include ClickHouse volume configuration
docs/gateway/guides/prompt-templates-schemas.mdx Updates documentation example to include ClickHouse volume configuration and converts environment array to object syntax
docs/gateway/guides/multimodal-inference.mdx Updates documentation example to include ClickHouse volume configuration and converts environment array to object syntax

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@GabrielBianconi GabrielBianconi marked this pull request as draft September 9, 2025 00:00
@GabrielBianconi GabrielBianconi marked this pull request as ready for review September 9, 2025 14:01
virajmehta
virajmehta previously approved these changes Sep 16, 2025
@virajmehta
Copy link
Copy Markdown
Member

Conflicts

@virajmehta virajmehta removed their assignment Sep 16, 2025
virajmehta
virajmehta previously approved these changes Sep 18, 2025
virajmehta
virajmehta previously approved these changes Sep 24, 2025
@virajmehta virajmehta added this pull request to the merge queue Sep 24, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Sep 24, 2025
@GabrielBianconi GabrielBianconi added this pull request to the merge queue Sep 25, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Sep 25, 2025
Copilot AI review requested due to automatic review settings September 25, 2025 16:43
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 32 out of 32 changed files in this pull request and generated no new comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

virajmehta
virajmehta previously approved these changes Sep 27, 2025
Copilot AI review requested due to automatic review settings October 5, 2025 00:29
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 31 out of 31 changed files in this pull request and generated 2 comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@GabrielBianconi GabrielBianconi added this pull request to the merge queue Oct 5, 2025
Merged via the queue into main with commit f326cf7 Oct 5, 2025
32 checks passed
@GabrielBianconi GabrielBianconi deleted the gb/volumex branch October 5, 2025 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants