Skip to content

Try to fix Clickhouse issue on Github actions#3806

Merged
virajmehta merged 4 commits intomainfrom
aaron/workaround-clickhouse-github
Oct 3, 2025
Merged

Try to fix Clickhouse issue on Github actions#3806
virajmehta merged 4 commits intomainfrom
aaron/workaround-clickhouse-github

Conversation

@Aaron1011
Copy link
Copy Markdown
Member

@Aaron1011 Aaron1011 commented Oct 3, 2025

Clickhouse suddenly failed to start up in all of our PR ci jobs (e.g. https://github.com/tensorzero/tensorzero/actions/runs/18230587441/job/51917262832?pr=3801) with this error:

clickhouse-1  | 2025-10-03T19:39:15.158611046Z 2025.10.03 19:39:15.158518 [ 1 ] {} <Warning> Application: Listen [::]:8123 failed: Poco::Exception. Code: 1000, e.code() = 0, DNS error: EAI: Address family for hostname not supported (version 24.12.6.70 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0</listen_host> . Example for disabled IPv4: <listen_host>::</listen_host>

Let's try to fix it by only listening on IPv4


Important

Fix Clickhouse startup issue in CI by configuring it to listen on IPv4 and updating Dockerfile base images.

  • Clickhouse Configuration:
    • Set <listen_host>0.0.0.0</listen_host> in config.xml to listen only on IPv4.
    • Update volume mount path in docker-compose.e2e.ci.yml, docker-compose.e2e.yml, and docker-compose.unit.yml to /etc/clickhouse-server/config.d/docker_related_config.xml.
  • Dockerfile Updates:
    • Update base image in gateway/Dockerfile and ui/Dockerfile to lukemathwalker/cargo-chef:latest-rust-1.90-bookworm.

This description was created by Ellipsis for e3bd2be. You can customize this summary. It will automatically update as commits are pushed.

Copilot AI review requested due to automatic review settings October 3, 2025 19:47
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR attempts to fix ClickHouse connectivity issues in GitHub Actions by configuring ClickHouse to listen on all network interfaces. The change adds the listen_host configuration to bind ClickHouse to 0.0.0.0 instead of the default localhost-only binding.

  • Added listen_host configuration to ClickHouse XML config files
  • Modified both replicated and latest-alpine ClickHouse configurations

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
tensorzero-core/tests/e2e/replicated_clickhouse_config/common/users.xml Added listen_host configuration for replicated ClickHouse setup
tensorzero-core/tests/e2e/clickhouse-configs/latest-alpine/users.xml Added listen_host configuration for latest-alpine ClickHouse setup

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@Aaron1011 Aaron1011 force-pushed the aaron/workaround-clickhouse-github branch from 36ccca2 to 4440da0 Compare October 3, 2025 20:03
Copilot AI review requested due to automatic review settings October 3, 2025 20:20
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

virajmehta
virajmehta previously approved these changes Oct 3, 2025
@virajmehta virajmehta enabled auto-merge October 3, 2025 20:37
Copilot AI review requested due to automatic review settings October 3, 2025 21:01
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated no new comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@virajmehta virajmehta added this pull request to the merge queue Oct 3, 2025
Merged via the queue into main with commit d6be8a9 Oct 3, 2025
30 checks passed
@virajmehta virajmehta deleted the aaron/workaround-clickhouse-github branch October 3, 2025 21:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants