Stateless -Cluster table functions (like s3Cluster) should always skip unavailable shards.

[alexey-milovidov]

Because it does not make sense to force all shards to be available.

[alexey-milovidov]

Not fixed.

clickhouse-cloud :) INSERT INTO wikistat WITH
    parseDateTimeBestEffort(extract(_file, '^pageviews-([\\d\\-]+)\\.gz$')) AS time,
    splitByChar(' ', line) AS values,
    splitByChar('.', values[1]) AS projects
SELECT
    time,
    projects[1] AS project,
    projects[2] AS subproject,
    decodeURLComponent(values[2]) AS path,
    CAST(values[3], 'UInt64') AS hits
FROM s3Cluster('default',
    'https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews*.gz',
    'LineAsString')
WHERE length(values) >= 3;

INSERT INTO wikistat WITH
    parseDateTimeBestEffort(extract(_file, '^pageviews-([\\d\\-]+)\\.gz$')) AS time,
    splitByChar(' ', line) AS values,
    splitByChar('.', values[1]) AS projects
SELECT
    time,
    projects[1] AS project,
    projects[2] AS subproject,
    decodeURLComponent(values[2]) AS path,
    CAST(values[3], 'UInt64') AS hits
FROM s3Cluster('default', 'https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews*.gz', 'LineAsString')
WHERE length(values) >= 3

Query id: 632c26ed-e920-494d-b815-970b96d41e58

↘ Progress: 0.00 rows, 0.00 B (0.00 rows/s., 0.00 B/s.)                                                                                                                                                                                                              (0.0 CPU, 189.58 MB RAM) 0%
Elapsed: 1.714 sec. 

Received exception from server (version 23.12.1):
Code: 198. DB::Exception: Received from ixfssb0z9s.eu-west-1.aws.clickhouse-staging.com:9440. DB::Exception: Not found address of host: c-denim-mi-40-server-f8cqs43-0.c-denim-mi-40-server-headless.ns-denim-mi-40.svc.cluster.local: While executing Remote. (DNS_ERROR)

[Avogar]

It would be good to see the logs of this failed query and the stacktrace of an exception

[alexey-milovidov]

Cannot reproduce.

I have a partially available cluster when some of the hosts don't resolve.
But everything works perfectly.