Skip to content

Can not read from Iceberg table that was partitioned by Time column #1536

@alsugiliazova

Description

@alsugiliazova

Describe what's wrong

Issue is present on 25.8, 26.1 altinityalntalya, but not present on 25.8, 26.1 upstream.

SELECT *
FROM `namespace_9c79ab0e_f62e_11f0_a09b_de7b9eea3490.table_9c79ab68_f62e_11f0_a09b_de7b9eea3490`
Received exception from server (version 25.8.14):
Code: 499. DB::Exception: Received from localhost:9000. DB::Exception: Failed to get object info: No response body.. HTTP response code: 404: while reading data/data/time_column=12:00:00/00000-0-e2f58393-ed35-4638-b273-cde26665a924.parquet: While executing ReadFromObjectStorage. (S3_ERROR)
SELECT count()
FROM `namespace_9c79ab0e_f62e_11f0_a09b_de7b9eea3490.table_9c79ab68_f62e_11f0_a09b_de7b9eea3490`

Query id: 8007e5e4-4e42-4c97-81c1-866083e8b66e

   ┌─count()─┐
1. │       1 │
   └─────────┘

1 row in set. Elapsed: 0.017 sec. 

clickhouse1 :) show table `namespace_9c79ab0e_f62e_11f0_a09b_de7b9eea3490.table_9c79ab68_f62e_11f0_a09b_de7b9eea3490`

SHOW CREATE TABLE `namespace_9c79ab0e_f62e_11f0_a09b_de7b9eea3490.table_9c79ab68_f62e_11f0_a09b_de7b9eea3490`

Query id: abb5ad35-5eff-4b79-b3fc-851b7aff7eba

   ┌─statement──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
1. │ CREATE TABLE iceberg_database_9c79abcc_f62e_11f0_a09b_de7b9eea3490.`namespace_9c79ab0e_f62e_11f0_a09b_de7b9eea3490.table_9c79ab68_f62e_11f0_a09b_de7b9eea3490`↴│
   │↳(                                                                                                                                                             ↴│
   │↳    `time_column` Nullable(Int64),                                                                                                                            ↴│
   │↳    `name` Nullable(String)                                                                                                                                   ↴│
   │↳)                                                                                                                                                             ↴│
   │↳ENGINE = Iceberg('http://minio:9000/warehouse/data/', 'admin', '[HIDDEN]')                                                                                     │
   └────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

1 row in set. Elapsed: 0.011 sec. 

Does it reproduce on the most recent release?

Yes

How to reproduce

I used pyiceberg to create table with following schema:

partition_spec=PartitionSpec(
    PartitionField(source_id=1, field_id=1001, transform=IdentityTransform(), name=time_column)
)
sort_order=SortOrder(),
schema=Schema(
    NestedField(field_id=1, name=time_column, field_type=TimeType(), required=False),
    NestedField(field_id=2, name="name", field_type=StringType(), required=False),
)

Data append:

test_data = [{column_name: time(12, 0, 0), "name": "test"}]
df = pa.Table.from_pylist(test_data, schema=pa.schema([(column_name, pa.time64("us")), ("name", pa.string())]))
table.append(df)

Metadata

Metadata

Assignees

No one assigned

    Labels

    antalyabugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions