Skip to content

lightning import parquet from S3 is slow #62906

@joechenrh

Description

@joechenrh

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Import parquet/CSV data from s3.

2. What did you expect to see? (Required)

The speed gap between parquet and CSV should not be too large.

3. What did you see instead (Required)

Read and encode parquet is too slow compared to CSV.

4. What is your TiDB version? (Required)

Metadata

Metadata

Assignees

No one assigned

    Labels

    affects-8.5This bug affects the 8.5.x(LTS) versions.component/lightningThis issue is related to Lightning of TiDB.report/customerCustomers have encountered this bug.severity/majortype/bugThe issue is confirmed as a bug.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions