Skip to content

Generating 10 files with 10 process for dlrm model takes more than 1 hour with 1% I/O time #324

@wolfgang-desalvador

Description

@wolfgang-desalvador

Generating parquet files for dlrm takes 1 hour, with only 1 minute spent in writing.

How to reproduce:

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions