Skip to content

Deterministic Dictionary testing in CometFuzzTestSuite #1708

@mbutrovich

Description

@mbutrovich

What is the problem the feature request solves?

#1697 exposed an issue in the random data generation: depending on RNG you can get Dictionary encoded values when written to Parquet, which can result in different paths being exercised.

Describe the potential solution

I tested this locally, but we could modify the generation to use a lower cardinality on some columns to force dictionary encoding.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions