Skip to content

Bump up DataTable version to address TODOs in DataTableBuilders #6726

@mqliang

Description

@mqliang

As discussed into: #6710, we need bump up DataTable version to address TODOs in DataTableBuilders:

// TODO: potential optimizations:
// TODO:   1. Fix float size.
// TODO:   2. Use one dictionary for all columns (save space).
// TODO:   3. Given a data schema, write all values one by one instead of using rowId and colId to position (save time).
// TODO:   4. Store bytes as variable size data instead of String

For the 3rd TODO, it speculative and benchmark result shows it's not needed: #6720

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions