Skip to content

feat: bytes read and bytes write mectirc for per lance scanner and writer #3570

Description

@SaintBacchus

When we scan the lance dataset, it's better to provide the read metrics, especially for the io bytes and IOPS metric.

The Spark web UI has some task-level metrics, for example, the input bytes. But now Lance can't provide it.

Image

The same metrics are required when we write a lance dataset.

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Fields

    No fields configured for Feature.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions