Skip to content

[otel-arrow-rust] Adaptive array builders for encoding #533

Open
1 of 3 issues completed
Open
@albertlockett

Description

@albertlockett

When encoding OTAP batches, we often need to dynamically switch between the array not being present in the record batch, or the array being present but with either arrow type dictionary (with variable key size depending on the cardinality), or the native array type.

For more information see here: https://arrow.apache.org/blog/2023/06/26/our-journey-at-f5-with-apache-arrow-part-2/

We already have this implemented in Go:
https://github.com/open-telemetry/otel-arrow/blob/main/go/pkg/otel/common/schema/builder/record.go

We should add the same functionality to otel-arrow-rust

Sub-issues

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestrustPull requests that update Rust code

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions