Skip to content

fix: treat blob descriptors as opaque projections#7618

Merged
jackye1995 merged 2 commits into
mainfrom
xuanwo/fix-blob-v2-descriptor-projection-7617
Jul 3, 2026
Merged

fix: treat blob descriptors as opaque projections#7618
jackye1995 merged 2 commits into
mainfrom
xuanwo/fix-blob-v2-descriptor-projection-7617

Conversation

@Xuanwo

@Xuanwo Xuanwo commented Jul 3, 2026

Copy link
Copy Markdown
Collaborator

Fixes #7617.

The issue was caused by unloaded blob descriptor schemas being treated like ordinary V2.0 structs during reader projection validation. Blob descriptor views are backed by a single physical blob column, so the reader should not recurse into descriptor child fields such as position and size when consuming projection column indices.

This keeps blob and packed-struct fields opaque across file versions and adds regression coverage for descriptor scans, binary blob scans, take_blobs, and read_blobs.

Validation note: Rust formatting, full workspace clippy, and targeted Rust/Python regressions pass. uv run make lint still fails on this macOS environment because pyright checks existing TensorFlow imports while tensorflow is configured as a Linux-only dependency in python/pyproject.toml.

@github-actions github-actions Bot added A-python Python bindings A-encoding Encoding, IO, file reader/writer bug Something isn't working labels Jul 3, 2026
@Xuanwo Xuanwo marked this pull request as ready for review July 3, 2026 16:57
@codecov

codecov Bot commented Jul 3, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@jackye1995 jackye1995 merged commit 882779a into main Jul 3, 2026
30 checks passed
@jackye1995 jackye1995 deleted the xuanwo/fix-blob-v2-descriptor-projection-7617 branch July 3, 2026 23:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-encoding Encoding, IO, file reader/writer A-python Python bindings bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Blob descriptor projection and take_blobs fail for blob v2 columns in 9.0.0-beta.13

3 participants