Skip to content

fix: stop calling deprecated PuffinFile.to_vector in Spark DV test - #3804

Open
daviddallakyan2005 wants to merge 1 commit into
apache:mainfrom
daviddallakyan2005:puffin-dv-deprecation
Open

fix: stop calling deprecated PuffinFile.to_vector in Spark DV test#3804
daviddallakyan2005 wants to merge 1 commit into
apache:mainfrom
daviddallakyan2005:puffin-dv-deprecation

Conversation

@daviddallakyan2005

@daviddallakyan2005 daviddallakyan2005 commented Aug 16, 2026

Copy link
Copy Markdown
Contributor

Closes #3803

Rationale for this change

Follow-up to #3476. test_read_spark_written_puffin_dv still calls PuffinFile.to_vector(), which #3491 deprecated in 0.12.0. filterwarnings = ["error"] turns that into a hard CI failure, so integration-test is red on main and on unrelated PRs including #3801.

This test now uses deletion_vectors_from_puffin_file(...), matching pyiceberg/io/pyarrow.py. Spark interop assertions are unchanged. Not part of #3801.

Are these changes tested?

Yes. make test-integration PYTEST_ARGS="-v -k test_read_spark_written_puffin_dv" → 1 passed, 5517 deselected.

Are there any user-facing changes?

No.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test_read_spark_written_puffin_dv fails on deprecated PuffinFile.to_vector

2 participants