Skip to content

Added AES-256 encrypted parquet generated from parquet-java#102

Open
hsiang-c wants to merge 1 commit intoapache:masterfrom
hsiang-c:aes_256_test
Open

Added AES-256 encrypted parquet generated from parquet-java#102
hsiang-c wants to merge 1 commit intoapache:masterfrom
hsiang-c:aes_256_test

Conversation

@hsiang-c
Copy link

@hsiang-c hsiang-c commented Feb 19, 2026

Context

Data Preparation

  • Both files are produced by Parquet Java's TestEncryptionOptions with 32-byte footer key and column keys
  • In addition, I need to disable page write checksum: withPageWriteChecksumEnabled(false) so that arrow-rs can read it w/o issue.

@hsiang-c hsiang-c marked this pull request as ready for review February 19, 2026 01:16
@hsiang-c
Copy link
Author

cc @adamreeve

@hsiang-c hsiang-c changed the title Added AES-256 encrypted parquet from modified parquet-java Added AES-256 encrypted parquet generated from parquet-java Feb 19, 2026
@adamreeve
Copy link
Contributor

Thanks @hsiang-c! Can you please update the data/README.md file and document the keys that have been used in these files?

There's an existing section about the encrypted files at https://github.com/apache/parquet-testing/blob/master/data/README.md#encrypted-files

@adamreeve
Copy link
Contributor

adamreeve commented Feb 19, 2026

I've checked I can read these files with C++ Parquet. How annoying would it be to make the data match what's in the existing encrypted files in this repository? It would greatly simplify adding a C++ test for these if the data is the same, then I could reuse the existing test functions, but it's probably OK if the data is different.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments