Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ARROW-11644: [Python][Parquet] Low-level Parquet decryption in Python #9631

Closed
wants to merge 33 commits into from
Closed

ARROW-11644: [Python][Parquet] Low-level Parquet decryption in Python #9631

wants to merge 33 commits into from

Commits on Feb 16, 2021

  1. ARROW-11644: [Python][Parquet] Expose Parquet encryption headers to C… 

    …ython.
    @itamarst
    itamarst committed Feb 16, 2021
    Copy the full SHA
    f40ae8c View commit details
    Browse the repository at this point in the history

  2. ARROW-11644: [Python][Parquet] Expose Parquet decryption headers to C… 

    …ython.
    @itamarst
    itamarst committed Feb 16, 2021
    Copy the full SHA
    6a41e21 View commit details
    Browse the repository at this point in the history

  3. ARROW-11644: [Python][Parquet] For now we're doing decryption only.

    @itamarst
    itamarst committed Feb 16, 2021
    Copy the full SHA
    d9f5d82 View commit details
    Browse the repository at this point in the history

  4. ARROW-11644: [Python][Parquet] Fix typo.

    @itamarst
    itamarst committed Feb 16, 2021
    Copy the full SHA
    284b162 View commit details
    Browse the repository at this point in the history

  5. ARROW-11644: [Python][Parquet] Sketch of Python API for decryption. 

    Covers some but not all of the API features.
    @itamarst
    itamarst committed Feb 16, 2021
    Copy the full SHA
    7bab699 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2021

  1. It compiles now.

    @itamarst
    itamarst committed Feb 18, 2021
    Copy the full SHA
    8369a1c View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2021

  1. Sketch of encryption, initially just for testing decryption.

    @itamarst
    itamarst committed Feb 26, 2021
    Copy the full SHA
    eef1f07 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2021

  1. ARROW-11644: [Python][Parquet] Basic encryption support compiles now.

    @itamarst
    itamarst committed Mar 2, 2021
    Copy the full SHA
    e828a91 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2021

  1. ARROW-11644: [Python][Parquet] First working round-trip test.

    @itamarst
    itamarst committed Mar 4, 2021
    Copy the full SHA
    1ff110d View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2021

  1. ARROW-11644: [Python][Parquet] Support for column keys.

    @itamarst
    itamarst committed Mar 12, 2021
    Copy the full SHA
    23e2feb View commit details
    Browse the repository at this point in the history

  2. ARROW-11644: [Python][Parquet] Test for allowing plain text files.

    @itamarst
    itamarst committed Mar 12, 2021
    Copy the full SHA
    219e581 View commit details
    Browse the repository at this point in the history

  3. ARROW-11644: [Python][Parquet] Test for disabling footer verification.

    @itamarst
    itamarst committed Mar 12, 2021
    Copy the full SHA
    3eac091 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2021

  1. ARROW-11644: [Python][Parquet] Lint fixes.

    @itamarst
    itamarst committed Mar 15, 2021
    Copy the full SHA
    2ca0390 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2021

  1. ARROW-11644: [Python][Parquet] Sketch of DecryptionKeyRetriever suppo… 

    …rt for Python.
    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    d6fd90e View commit details
    Browse the repository at this point in the history

  2. ARROW-11644: [Python][Parquet] DecryptionKeyRetriever support for Pyt… 

    …hon compiles.
    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    e925794 View commit details
    Browse the repository at this point in the history

  3. ARROW-11644: [Python][Parquet] Just rely on C++ error handling.

    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    707a94e View commit details
    Browse the repository at this point in the history

  4. ARROW-11644: [Python][Parquet] Fix GIL handling.

    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    079f635 View commit details
    Browse the repository at this point in the history

  5. ARROW-11644: [Python][Parquet] A test for the key retriever.

    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    2bd1aba View commit details
    Browse the repository at this point in the history

  6. ARROW-11644: [Python][Parquet] Lint fixes.

    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    0d1ed15 View commit details
    Browse the repository at this point in the history

  7. ARROW-11644: [Python][Parquet] Enable encyrption in wheel.

    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    d739f52 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'upstream/master' into ARROW-11644

    @itamarst
    itamarst committed Mar 29, 2021
    Copy the full SHA
    622e21c View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2021

  1. ARROW-11644: [Python][Parquet] Make it compile.

    @itamarst
    itamarst committed Apr 1, 2021
    Copy the full SHA
    1b5b93b View commit details
    Browse the repository at this point in the history

  2. ARROW-11644: [Python][Parquet] Fix typo in name.

    @itamarst
    itamarst committed Apr 1, 2021
    Copy the full SHA
    2b35340 View commit details
    Browse the repository at this point in the history

  3. ARROW-11644: [Python][Parquet] Make it compile.

    @itamarst
    itamarst committed Apr 1, 2021
    Copy the full SHA
    922681c View commit details
    Browse the repository at this point in the history

  4. ARROW-11644: [Python][Parquet] Test for null bytes in metadata.

    @itamarst
    itamarst committed Apr 1, 2021
    Copy the full SHA
    992c170 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2021

  1. ARROW-11644: [Python][Parquet] Support arbitrary bytes, not just UTF-… 

    …8 strings.
    @itamarst
    itamarst committed Apr 2, 2021
    Copy the full SHA
    945fcef View commit details
    Browse the repository at this point in the history

  2. ARROW-11644: [Python][Parquet] Always set metadata. 

    So as to avoid having to choose between fighting Cython and fighting Parquet.
    @itamarst
    itamarst committed Apr 2, 2021
    Copy the full SHA
    1a8d801 View commit details
    Browse the repository at this point in the history

  3. ARROW-11644: [Python][Parquet] If footer key isn't set, need retriever.

    @itamarst
    itamarst committed Apr 2, 2021
    Copy the full SHA
    2a44cd8 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2021

  1. ARROW-11644: [Python][Parquet] Fix lints.

    @itamarst
    itamarst committed Apr 6, 2021
    Copy the full SHA
    c3ebf6d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/master' into ARROW-11644

    @itamarst
    itamarst committed Apr 6, 2021
    Copy the full SHA
    2a5bd3f View commit details
    Browse the repository at this point in the history

Commits on May 6, 2021

  1. Merge remote-tracking branch 'upstream/master' into ARROW-11644

    @itamarst
    itamarst committed May 6, 2021
    Copy the full SHA
    9a5f4c7 View commit details
    Browse the repository at this point in the history

  2. ARROW-11644: [Python][Parquet] Switch to simpler pure-Cython key retr… 

    …iever.
    @itamarst
    itamarst committed May 6, 2021
    Copy the full SHA
    7267bd4 View commit details
    Browse the repository at this point in the history

  3. ARROW-11644: [Python][Parquet] Fix bad merge.

    @itamarst
    itamarst committed May 6, 2021
    Copy the full SHA
    7cfb720 View commit details
    Browse the repository at this point in the history