Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DM-13876: Implement and register ParquetStorage as a butler storage type #90

Merged
merged 3 commits into from
May 1, 2018
Merged

DM-13876: Implement and register ParquetStorage as a butler storage type #90

merged 3 commits into from
May 1, 2018

Commits on May 1, 2018

  1. Implement and register ParquetStorage as a butler storage type 

    This defines readParquetStorage and writeParquetStorage to define
butler get/put operations for ParquetStorage datatypes.  They use
the wrapper object ParquetTable around pyarrow read/write operations.
Read returns a lazy object; meaning no data is loaded, but arbitrary
columns can be loaded later using the .to_df method of the ParquetTable.
    @timothydmorton
    timothydmorton committed May 1, 2018
    Configuration menu
    Copy the full SHA
    8ed4ab1 View commit details
    Browse the repository at this point in the history

  2. fix trailing whitespace

    @timothydmorton
    timothydmorton committed May 1, 2018
    Configuration menu
    Copy the full SHA
    a1ee7a1 View commit details
    Browse the repository at this point in the history

  3. correct docstrings and use only first result in list

    @timothydmorton
    timothydmorton committed May 1, 2018
    Configuration menu
    Copy the full SHA
    bf5ba42 View commit details
    Browse the repository at this point in the history