Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor and nested types support for Parquet Reader #1314

Merged
merged 43 commits into from
Jan 24, 2021
Merged

Refactor and nested types support for Parquet Reader #1314

merged 43 commits into from
Jan 24, 2021

Commits on Dec 7, 2020

  1. move

    @hannes
    hannes committed Dec 7, 2020
    Configuration menu
    Copy the full SHA
    29031a3 View commit details
    Browse the repository at this point in the history

  2. moar intermediate

    @hannes
    hannes committed Dec 7, 2020
    Configuration menu
    Copy the full SHA
    a70e292 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2020

  1. merge

    @hannes
    hannes committed Dec 10, 2020
    Configuration menu
    Copy the full SHA
    7838f23 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2020

  1. moving

    @hannes
    hannes committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    7eff95e View commit details
    Browse the repository at this point in the history

Commits on Dec 17, 2020

  1. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Dec 17, 2020
    Configuration menu
    Copy the full SHA
    7ddb3fa View commit details
    Browse the repository at this point in the history

  2. got a bit further

    @hannes
    hannes committed Dec 17, 2020
    Configuration menu
    Copy the full SHA
    12a4b6e View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2020

  1. zero copy for strings work

    @hannes
    hannes committed Dec 18, 2020
    Configuration menu
    Copy the full SHA
    6e53cd5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Dec 18, 2020
    Configuration menu
    Copy the full SHA
    7d3395f View commit details
    Browse the repository at this point in the history

  3. some cleanup

    @hannes
    hannes committed Dec 18, 2020
    Configuration menu
    Copy the full SHA
    f27ec32 View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2020

  1. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Dec 28, 2020
    Configuration menu
    Copy the full SHA
    bb843ec View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2020

  1. mc

    @hannes
    hannes committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    9bf2cfa View commit details
    Browse the repository at this point in the history

  2. gah

    @hannes
    hannes committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    5bea364 View commit details
    Browse the repository at this point in the history

  3. handle most scan cases, still todo: broken_arrow

    @hannes
    hannes committed Dec 29, 2020
    Configuration menu
    Copy the full SHA
    5276f75 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2020

  1. broken arrow

    @hannes
    hannes committed Dec 30, 2020
    Configuration menu
    Copy the full SHA
    ae3bb6d View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2020

  1. first stabs at lists

    @hannes
    hannes committed Dec 31, 2020
    Configuration menu
    Copy the full SHA
    a5b7577 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2021

  1. mc

    @hannes
    hannes committed Jan 4, 2021
    Configuration menu
    Copy the full SHA
    ae2f34c View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2021

  1. baseline again

    @hannes
    hannes committed Jan 7, 2021
    Configuration menu
    Copy the full SHA
    9c8e758 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2021

  1. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    74e7426 View commit details
    Browse the repository at this point in the history

  2. storing this

    @hannes
    hannes committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    71c11c1 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2021

  1. moar refactor

    @hannes
    hannes committed Jan 11, 2021
    Configuration menu
    Copy the full SHA
    5ce7805 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2021

  1. more refactor, now creating reader tree

    @hannes
    hannes committed Jan 13, 2021
    Configuration menu
    Copy the full SHA
    0c409d7 View commit details
    Browse the repository at this point in the history

Commits on Jan 14, 2021

  1. refactor to pull def & rep through

    @hannes
    hannes committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    8a3570d View commit details
    Browse the repository at this point in the history

  2. first struct list read works ^^

    @hannes
    hannes committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    0514023 View commit details
    Browse the repository at this point in the history

  3. something actually working

    @hannes
    hannes committed Jan 14, 2021
    Configuration menu
    Copy the full SHA
    ada82f0 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2021

  1. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    41a8d7b View commit details
    Browse the repository at this point in the history

  2. nested lists work (a bit)

    @hannes
    hannes committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    82df4f0 View commit details
    Browse the repository at this point in the history

  3. handling overflow in list read

    @hannes
    hannes committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    2b2a277 View commit details
    Browse the repository at this point in the history

  4. actual serious test case and @apkwan

    @hannes
    hannes committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    0f2238b View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2021

  1. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Jan 16, 2021
    Configuration menu
    Copy the full SHA
    0d5b227 View commit details
    Browse the repository at this point in the history

  2. cleanup

    @hannes
    hannes committed Jan 16, 2021
    Configuration menu
    Copy the full SHA
    df710f0 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2021

  1. fixed filter bug

    @hannes
    hannes committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    09c3125 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2021

  1. Merge branch 'master' of github.com:cwida/duckdb into parquetrefactor

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    d7d636a View commit details
    Browse the repository at this point in the history

  2. getting there

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    707fb9c View commit details
    Browse the repository at this point in the history

  3. stats still ugly but functional again

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    be7eda6 View commit details
    Browse the repository at this point in the history

  4. making gcc happier

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    dba49c2 View commit details
    Browse the repository at this point in the history

  5. templating fun

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    16bee9e View commit details
    Browse the repository at this point in the history

  6. more signs

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    3876514 View commit details
    Browse the repository at this point in the history

  7. adding new file for parquet reader

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    7a9f5b5 View commit details
    Browse the repository at this point in the history

  8. everybody gets a file

    @hannes
    hannes committed Jan 21, 2021
    Configuration menu
    Copy the full SHA
    04bd6a4 View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2021

  1. templating scalar conversions

    @hannes
    hannes committed Jan 22, 2021
    Configuration menu
    Copy the full SHA
    710fd33 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2021

  1. turns out Type() was copying the type. Performance now okay.

    @hannes
    hannes committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    67d64c8 View commit details
    Browse the repository at this point in the history

  2. fix for duckdb#1291

    @hannes
    hannes committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    f43604e View commit details
    Browse the repository at this point in the history

  3. reading more correct now yay

    @hannes
    hannes committed Jan 24, 2021
    Configuration menu
    Copy the full SHA
    704cc4d View commit details
    Browse the repository at this point in the history