Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CSV Reader] Reorder of Columns for CSV Scans on multiple files. #12288

Merged
merged 43 commits into from
Jun 24, 2024
Merged

[CSV Reader] Reorder of Columns for CSV Scans on multiple files. #12288

merged 43 commits into from
Jun 24, 2024

Commits on Apr 19, 2024

  1. Basica of schema matching

    @pdet
    pdet committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    1195752 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Get build on this right

    @pdet
    pdet committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    0afca36 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. small tweaks

    @pdet
    pdet committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    180d3f0 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Adding SchemasMatch function

    @pdet
    pdet committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    4f01ede View commit details
    Browse the repository at this point in the history

  2. Improve error message

    @pdet
    pdet committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    9cc4666 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. wip

    @pdet
    pdet committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    ca030cf View commit details
    Browse the repository at this point in the history

  2. wip

    @pdet
    pdet committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    6f8ef9a View commit details
    Browse the repository at this point in the history

  3. Type matching

    @pdet
    pdet committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    1c82270 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. fixing test

    @pdet
    pdet committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    764fd60 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Merge remote-tracking branch 'origin/main' into auto_glob_matching

    @pdet
    pdet committed May 2, 2024
    Configuration menu
    Copy the full SHA
    28a3573 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. starting rework of type matching

    @pdet
    pdet committed May 3, 2024
    Configuration menu
    Copy the full SHA
    7123522 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. merge

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    ce48f19 View commit details
    Browse the repository at this point in the history

  2. use csv types

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    65743ce View commit details
    Browse the repository at this point in the history

  3. Only replace if the mapping is not defined in the multi scanner reader

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    55e55a6 View commit details
    Browse the repository at this point in the history

  4. Lots on making columns parameter more functional

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    fc949db View commit details
    Browse the repository at this point in the history

  5. Introduce columns_set variable to keep track if columns were set

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    f73e01d View commit details
    Browse the repository at this point in the history

  6. More on column being set

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    21de12e View commit details
    Browse the repository at this point in the history

  7. make sure to set columns in copy

    @pdet
    pdet committed May 17, 2024
    Configuration menu
    Copy the full SHA
    cc02caf View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. Merge remote-tracking branch 'origin/feature' into auto_glob_matching

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    e9eae48 View commit details
    Browse the repository at this point in the history

  2. Being more flexible with types'

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    b840f22 View commit details
    Browse the repository at this point in the history

  3. same is same

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    bafd948 View commit details
    Browse the repository at this point in the history

  4. properly skip multifile options

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    091aec7 View commit details
    Browse the repository at this point in the history

  5. this test now works

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    b0af185 View commit details
    Browse the repository at this point in the history

  6. Adjustments to header detection for set columns, mainly adding new er… 

    …ror messages and defaulting to true if it's all varchar
    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    c6daabc View commit details
    Browse the repository at this point in the history

  7. Accidental comment

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    3a68cfd View commit details
    Browse the repository at this point in the history

  8. add benchmarks

    @pdet
    pdet committed May 28, 2024
    Configuration menu
    Copy the full SHA
    e169d42 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge remote-tracking branch 'origin/feature' into auto_glob_matching

    @pdet
    pdet committed May 29, 2024
    Configuration menu
    Copy the full SHA
    616b299 View commit details
    Browse the repository at this point in the history

  2. format

    @pdet
    pdet committed May 29, 2024
    Configuration menu
    Copy the full SHA
    7643b25 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. test adjustment

    @pdet
    pdet committed May 31, 2024
    Configuration menu
    Copy the full SHA
    b9509c2 View commit details
    Browse the repository at this point in the history

  2. Have to do some cleanup of the relations since columns get serialized… 

    … now :-)
    @pdet
    pdet committed May 31, 2024
    Configuration menu
    Copy the full SHA
    de8a5f8 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/feature' into auto_glob_matching

    @pdet
    pdet committed May 31, 2024
    Configuration menu
    Copy the full SHA
    472de11 View commit details
    Browse the repository at this point in the history

  4. generated files

    @pdet
    pdet committed May 31, 2024
    Configuration menu
    Copy the full SHA
    bb6fafd View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge remote-tracking branch 'origin/feature' into auto_glob_matching

    @pdet
    pdet committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    89f7360 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Take csv benchmarks out of micro, so only a subset of them run on CI'

    @pdet
    pdet committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    62127b6 View commit details
    Browse the repository at this point in the history

  2. If files are just header and whatnot we go to next file

    @pdet
    pdet committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    228dff3 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. wip in trying to use multifilereader to get projections

    @pdet
    pdet committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    44e4b3f View commit details
    Browse the repository at this point in the history

  2. Magic

    @pdet
    pdet committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    557531a View commit details
    Browse the repository at this point in the history

  3. add more tests

    @pdet
    pdet committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    80c7b25 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. be more flexible with null handling when sniffing extra files

    @pdet
    pdet committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    104bf23 View commit details
    Browse the repository at this point in the history

  2. Add glob reorder test

    @pdet
    pdet committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    f0944f3 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. format

    @pdet
    pdet committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    630c37d View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. merge

    @pdet
    pdet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    60cfe17 View commit details
    Browse the repository at this point in the history

  2. More on the merge

    @pdet
    pdet committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    7b15182 View commit details
    Browse the repository at this point in the history