Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP][SPARK-2883][SQL]initial support ORC in spark sql #2576

Closed
wants to merge 45 commits into from
Closed

[WIP][SPARK-2883][SQL]initial support ORC in spark sql #2576

wants to merge 45 commits into from

Commits on Sep 29, 2014

  1. initial support orc in spark sql

    @scwf
    scwf committed Sep 29, 2014
    Configuration menu
    Copy the full SHA
    fb14a06 View commit details
    Browse the repository at this point in the history

  2. add unit tests

    @scwf
    scwf committed Sep 29, 2014
    Configuration menu
    Copy the full SHA
    ec3cdaf View commit details
    Browse the repository at this point in the history

  3. add orc to example of spark sql

    @scwf
    scwf committed Sep 29, 2014
    Configuration menu
    Copy the full SHA
    7126290 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2014

  1. merge with apache/master and fix conflict

    @scwf
    scwf committed Oct 4, 2014
    Configuration menu
    Copy the full SHA
    655b23f View commit details
    Browse the repository at this point in the history

  2. fix according comments and move orc to hive sub project

    @scwf
    scwf committed Oct 4, 2014
    Configuration menu
    Copy the full SHA
    1505af4 View commit details
    Browse the repository at this point in the history

  3. fix scala style

    @scwf
    scwf committed Oct 4, 2014
    Configuration menu
    Copy the full SHA
    1db30b1 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2014

  1. address comments_1

    @scwf
    scwf committed Oct 14, 2014
    Configuration menu
    Copy the full SHA
    9529d68 View commit details
    Browse the repository at this point in the history

  2. update with apache/spark master and fix conflicts

    @scwf
    scwf committed Oct 14, 2014
    Configuration menu
    Copy the full SHA
    25416c3 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2014

  1. log.info -> logInfo

    @scwf
    scwf committed Oct 15, 2014
    Configuration menu
    Copy the full SHA
    89421ef View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2014

  1. address comments

    @scwf
    scwf committed Oct 16, 2014
    Configuration menu
    Copy the full SHA
    40f9d68 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/apache/spark into orc

    @scwf
    scwf committed Oct 16, 2014
    Configuration menu
    Copy the full SHA
    b2b5455 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2014

  1. reuse TableReader

    @scwf
    scwf committed Oct 17, 2014
    Configuration menu
    Copy the full SHA
    349bb92 View commit details
    Browse the repository at this point in the history

  2. fix InsertIntoOrcTable

    @scwf
    scwf committed Oct 17, 2014
    Configuration menu
    Copy the full SHA
    65483e8 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2014

  1. address comments

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    629f95e View commit details
    Browse the repository at this point in the history

  2. added test for read orc schema

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    d1bba23 View commit details
    Browse the repository at this point in the history

  3. add test files

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    b46ecb1 View commit details
    Browse the repository at this point in the history

  4. scala style fixed

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    f68bea0 View commit details
    Browse the repository at this point in the history

  5. revert no related changes

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    b06e335 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'test' into orc

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    7bdc503 View commit details
    Browse the repository at this point in the history

  7. more tests

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    4d0950b View commit details
    Browse the repository at this point in the history

  8. tests suite fix

    @scwf
    scwf committed Oct 18, 2014
    Configuration menu
    Copy the full SHA
    37a2192 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2014

  1. minor fix

    @scwf
    scwf committed Oct 19, 2014
    Configuration menu
    Copy the full SHA
    4e1c839 View commit details
    Browse the repository at this point in the history

  2. add test case for reading/righting empty RDD

    @scwf
    scwf committed Oct 19, 2014
    Configuration menu
    Copy the full SHA
    b8495d5 View commit details
    Browse the repository at this point in the history

  3. no use method

    @scwf
    scwf committed Oct 19, 2014
    Configuration menu
    Copy the full SHA
    f680da0 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2014

  1. make wrap consistent with InsertIntoHiveTable.wrapperFor

    @zhzhan
    zhzhan committed Oct 22, 2014
    Configuration menu
    Copy the full SHA
    269b15f View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2014

  1. Merge pull request #4 from zhzhan/orc1 

    make wrap consistent with InsertIntoHiveTable.wrapperFor
    @scwf
    scwf committed Oct 23, 2014
    Configuration menu
    Copy the full SHA
    d06fe5b View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2014

  1. First draft.

    @marmbrus
    marmbrus committed Nov 14, 2014
    Configuration menu
    Copy the full SHA
    9bd3c85 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2014

  1. https -> http in pom

    @scwf
    scwf committed Nov 17, 2014
    Configuration menu
    Copy the full SHA
    5f5fda8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'mvn' into parquet

    @scwf
    scwf committed Nov 17, 2014
    Configuration menu
    Copy the full SHA
    2421f24 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2014

  1. logging / formatting improvements.

    @marmbrus
    marmbrus committed Nov 18, 2014
    Configuration menu
    Copy the full SHA
    5d7f863 View commit details
    Browse the repository at this point in the history

  2. Add an experimental interface to data sources that exposes catalyst e… 

    …xpressions.
    @marmbrus
    marmbrus committed Nov 18, 2014
    Configuration menu
    Copy the full SHA
    94e0d40 View commit details
    Browse the repository at this point in the history

  3. Alternative implementation of parquet based on the datasources API.

    @marmbrus
    marmbrus committed Nov 18, 2014
    Configuration menu
    Copy the full SHA
    dd78aa7 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2014

  1. Merge branch 'newParquet' of https://github.com/marmbrus/spark into p… 

    …arquet
    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    244ab59 View commit details
    Browse the repository at this point in the history

  2. wf comment

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    a37f6a8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/apache/spark into mvn

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    1d6856e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'parquet' into newOrc

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    b8e6f84 View commit details
    Browse the repository at this point in the history

  5. draft for datasource api

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    e521e6a View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into newOrc

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    9ba04ac View commit details
    Browse the repository at this point in the history

  7. test case

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    c90ed2f View commit details
    Browse the repository at this point in the history

  8. fix test

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    b6ae12b View commit details
    Browse the repository at this point in the history

  9. no used bin file

    @scwf
    scwf committed Nov 20, 2014
    Configuration menu
    Copy the full SHA
    3ca68eb View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2014

  1. update with apache master

    @scwf
    scwf committed Nov 22, 2014
    Configuration menu
    Copy the full SHA
    abf1b78 View commit details
    Browse the repository at this point in the history

  2. Revert "https -> http in pom" 

    This reverts commit 5f5fda8.
    @scwf
    scwf committed Nov 22, 2014
    Configuration menu
    Copy the full SHA
    1e0c1d9 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2014

  1. ppd support

    @zhzhan
    zhzhan committed Dec 1, 2014
    Configuration menu
    Copy the full SHA
    c5236ef View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2014

  1. Merge pull request #13 from zhzhan/orc1 

    predictor pushdown support
    @scwf
    scwf committed Dec 2, 2014
    Configuration menu
    Copy the full SHA
    601d242 View commit details
    Browse the repository at this point in the history