Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AMORO-2276]: UnifiiedCatalog for Spark Engine #2269

Merged
merged 36 commits into from
Dec 12, 2023
Merged

[AMORO-2276]: UnifiiedCatalog for Spark Engine #2269

merged 36 commits into from
Dec 12, 2023

Commits on Nov 7, 2023

  1. Squash Merged from branch:external-unified-catalog

    @baiyangtx
    baiyangtx committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    9136dc7 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. Merge branch 'master' into spark-unified-catalog 

    # Conflicts:
#	ams/server/src/test/java/com/netease/arctic/server/AmsEnvironment.java
#	core/src/main/java/com/netease/arctic/formats/iceberg/IcebergCatalog.java
#	core/src/main/java/com/netease/arctic/formats/mixed/MixedCatalog.java
#	core/src/main/java/com/netease/arctic/utils/ArcticTableUtil.java
#	core/src/test/java/com/netease/arctic/catalog/CatalogTestBase.java
#	core/src/test/java/com/netease/arctic/catalog/TableTestBase.java
    @baiyangtx
    baiyangtx committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    9669d64 View commit details
    Browse the repository at this point in the history

  2. spark catalog

    @baiyangtx
    baiyangtx committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    138e907 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Merge branch 'master' into spark-unified-catalog

    @baiyangtx
    baiyangtx committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    59a6395 View commit details
    Browse the repository at this point in the history

  2. spark test base refactor to adapt UnifiedCatalog test and mixed catal… 

    …og test.
    @baiyangtx
    baiyangtx committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    1565323 View commit details
    Browse the repository at this point in the history

  3. run tests/ some passed

    @baiyangtx
    baiyangtx committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    65ed1d6 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. fix unit tests in truncate sql.

    @baiyangtx
    baiyangtx committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    acd8bea View commit details
    Browse the repository at this point in the history

  2. unified catalog refactors

    @baiyangtx
    baiyangtx committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    7e174dc View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. support mixed-iceberg

    @baiyangtx
    baiyangtx committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    99fdddf View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. paimon catalog loaded.

    @baiyangtx
    baiyangtx committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    a90a403 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. support unified catalog in spark

    @baiyangtx
    baiyangtx committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    5984e0d View commit details
    Browse the repository at this point in the history

  2. refactor mixed spark catalog. extract common base.

    @baiyangtx
    baiyangtx committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    b49a85c View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. UnifiedCatalog test.

    @baiyangtx
    baiyangtx committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    6f49f01 View commit details
    Browse the repository at this point in the history

  2. remove useless codes

    @baiyangtx
    baiyangtx committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    84f3c03 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into spark-unified-catalog 

    # Conflicts:
#	spark/common/src/test/java/com/netease/arctic/spark/test/SparkTableTestBase.java
    @baiyangtx
    baiyangtx committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    36a5651 View commit details
    Browse the repository at this point in the history

  4. merge from master

    @baiyangtx
    baiyangtx committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    5114a3b View commit details
    Browse the repository at this point in the history

  5. fix unit test cases.

    @baiyangtx
    baiyangtx committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    7ae8088 View commit details
    Browse the repository at this point in the history

  6. fix complie error

    @baiyangtx
    baiyangtx committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    9d0974e View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. fix unit tests

    @baiyangtx
    baiyangtx committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    0b120db View commit details
    Browse the repository at this point in the history

  2. unified catalog and test from spark engine.

    @baiyangtx
    baiyangtx committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    5af7f23 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into spark-unified-catalog

    @baiyangtx
    baiyangtx committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    0002e38 View commit details
    Browse the repository at this point in the history

  4. unified session catalog and test case

    @baiyangtx
    baiyangtx committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    190af26 View commit details
    Browse the repository at this point in the history

  5. support sub table for unified session catalog.

    @baiyangtx
    baiyangtx committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    80e103b View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. spotless:apply

    @baiyangtx
    baiyangtx committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    1d0bfad View commit details
    Browse the repository at this point in the history

  2. remove useless annotation

    @baiyangtx
    baiyangtx committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    17c731b View commit details
    Browse the repository at this point in the history

  3. support paimon in session catalog

    @baiyangtx
    baiyangtx committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    04fb603 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into spark-unified-catalog

    @baiyangtx
    baiyangtx authored Nov 30, 2023
    Configuration menu
    Copy the full SHA
    bf40a59 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. merged from master && mixed module.

    @baiyangtx
    baiyangtx committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    c07bdef View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into spark-unified-catalog

    @baiyangtx
    baiyangtx authored Dec 1, 2023
    Configuration menu
    Copy the full SHA
    d83e778 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. fix code reviewer comments.

    @baiyangtx
    baiyangtx committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    919a7a1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into spark-unified-catalog

    @baiyangtx
    baiyangtx authored Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2fffedb View commit details
    Browse the repository at this point in the history

  3. add catalog() to TableIdWithFormat

    @baiyangtx
    baiyangtx committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    05f0465 View commit details
    Browse the repository at this point in the history

  4. Add docs to class

    @baiyangtx
    baiyangtx committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    4d24cad View commit details
    Browse the repository at this point in the history

  5. spotless

    @baiyangtx
    baiyangtx committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    dd6fc3b View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. fix review comments

    @baiyangtx
    baiyangtx committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    153cbeb View commit details
    Browse the repository at this point in the history

  2. fix review comments

    @baiyangtx
    baiyangtx committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    2f18c81 View commit details
    Browse the repository at this point in the history