merge from newest master #1
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
bump fastjson to 1.2.83 Co-authored-by: wangtaohz <103108928+wangtaohz@users.noreply.github.com>
* Support Http interface for Tags and Branches * fix * spotless * fixed * fix --------- Co-authored-by: huyuanfeng <huyuanfeng@huya.com> Co-authored-by: wangtaohz <103108928+wangtaohz@users.noreply.github.com>
…#2229) FileNameRules adapt to hidden filename.
…ble (apache#2228) * set change metrics for KeyedTable * remove useless code * spotless:apply
… partition directory. (apache#2224) * Cast empty partition data to NULL to avoid creating empty partition directory * fix some warnings * add some todo comment
…er.duplicate-ratio` to 0.1 (apache#2230) * Change the default value of self-optimizing.major.trigger.duplicate-ratio to 0.1 * fix style error * fix style error * fix compile errors * fix compile errors
* fix: support comments in terminal * style: clean code * style: clean code * front: support comment style * revert: rollback code of front end --------- Co-authored-by: chenyuzhi <chenyuzhi@corp.netease.com> Co-authored-by: wangtaohz <103108928+wangtaohz@users.noreply.github.com>
* Add paimon storage doc * Modify download s3 and oss address
…#2233) * Update Code formating description * Update CONTRIBUTING.md Co-authored-by: Xianxun Ye <yesorno828423@gmail.com> * Apply suggestions from code review Co-authored-by: HuangFru <68625618+HuangFru@users.noreply.github.com> --------- Co-authored-by: Xianxun Ye <yesorno828423@gmail.com> Co-authored-by: HuangFru <68625618+HuangFru@users.noreply.github.com>
change hive images
Co-authored-by: ZhouJinsong <zhoujinsong0505@163.com>
Fixed a counting error
…e skipped partitions (apache#2249)
…running optimizing process (apache#2252) * [AMORO-2250][AMS] After disabed self-optimizing, change the status of the table to IDLE * fix
… tasks (apache#2236) * [AMORO-2117] Support Http interface for getting details of optimizing tasks * [AMORO-2117] rename * [AMORO-2117] Fix comment * [AMORO-2117] Fix comment
…Sequence` from snapshot level (apache#1834) * upgrade iceberg to 1.3.0 * fix flink * fix flink * remove useless * change version from 0.5.0-SNAPSHOT to 0.5.1-SNAPSHOT * update iceberg version 1.3.x in Flink 1.12 module * update iceberg version 1.3.x in Flink 1.12 module * ArcticUpdate support toBranch * fix ci error * update iceberg version 1.3.x in Flink 1.14 module * update iceberg version 1.3.x in Flink 1.15 module * calculate available core * change max input size per thread from 5GB to 500MB * add PuffinUtil and unit test * remove legacyPartitionMaxTransactionId before 0.4.1 * store optimized sequence to puffin * support overwrite puffin when retry * add table property table.version * fix unit test * fix unit test for hive * change version from 0.5.1-SNAPSHOT to 0.5.0-SNAPSHOT * change version from 0.5.0-SNAPSHOT to 0.5.1-SNAPSHOT * no need to get optimized sequence from KeyedTableSnapshot * change version back to 0.5.0-SNAPSHOT * fix get null sequence * fix sequence number = -1 * fix optimizing integration test for hive * create puffin for each snapshot * for compatibility, if puffin not exist, using table properties * remove useless table version * add readWithCompatibility * add some comments for PuffinUtil * expire statistics files * fix check style * fix compile error * remove useless deprecate * fix unit test * refactor PuffinUtil * fix compile error in ams server * spotless:apply core * fix unit test * support generic type for PartitionDataSerializer * rename PuffinUtil to StatisticsFileUtil * rename method to readFromStatisticsFile * spotless: apply * 1.fix comment 2.add writerBuilder for StatisticsFileUtil.Writer 3.store puffin files in the location of data/puffin/ 4.search snapshot based on a mark in snapsnot summary * fix snapshot expring unit test error --------- Co-authored-by: lklhdu <lekeleihz@163.com> Co-authored-by: ZhouJinsong <zhoujinsong0505@163.com>
…ache#2232) * Using unified catalog for server external catalog. * fix hard code texts. * spotless:apply * add deprecated of ArcticCatalog initialize * remove useless initialize * remove useless code. * remove catalog.refresh() * spotless:apply * fix unit tests. * catalog impl to private * build catalog to private * remove IcebergCatalogWrapper.java * spotless:apply * remove useless comments. * remove useless code. * spotless:apply * fix unit tests in core * fix unit tests. * apply spotless
* [DOC] Add a supported table format * [DOC] Unified description of each table format --------- Co-authored-by: rqyin <rqyin@easipass.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Why are the changes needed?
Close #xxx.
Brief change log
How was this patch tested?
Add some test cases that check the changes thoroughly including negative and positive cases if possible
Add screenshots for manual tests if appropriate
Run test locally before making a pull request
Documentation