Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[IMPROVEMENT] Introduce the enumType in ConfigOptions #199

Merged
merged 3 commits into from Sep 5, 2022

Conversation

zuston
Copy link
Member

@zuston zuston commented Sep 5, 2022

What changes were proposed in this pull request?

Introduce the enumType in ConfigOptions

Why are the changes needed?

When I want to extend the zstd compression type in uniffle, I found we lack the enum class for configOptions.
And I think it will be used for users to specify the concrete implementation in some pluggable class.

Does this PR introduce any user-facing change?

No

How was this patch tested?

UTs.

@codecov-commenter
Copy link

codecov-commenter commented Sep 5, 2022

Codecov Report

Merging #199 (b50fbc2) into master (331ebb2) will decrease coverage by 1.20%.
The diff coverage is 86.36%.

@@             Coverage Diff              @@
##             master     #199      +/-   ##
============================================
- Coverage     58.41%   57.21%   -1.21%     
+ Complexity     1273     1199      -74     
============================================
  Files           158      149       -9     
  Lines          8448     7965     -483     
  Branches        784      754      -30     
============================================
- Hits           4935     4557     -378     
+ Misses         3260     3166      -94     
+ Partials        253      242      -11     
Impacted Files Coverage Δ
...uniffle/coordinator/AssignmentStrategyFactory.java 69.23% <50.00%> (ø)
.../org/apache/uniffle/common/config/ConfigUtils.java 34.44% <92.85%> (+12.07%) ⬆️
...rg/apache/uniffle/common/config/ConfigOptions.java 96.61% <100.00%> (+5.23%) ⬆️
...rg/apache/uniffle/coordinator/CoordinatorConf.java 96.39% <100.00%> (ø)
...storage/handler/impl/DataSkippableReadHandler.java 81.25% <0.00%> (-3.13%) ⬇️
.../java/org/apache/spark/shuffle/RssSparkConfig.java
...org/apache/spark/shuffle/RssSparkShuffleUtils.java
...k/shuffle/writer/WrappedByteArrayOutputStream.java
...e/spark/shuffle/reader/RssShuffleDataIterator.java
...ava/org/apache/spark/shuffle/RssShuffleHandle.java
... and 6 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@zuston zuston requested a review from jerqi September 5, 2022 08:36
@jerqi
Copy link
Contributor

jerqi commented Sep 5, 2022

cc @smallzhongfeng , the pr is useful for your pr #192.

@smallzhongfeng
Copy link
Contributor

cc @smallzhongfeng , the pr is useful for your pr #192.

Good job, this is helpful for my pr. After you review this PR, I will repair my current pr.

Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @zuston

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants