New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
YARN-11216. Avoid unnecessary reconstruction of ConfigurationProperties #4655
base: trunk
Are you sure you want to change the base?
Conversation
💔 -1 overall
This message was automatically generated. |
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
💔 -1 overall
This message was automatically generated. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for the change @K0K0V0K. The change generally seems good to me, though I have left some comments that need to be addressed before merging. One good rule of thumb is to avoid the Streaming API in simple cases like this.
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
🎊 +1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractLeafQueue.java
Outdated
Show resolved
Hide resolved
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
🎊 +1 overall
This message was automatically generated. |
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
🎊 +1 overall
This message was automatically generated. |
...pache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestConfigurationProperties.java
Show resolved
Hide resolved
...adoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @K0K0V0K for working on this. The latest revision LGTM.
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
Thanks for the changes @K0K0V0K, can you deal with the checkstyle issues please? |
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
Outdated
Show resolved
Hide resolved
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
Show resolved
Hide resolved
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
Show resolved
Hide resolved
...he/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...rg/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java
Outdated
Show resolved
Hide resolved
...adoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...adoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacitySchedulerConfiguration.java
Outdated
Show resolved
Hide resolved
...adoop/yarn/server/resourcemanager/scheduler/capacity/TestCapacitySchedulerConfiguration.java
Show resolved
Hide resolved
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
Hi @K0K0V0K |
💔 -1 overall
This message was automatically generated. |
- prefix filter in ConfigurationProperties
- add javadoc and test
- when AQC happens to a leaf queue, we should only set the default values if the template not contains it
- Fix memory leak. - Remove Optional as return type
- Code clean up
- fix import
- fix style
- CapacitySchedulerConfiguration#set should use the CapacitySchedulerConfiguration#get when set the value in the configurationProperties cause there is some logic in the super set
- Hack property change listener
- add test
- fix typo and names
…-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java Co-authored-by: Szilard Nemeth <954799+szilard-nemeth@users.noreply.github.com>
…-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/ConfigurationProperties.java Co-authored-by: Szilard Nemeth <954799+szilard-nemeth@users.noreply.github.com>
💔 -1 overall
This message was automatically generated. |
Description of PR
How was this patch tested?
For code changes:
LICENSE
,LICENSE-binary
,NOTICE-binary
files?