[Improvement] [mr] Ensure configurations in both mapred-site.xml and dynamic_client.conf take effect. #1051
Closed
3 tasks done
Labels
0.8
For 0.8 version release
Code of Conduct
Search before asking
What would you like to be improved?
If dynamic conf is not enabled, though
mapreduce.rss.storage.type
is configued at mapred-site.xml, running MR job within RSS still fails, with this error messageError: java.lang.IllegalArgumentException: No enum constant org.apache.uniffle.storage.util.StorageType.
The reason is only
rssJobConf
is used to newCreateShuffleReadClientRequest
incubator-uniffle/client-mr/core/src/main/java/org/apache/hadoop/mapreduce/task/reduce/RssShuffle.java
Line 243 in 57c35ad
This issue will optimize how configuration works. Configuration in both dynamic conf and local conf file should work.
How should we improve?
No response
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: