Code of Conduct
Search before asking
What would you like to be improved?
Currently, users need to set the parameter tez.am.launch.launch.cmd-opts to switch between local shuffle and remote shuffle, but this parameter is difficult for users to understand.
We need a simpler and easier to understand parameter,such as tez.shuffle.mode = local/remote
How should we improve?
- set tez.am.launch.launch.cmd-opts=-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA -XX:+UseParallelGC org.apache.tez.dag.app.RssDAGAppMaster。 【 note: this config will not change 】
- add new conf tez.shuffle.mode which will used in RssDAGAppMaster. when this conf equal local, RssDAGAppMaster will use all DAGAppMaster functions
Are you willing to submit PR?
Code of Conduct
Search before asking
What would you like to be improved?
Currently, users need to set the parameter tez.am.launch.launch.cmd-opts to switch between local shuffle and remote shuffle, but this parameter is difficult for users to understand.
We need a simpler and easier to understand parameter,such as tez.shuffle.mode = local/remote
How should we improve?
Are you willing to submit PR?