Skip to content

Conversation

tmgstevens
Copy link
Contributor

Adding the ability to specify custom role config groups by using the syntax ROLETYPE/CUSTOMROLENAME as follows:

   IMPALAD:
     scratch_dirs: /tmp/impala
   IMPALAD/COORDINATOR:
     impalad_specialization: COORDINATOR_ONLY
   IMPALAD/EXECUTOR:
     impalad_specialization: EXECUTOR_ONLY

Includes logic to fold in any default values from the config overlays (TLS, Kerberos, etc) and to inherit any base configs specified (for example scratch_dirs above).

Tested on a cluster with and without custom rcgs.

Dave Beech and others added 3 commits July 15, 2021 10:51
support for specialised role config groups

Signed-off-by: Tristan Stevens <tristan@cloudera.com>
Signed-off-by: Tristan Stevens <tristan@cloudera.com>
Signed-off-by: Tristan Stevens <tristan@cloudera.com>
@tmgstevens tmgstevens requested a review from Chaffelson August 5, 2021 11:30
@WillDyson
Copy link
Contributor

LGTM. We will need to make a few additional changes for teardown to work with custom role groups, but it will continue to work for non-custom role groups. As this devel, I'm happy for this to be merged.

@Chaffelson Chaffelson merged commit f029e02 into cloudera-labs:devel Sep 16, 2021
tmgstevens added a commit that referenced this pull request Nov 10, 2021
#30)

* @dbeech support for specialised role config groups
* Allow for role group inheriting of base and merged properties
* Allow for role group inheriting of base and merged properties

Signed-off-by: Tristan Stevens <tristan@cloudera.com>

Co-authored-by: Dave Beech <dbeech@cloudera.com>
tmgstevens added a commit that referenced this pull request Nov 24, 2021
#30)

* @dbeech support for specialised role config groups
* Allow for role group inheriting of base and merged properties
* Allow for role group inheriting of base and merged properties

Signed-off-by: Tristan Stevens <tristan@cloudera.com>

Co-authored-by: Dave Beech <dbeech@cloudera.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants