Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DCOS-58437] Deploy workloads under role-enforced group. #550

Open
wants to merge 37 commits into
base: master
Choose a base branch
from

Conversation

mpereira
Copy link
Contributor

@mpereira mpereira commented Oct 7, 2019

What changes were proposed in this pull request?

Resolves DCOS-58437

How were these changes tested?

They will be tested in this week's Dry-Run MWT #21.

@mpereira mpereira changed the title [DCOS-58437] Add required roles and permissions required for group role enforcement. [DCOS-58437] Deploy workloads under role-enforced group. Oct 7, 2019
@mpereira mpereira force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 1d8575d to 510676e Compare October 7, 2019 18:59
Copy link
Contributor

@samvantran samvantran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking care of this @mpereira!

scale-tests/batch_test.py Outdated Show resolved Hide resolved
scale-tests/deploy-dispatchers.py Show resolved Hide resolved
scale-tests/kafka_cassandra_streaming_test.py Show resolved Hide resolved
scale-tests/run.sh Show resolved Hide resolved
scale-tests/scale_tests_utils.py Show resolved Hide resolved
spark-testing/spark_utils.py Outdated Show resolved Hide resolved
@mpereira mpereira force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 955ff8d to f4a0d7d Compare October 10, 2019 13:11
@mpereira mpereira force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 33907e2 to d7235ac Compare October 10, 2019 17:36
@mpereira
Copy link
Contributor Author

@samvantran there were a bunch of additional changes/improvements required for a smooth test today, please take a look at commits after your last review if you get a chance.

Copy link
Contributor

@samvantran samvantran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mpereira - new changes look good.

scale-tests/deploy_dsengine.sh Outdated Show resolved Hide resolved
scale-tests/deploy_dsengine.sh Show resolved Hide resolved
@alexeygorobets alexeygorobets force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 440cd25 to 9f4b3cb Compare October 11, 2019 10:42
@mpereira
Copy link
Contributor Author

This PR changed sdk_security.py in a way that might be causing some tests to fail: TC builds

Need to take a look into that...

@samvantran
Copy link
Contributor

Looking at the 6 tests that fail towards the end of the CI run, it appears that hdfs does not deploy successfully (or at all: 10 expected tasks and not even 1 task up). Like you said, could be related to security/service-account changes.

@@ -31,6 +31,7 @@
--quota-executors-gpus <n> number of GPUs to use for executors quota [default: 0]
--quota-executors-mem <n> amount of memory (mb) to use per executors quota [default: 1524.0]
--role <role> Mesos role registered by dispatcher [default: *]
--group-role <group-role> TODO: description [default: None]
Copy link
Contributor

@alexeygorobets alexeygorobets Dec 3, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should provide a description here
root-level group to apply quotas against (e.g. '/dev') [default: None] ?

@rishabh96b rishabh96b force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 38bbbd2 to 275da0f Compare April 15, 2020 11:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants