Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MWT-27 #581

Open
wants to merge 67 commits into
base: master
Choose a base branch
from
Open

MWT-27 #581

wants to merge 67 commits into from

Conversation

rishabh96b
Copy link
Contributor

Changes for upcoming MWT-27

mpereira and others added 30 commits April 15, 2020 16:50
@mpereira @rishabh96b
Add visual separations for the script's sections.
ef3c10d
@mpereira @rishabh96b
Make container name be dependent on test parameter file name.
70579ca
@mpereira @rishabh96b
Check package repos every time, create Marathon group.
9564118
@mpereira @rishabh96b
Use container name for docker image tag and run directory.
287a9b9
@mpereira @rishabh96b
Automatically format some files with Black.
04717bd
@mpereira @rishabh96b
Parameterize group file name, run commands in container.
9fbca5b
@mpereira @rishabh96b
Run commands in the container.
0e856a2
@mpereira @rishabh96b
Quote this.
d9a7e96
@mpereira @rishabh96b
Make deploy-dispatchers.py script support group roles.
585beac
@mpereira @rishabh96b
Show CLUSTER_URL in pre-run report.
c4d870f
@mpereira @rishabh96b
Add group_role support to streaming workload deploy script.
cd95b27
@mpereira @rishabh96b
Make sure service name is prefixed with a slash.
5c1c912
@mpereira @rishabh96b
Add group_role support to the batch_test.py script.
f40351a
@mpereira @rishabh96b
Add required roles and permissions required for group role enforcement.
0b25ba5
@mpereira @rishabh96b
Add spark-options.json file.
0a2f2d1
@mpereira @samvantran @rishabh96b
Typo.
2bd9407 
Co-Authored-By: Sam Tran <stran@mesosphere.com>
@mpereira @samvantran @rishabh96b
Add CLI parameter description.
73b5824 
Co-Authored-By: Sam Tran <stran@mesosphere.com>
@mpereira @rishabh96b
Remove failing jobs stuff.
bf0fcf0
@mpereira @rishabh96b
Fix shellcheck warning.
0025ef4
@mpereira @rishabh96b
Variable renames, shellcheck fixes, DSEngine, total cpu/mem/gpu.
50b56ef
@mpereira @rishabh96b
GROUP_NAME should be coming with no slash prefix.
b849f5d
@mpereira @rishabh96b
Create quota if it doesn't exit.
2f1075b
@mpereira @rishabh96b
Install recent DC/OS CLI.
222cbe2
@mpereira @rishabh96b
Fix quoting.
464a17b
@mpereira @rishabh96b
Should be group name here.
af9129e
@mpereira @rishabh96b
Make revoke_permissions() also take role list.
c2daf5e
@mpereira @rishabh96b
Fix indentation.
65b3fd9
@mpereira @rishabh96b
Make DC/OS CLI binary a parameter.
bec6c9f
@mpereira @rishabh96b
Don't break out of loop, just skip to the next element.
5b34f05
@mpereira @rishabh96b
This was breaking.
3cd62ec
alexeygorobets and others added 19 commits September 14, 2020 17:04
@alexeygorobets
update Cassandra to 2.10.0-3.11.6-beta
ba74e60
@alexeygorobets
add external volumes to cassandra options
05743fa
@rishabh96b
use latest spark 2.11.0-2.4.6
610e6a3
@rishabh96b
update spark stub to universe-converter
6888ecc
@alexeygorobets
Merge branch 'dcos-58437-deploy-workloads-under-role-enforced-group' …
3a4b36e 
…into mwt-26

# Conflicts:
#	spark-testing/spark_utils.py
#	testing/sdk_install.py
@farhan5900
Adds data science engine configs
6ffb082
@alexeygorobets
update configs for dry run
288b97a
@alexeygorobets
use root user for services
853dbe5
@alexeygorobets
Merge remote-tracking branch 'origin/mwt-26' into mwt-26
f087a33 
# Conflicts:
#	scale-tests/configs/dsengine-options.json
#	scale-tests/run.sh
@kaiwalyajoshi
Grant task:user:root permissions on master and agent for DSE.
c8e8fdc
@alexeygorobets
install DSE with other services
7d85cbb
@alexeygorobets
update dsengine options
8b71331
@alexeygorobets
Merge branch 'mwt-26' of https://github.com/mesosphere/spark-build in…
a8c6e56 
…to mwt-26
@alexeygorobets
fix DSE permissions
083ebb9
@alexeygorobets
add MWT 26 config
2750a25
@alexeygorobets
not using GPU in DSE
6032efa
@alexeygorobets
fix marathon check for batched job
aaace06
@alexeygorobets
use right branch in batched workload for spark
d34af99
@rishabh96b
add configs for mwt-27
20d3f85
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@kaiwalyajoshi kaiwalyajoshi kaiwalyajoshi approved these changes

@farhan5900 farhan5900 Awaiting requested review from farhan5900

@alexeygorobets alexeygorobets Awaiting requested review from alexeygorobets

Assignees
No one assigned
Labels
MWT-27
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
5 participants
@rishabh96b @kaiwalyajoshi @mpereira @alexeygorobets @farhan5900