Skip to content

Score with disk resources.#1657

Merged
baconmania merged 88 commits into
report-disk-usagefrom
score-with-disk-resources
Dec 8, 2017
Merged

Score with disk resources.#1657
baconmania merged 88 commits into
report-disk-usagefrom
score-with-disk-resources

Conversation

@baconmania
Copy link
Copy Markdown
Contributor

This PR rolls disk usage into Singularity's offer scoring calcs.

It also changes the default relative offer weights to 0.25 cpu; 0.65 mem; 0.10 disk based on the fact that typical apps which Singularity is intended to host are stateless, primarily I/O bound, then CPU bound, with minimal, bounded disk usage.

Still need to update tests to exercise disk resources in tests of SingularityMesosOfferScheduler#score().

/cc @ssalinas

private double longRunningUsedCpuWeightForOffer = 0.25;

private double longRunningUsedMemWeightForOffer = 0.70;
private double longRunningUsedMemWeightForOffer = 0.65;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This actually changes the relative weights of cpu vs memory from memory being 2.333 times the weight of cpu to 2.666 times the weight of cpu. Would we instead want .27 and .63 to keep the relative weights of those two the same?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Followed up in-person, will keep as is for now. mem > cpu > disk is preserved here which is the most important piece

@ssalinas
Copy link
Copy Markdown
Contributor

FYI that cluster coordinator change should already be in master. Maybe merge master into this before getting this in staging to avoid additional merge conflicts later on?

Looks good though 👍

@tpetr
Copy link
Copy Markdown
Contributor

tpetr commented Nov 29, 2017

typical apps which Singularity is intended to host are stateless, primarily I/O bound, then CPU bound, with minimal, bounded disk usage.

This is likely outside the scope of the PR, but it could be interesting if users were able to set the weights on a per-Request basis.

@baconmania
Copy link
Copy Markdown
Contributor Author

Aye, that's a cool thought.

@ssalinas ssalinas added this to the 0.19.0 milestone Nov 30, 2017
@baconmania baconmania merged commit 02f7ac2 into report-disk-usage Dec 8, 2017
@baconmania baconmania deleted the score-with-disk-resources branch December 8, 2017 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants