Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
88 commits
Select commit Hold shift + click to select a range
8efd7ef
Make the leniency of OPTIMISTIC tunable.
baconmania Oct 16, 2017
329b8da
Improve logging.
baconmania Oct 17, 2017
ec4b804
Set default leniency based on experimentation.
baconmania Oct 17, 2017
61f7e60
Fix test.
baconmania Oct 17, 2017
f794f2b
Enforce a minimum for the placement leninency coefficient.
baconmania Oct 17, 2017
27fae78
Catch errors in FetchRequestArgHistory
ssalinas Oct 19, 2017
85d1ce9
progress on external jwt auth
ssalinas Oct 20, 2017
1b99c24
first draft of jwt auth
ssalinas Oct 20, 2017
0ffdee5
config for auth
ssalinas Oct 20, 2017
7b91439
backend uses auth header, add default emial domain if response doesn'…
ssalinas Oct 20, 2017
5a98e84
allow multiple auth methods
ssalinas Oct 20, 2017
1d7610c
grab the cookie and create a header in the ui
ssalinas Oct 24, 2017
389552b
fix getter/setter
ssalinas Oct 24, 2017
64f80e6
onemore setter fix
ssalinas Oct 24, 2017
2e2f45e
change conig field name
ssalinas Oct 24, 2017
337cd3e
fixes in gulpfile
ssalinas Oct 24, 2017
40fec50
catch nulls
ssalinas Oct 25, 2017
4ade51b
trace logging
ssalinas Oct 25, 2017
58ee7ba
keep this as a set
ssalinas Oct 25, 2017
7ab90c2
specific SingularityUserPermissionsResponse object
ssalinas Oct 25, 2017
ef40108
update user permissions response model
ssalinas Oct 25, 2017
16caab8
don't need this config field
ssalinas Oct 25, 2017
f0955d2
ui overrides
ssalinas Oct 25, 2017
9af857e
catch these exceptions and return absent
ssalinas Oct 25, 2017
e988094
catch one level up
ssalinas Oct 25, 2017
5a742fd
redirect to login earlier
ssalinas Oct 25, 2017
b778e64
wip, dropwizard auth
ssalinas Oct 26, 2017
e86652b
more wip auth
ssalinas Oct 26, 2017
f9f38f0
more wip
ssalinas Oct 26, 2017
fdb3bf8
look, it works now!
ssalinas Oct 27, 2017
dd3d139
add auth header in the tailer as well
ssalinas Oct 27, 2017
1b1fd35
bump tailer version
ssalinas Oct 27, 2017
7d3976f
new tailer version
ssalinas Oct 27, 2017
d4fba37
guice fix for test module
ssalinas Oct 27, 2017
2f9108d
missing dep on hk2-api
ssalinas Oct 27, 2017
4c2e394
move isAuthenticated
ssalinas Oct 27, 2017
baacbb6
utils -> Utils
ssalinas Oct 27, 2017
990947d
correctly wire up setAuthHeader
ssalinas Oct 27, 2017
4bef1da
typo
ssalinas Oct 27, 2017
4a4544c
better name for this
ssalinas Oct 27, 2017
b11dc5c
401s returning properly, don't need this anymore
ssalinas Oct 27, 2017
4db8a6d
auth check on current user, not id
ssalinas Oct 30, 2017
da8e086
auth on additional endpoints
ssalinas Oct 30, 2017
d646b74
change auth checks in utilization resource
ssalinas Oct 30, 2017
dd996bf
don't need this
ssalinas Oct 30, 2017
b7d5d26
Merge pull request #1633 from HubSpot/tunable-OPTIMISTIC-placement
ssalinas Oct 30, 2017
59f41b8
remove the cluster coordinator module, won't work with newer auth
ssalinas Nov 2, 2017
e2f53e7
configurable auth token key
ssalinas Nov 2, 2017
251d71d
avoid optional get on empty
ssalinas Nov 2, 2017
8bc7f55
Shade protobuf for SingularityClient
ssalinas Nov 2, 2017
ef4c649
Merge pull request #1634 from HubSpot/catch_404_run_now
ssalinas Nov 3, 2017
35109a7
also shade in SingularityBase
ssalinas Nov 3, 2017
7c747dc
attempt two at shading mesos
ssalinas Nov 3, 2017
c2a5507
make this a constant
ssalinas Nov 6, 2017
7d24856
Merge pull request #1642 from HubSpot/shade_protobuf
ssalinas Nov 6, 2017
8d4c060
Merge pull request #1635 from HubSpot/jwt_auth
ssalinas Nov 7, 2017
ce4390e
missing line in gulpfile
ssalinas Nov 7, 2017
474043d
Merge pull request #1646 from HubSpot/ui_dev_fix
kwm4385 Nov 7, 2017
ff56e60
Split s3 files based on top level directory
kwm4385 Nov 7, 2017
a0803cc
Add key
kwm4385 Nov 7, 2017
c93a33a
Add padding between folders
kwm4385 Nov 7, 2017
d18a6d6
wip, remove mesos dep from SingularityBase
ssalinas Nov 6, 2017
5634825
Show current directory
kwm4385 Nov 7, 2017
6b92d3e
this is much cleaner
ssalinas Nov 7, 2017
8744692
in a module
ssalinas Nov 8, 2017
4803a1d
objectMapper.convert
ssalinas Nov 8, 2017
7ceeb14
more protos utils usages
ssalinas Nov 8, 2017
1882942
additional fields copied for size optimized offer model
ssalinas Nov 10, 2017
2169ea4
Don't error when ArtifactManager copies duplicate files
Nov 13, 2017
257629b
Removing Throwables.propagate (deprecated)
Nov 13, 2017
7810daf
Merge pull request #1647 from HubSpot/s3-folders
ssalinas Nov 15, 2017
418374f
Merge pull request #1648 from HubSpot/base_no_mesos
ssalinas Nov 17, 2017
982cca5
Merge pull request #1649 from HubSpot/s3_dupe_file_dl
ssalinas Nov 17, 2017
2b2eb2e
Set up new weight configs for disk resources.
baconmania Nov 17, 2017
6ae7795
Add resource usage types for disk resources.
baconmania Nov 17, 2017
61c3b02
Roll disk resources into Singularity offer scoring.
baconmania Nov 17, 2017
3774176
Count up the disk bytes used here as well.
baconmania Nov 20, 2017
a8f37d4
Exercise disk scoring in tests.
baconmania Nov 27, 2017
ede34c6
Configure disk everywhere.
baconmania Nov 28, 2017
1ff5959
Document disk everywhere.
baconmania Nov 28, 2017
be9d01e
Enforce disk resource maxima when validating incoming API calls.
baconmania Nov 28, 2017
e54b0d2
Report container kills due to disk overflow.
baconmania Nov 28, 2017
d805231
Update SingularityService tests to be aware of disk resources.
baconmania Nov 28, 2017
7366650
remove the cluster coordinator module, won't work with newer auth
ssalinas Nov 2, 2017
afe52d1
Fix test.
baconmania Nov 29, 2017
a8e96cc
Fix test.
baconmania Nov 29, 2017
f1fb2ff
Re-sync with master.
baconmania Nov 29, 2017
621e5be
Only ask for the disk resources that were actually requested.
baconmania Dec 1, 2017
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Docs/about/requests-and-deploys.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ Now you want `TestService` to actually run. To do this, you need to create a `De
"resources": {
"cpus":1,
"memoryMb":128,
"diskMb": 1024,
"numPorts":2
},
"command":"java -Ddw.server.applicationConnectors[0].port=$PORT0 -Ddw.server.adminConnectors[0].port=$PORT1 -jar singularitytest-1.0-SNAPSHOT.jar server example.yml",
Expand Down
1 change: 1 addition & 0 deletions Docs/getting-started/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,7 @@ mesos:
master: http://[mesos master hostname]/api/v1/scheduler
defaultCpus: 1
defaultMemory: 128
defaultDisk: 1024
frameworkName: Singularity
frameworkId: Singularity
frameworkFailoverTimeout: 1000000
Expand Down
1 change: 1 addition & 0 deletions Docs/reference/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -176,6 +176,7 @@ These settings should live under the "mesos" field inside the root configuration
|-----------|---------|-------------|------|
| defaultCpus | 1 | Number of CPUs to request for a task if none are specified | int |
| defaultMemory | 64 | MB of memory to request for a task if none is specified | int |
| defaultDisk | 1024 | MB of disk to request for a task if none is specified | int |
| maxNumInstancesPerRequest | 25 | Max instances (tasks) to allow for a request (requests using over this will return a 400) | int |
| maxNumCpusPerInstance | 50 | Max number of CPUs allowed on a given task | int |
| maxNumCpusPerRequest | 900 | Max number of CPUs allowed for a given request (cpus per task * task instance) | int |
Expand Down
5 changes: 0 additions & 5 deletions SingularityBase/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -41,11 +41,6 @@
<artifactId>jackson-datatype-guava</artifactId>
</dependency>

<dependency>
<groupId>org.apache.mesos</groupId>
<artifactId>mesos</artifactId>
</dependency>

<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-lang3</artifactId>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -202,12 +202,4 @@ public static ThreadPoolExecutor newFixedTimingOutThreadPool(int maxThreads, lon
public static String getReplaceHyphensWithUnderscores(String string) {
return string.replace("-", "_");
}

public static final Optional<String> getUserEmail(Optional<SingularityUser> user) {
if (user.isPresent()) {
return user.get().getEmail();
} else {
return Optional.absent();
}
}
}
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,6 @@

import java.util.Objects;

import org.apache.mesos.v1.Protos;

import com.fasterxml.jackson.annotation.JsonCreator;
import com.fasterxml.jackson.annotation.JsonProperty;
import com.google.common.base.Optional;
Expand All @@ -23,19 +21,6 @@ public SingularityVolume(
this.mode = Optional.fromNullable(mode);
}

@Deprecated
public SingularityVolume(String containerPath, Optional<String> hostPath, Optional<Protos.Volume.Mode> mode) {
this(containerPath, hostPath, convertedMode(mode));
}

private static SingularityDockerVolumeMode convertedMode(Optional<Protos.Volume.Mode> mode) {
if (mode.isPresent()) {
return SingularityDockerVolumeMode.valueOf(mode.get().toString());
} else {
return null;
}
}

public String getContainerPath() {
return containerPath;
}
Expand Down

This file was deleted.

Loading