Skip to content

radanalyticsio/scorpion-stare

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
ss2
 
 
 
 
 
 
 
 
 
 

scorpion-stare

Spark scheduler backend plug-ins for awareness of kube, openshift, oshinko, etc

build a plug-in into local (uber-)jar files:

$ cd /path/to/scorpion-stare
$ sbt oshinko/assembly

using custom scorpion-stare build of spark:

$ cd /path/to/spark
$ ./bin/spark-shell --master "local-cluster[2,1,1024]" --jars /path/to/scorpion-stare/oshinko/target/scala-2.11/scorpion_stare.jar

The spark-shell should recognize the OshinkoService plug-in for WorkerScaleoutService

About

Spark scheduler backend plug-ins for awareness of kube, openshift, oshinko, etc

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published