Federated Big Data Orchestration Service
Java Python CSS JavaScript PLpgSQL Shell Other
Latest commit fe67d82 Feb 21, 2017 @tgianos tgianos committed on GitHub Upgrade to Spring Platfrom Brussels-RELEASE (#472)
Permalink
Failed to load latest commit information.
codequality Added retries to service level methods that make persistence calls. (#… Oct 19, 2016
genie-app Upgrade to Spring Platform Athens SR2, Spring Cloud Camden SR3 and Sp… Jan 13, 2017
genie-client fix bug with HadoopJob constructed command args when command in None … Feb 9, 2017
genie-common Switch how health status is determined from raw number of running job… Oct 10, 2016
genie-core Upgrade to Spring Boot 1.5.1 (#470) Feb 15, 2017
genie-ddl Change 'user' field to 'genie_user' in database to avoid sql keyword … Feb 8, 2017
genie-demo Adding g++ to docker image for client to fix build (#451) Jan 9, 2017
genie-docs Upgrade to Spring Boot 1.5.1 (#470) Feb 15, 2017
genie-test Collecting size of stdout and stderr upon job completion if they exist ( Aug 18, 2016
genie-war Upgrade to Spring Platform Athens SR2, Spring Cloud Camden SR3 and Sp… Jan 13, 2017
genie-web Upgrade to Spring Boot 1.5.1 (#470) Feb 15, 2017
gradle Upgrade to Spring Platfrom Brussels-RELEASE (#472) Feb 21, 2017
.editorconfig [#154] Added swagger back in as an optional dependency that can be in… Dec 15, 2015
.gitignore Upgrade to Spring Boot 1.5.1 (#470) Feb 15, 2017
.netflixoss Add keys for travis publish. Disable cloudbees jobs. Dec 15, 2015
.travis.yml Change 'user' field to 'genie_user' in database to avoid sql keyword … Feb 8, 2017
CHANGELOG.md Setup for documentation generation (#422) Oct 26, 2016
LICENSE Updating the build files with some clean up after the pull request fo… Feb 17, 2015
OSSMETADATA adding OSSMETADATA for NetflixOSS tracking Dec 11, 2015
README.md Adding NetflixOSS lifecycle badge to README (#462) Jan 31, 2017
build.gradle Upgrade to Spring Boot 1.5.1 (#470) Feb 15, 2017
gradle.properties Upgrade to Spring Platfrom Brussels-RELEASE (#472) Feb 21, 2017
gradlew Initial REST documentation (#439) Dec 8, 2016
gradlew.bat Upgrade Gradle to 3.1 and Spring Platform to 2.0.8.RELEASE (#398) Sep 26, 2016
lombok.config Modifying DTO's for serializability and for using as keys and values … Feb 20, 2016
settings.gradle Setup for documentation generation (#422) Oct 26, 2016

README.md

Genie

Download License Issues NetflixOSS Lifecycle

Introduction

Genie is a federated job orchestration engine developed by Netflix. Genie provides REST-ful APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing the metadata of many distributed processing clusters and the commands and applications which run on them.

Documentation

See the official website to find documentation about Genie and specific documentation for various releases.

Demo

Genie has demo instructions available for all 3.x.x releases. Please see the release you're interested in demoing on the releases page. Click on the release and then demo docs.

Builds

Genie builds are run on Travis CI here.

Branch Build Coverage
Master Build Status Coverage Status

Docker

Successful builds will also generate a docker image which is published to Docker Hub.

App Image

App Image

This is the image for the Spring Boot all in one jar. You can use docker pull netflixoss/genie-app:{version} to test the one you want.

You can run via docker run -t --rm -p 8080:8080 netflixoss/genie-app:{version}

WAR Image

WAR Image

This is the image that has Genie deployed as a WAR file within Tomcat. You can use docker pull netflixoss/genie-war:{version} to test the one you want.

You can run via docker run -t --rm -p 8080:8080 netflixoss/genie-war:{version}