Mirror of Apache Myriad (Incubating)
Java CSS JavaScript Shell HTML
Permalink
Failed to load latest commit information.
config Added Apache license headers to some more files Nov 6, 2015
docker docker/build.gradle was missing header file May 13, 2016
docs typo & set minimum-allocation-mb for fine grain Jun 30, 2016
gradle Implementation of MYRIAD-229, MYRIAD-237, MYRIAD-238, MYRIAD-225 Aug 30, 2016
myriad-commons Refactor which addresses Myriad 213, 214, and 136 in the process. Aug 12, 2016
myriad-executor [MYRIAD-153] tasks not finishing when FGS is enabled. Mar 10, 2016
myriad-scheduler Used reserved resources firstly. Oct 7, 2016
support/apache-release Exclude 'support' folder from release sources Dec 10, 2015
vagrant fixed networking so web interfaces forward correctly Nov 13, 2015
website Website updates. Jun 30, 2016
.gitignore MYRIAD-144: Podling incubator website Nov 4, 2015
.travis.yml Updated travis.yml to build against openjdk7 Oct 17, 2014
DISCLAIMER Create DISCLAIMER Oct 15, 2015
LICENSE Incorporated feedback from IPMC on RC2 Nov 20, 2015
NOTICE Update NOTICE file to 2016 May 17, 2016
README.md Release prep: May 12, 2016
Vagrantfile fixed networking so web interfaces forward correctly Nov 13, 2015
build.gradle Implementation of MYRIAD-229, MYRIAD-237, MYRIAD-238, MYRIAD-225 Aug 30, 2016
gradle.properties [Myriad 171] - updateFile had parameter change between Hadoop 2.7.0->… Apr 2, 2016
gradlew updating gradlew to 2.9 which provides faster incremental builds Nov 18, 2015
gradlew.bat updating gradlew to 2.9 which provides faster incremental builds Nov 18, 2015
settings.gradle Docker Gradle Integration Mar 31, 2016

README.md

Myriad

Build Status

Myriad is a Mesos framework designed for scaling a YARN cluster on Mesos. Myriad can expand or shrink the resources managed by a YARN cluster in response to events as per configured rules and policies.

The name Myriad means, countless or extremely great number. In context of the project, it allows one to expand overall resources managed by Mesos, even when the cluster under Mesos management runs other cluster managers like YARN.

Please note: Myriad is not yet production ready. However, the project is rapidly progressing with some very useful features.

Getting started

For up-to-date documentation, see Apache Myriad on the wiki.

Build Myriad

Please refer to the build section for steps to build Myriad.

Roadmap

Please keep checking this section for updates.

  • NodeManager Profiles
  • Scale up/down Node Managers via REST API/Web UI
  • Framework re-conciliation & HA
  • ResourceManager failover/discovery using Marathon/Mesos-DNS
  • Fine-grained scaling
  • Remote distribution of NodeManager binaries
  • Framework checkpointing
  • Launch Job History Server
  • Constraints based Node Manager placement
  • Docker support
  • Support multi-tenancy for Node Managers
  • Configuration store for storing rules and policies for clusters managed by Myriad

Mailing Lists

Videos and Slides

  • MesosCon 2014 - Running YARN alongside Mesos (video) (slides)
  • Mesos User Group, March 2015 - Myriad: Integrating Hadoop into the Datacenter (video)
  • MesosCon, Seattle 2015 - Resource Sharing Beyond Boundaries (video) (slides)

License

Apache Myriad is licensed under the Apache License, Version 2.0.

For additional information, see the LICENSE and NOTICE files.


Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.