No description, website, or topics provided.
Python Shell Scala
Switch branches/tags
Nothing to show
Clone or download
Latest commit 112393b Dec 22, 2015
Permalink
Failed to load latest commit information.
core @ 352ee0b Minor change Dec 22, 2015
project Minor change Dec 22, 2015
scripts We don't need that =] Aug 26, 2015
src Updated core and sbt Dec 17, 2015
.gitignore Initial sample Mar 22, 2015
.gitmodules Initial sample Mar 22, 2015
LICENSE Fixing License Mar 22, 2015
README.md Update README.md Mar 26, 2015
assembly.sbt Updated core and sbt Dec 17, 2015
sbt Fix some potential problems Jul 28, 2015

README.md

Ignition-Template

This provides a template to work with Apache Spark and with Ignition-Core.

Notable features

  • This template will point to a stable Spark and Hadoop-client version, potentially working-around some known bugs
  • src/main/scala/ignition/jobs/Runner.scala is a example of multi-setup project that can run using core/tools/cluster.py jobs run command
  • See scripts/job_runner.py for a full-featured, production-grade script-template that launchs and supervises clusters and jobs using AWS spot instances with automatic failure recovery

In general, check the source files for more information.

Getting started

See http://monkeys.chaordic.com.br/start-using-spark-with-ignition/ for quick-start tutorial

TODO

  • An example using Scalaz Validation
  • Other examples, more documentation