Skip to content

Latest commit

 

History

History
48 lines (30 loc) · 2.28 KB

README.md

File metadata and controls

48 lines (30 loc) · 2.28 KB
Raw

Build Status (click this icon to view the build output and the test results)

This repository contains example projects to help you quickly get started with Spark as a Service, using spark-submit.sh.

Also see this repository for example projects for IBM BigInsights for Apache Hadoop.

Pre-requisites

Mandatory

  • Access to a Bluemix Spark service instance (e.g. free tier)
  • Your local machine is OS/X or Linux (Cygwin should work on Windows - see here)
  • Java 8 JDK installed on your local machine
  • Git client installed on your local machine
  • You are comfortable running commands in the terminal or console

Optional

  • Cloudant account details (e.g. Free tier on Bluemix)
  • dashDB account details (e.g. Free tier on Bluemix)
  • Objectstore container details (e.g. Free tier on Bluemix, or Softlayer account)
  • Elasticsearch cluster (e.g. Free trial on Compose.io)

Setup Instructions

  • Clone this repository git clone https://github.com/snowch/bluemix-spark-examples.git
  • Copy connection.properties_template to connection.properties
  • Save your vcap.json in the cloned folder (see the vcap.json_template for an example and the bluemix docs for more information)
  • Follow the instructions in the README.md for your chosen example

Testing

  • Follow the above setup instructions making sure to add connection properties for all services you wish to test.
  • Run ./gradlew check

Contributing

Contributions are welcome. Please send a pull request or contact me at chris.snow@uk.ibm.com to get involved.