(click this icon to view the build output and the test results)
This repository contains example projects to help you quickly get started with Spark as a Service, using spark-submit.sh.
Also see this repository for example projects for IBM BigInsights for Apache Hadoop.
- Access to a Bluemix Spark service instance (e.g. free tier)
- Your local machine is OS/X or Linux (Cygwin should work on Windows - see here)
- Java 8 JDK installed on your local machine
- Git client installed on your local machine
- You are comfortable running commands in the terminal or console
- Cloudant account details (e.g. Free tier on Bluemix)
- dashDB account details (e.g. Free tier on Bluemix)
- Objectstore container details (e.g. Free tier on Bluemix, or Softlayer account)
- Elasticsearch cluster (e.g. Free trial on Compose.io)
- Clone this repository
git clone https://github.com/snowch/bluemix-spark-examples.git
- Copy
connection.properties_template
toconnection.properties
- Save your
vcap.json
in the cloned folder (see thevcap.json_template
for an example and the bluemix docs for more information) - Follow the instructions in the README.md for your chosen example
- Follow the above setup instructions making sure to add connection properties for all services you wish to test.
- Run
./gradlew check
Contributions are welcome. Please send a pull request or contact me at chris.snow@uk.ibm.com to get involved.