Skip to content

This repository contains example projects to help you quickly get started with Spark as a Service, spark-submit.sh.

License

Notifications You must be signed in to change notification settings

snowch/bluemix-spark-examples

Repository files navigation


Build Status (click this icon to view the build output and the test results)

This repository contains example projects to help you quickly get started with Spark as a Service, using spark-submit.sh.

Also see this repository for example projects for IBM BigInsights for Apache Hadoop.


Pre-requisites

Mandatory

  • Access to a Bluemix Spark service instance (e.g. free tier)
  • Your local machine is OS/X or Linux (Cygwin should work on Windows - see here)
  • Java 8 JDK installed on your local machine
  • Git client installed on your local machine
  • You are comfortable running commands in the terminal or console

Optional

  • Cloudant account details (e.g. Free tier on Bluemix)
  • dashDB account details (e.g. Free tier on Bluemix)
  • Objectstore container details (e.g. Free tier on Bluemix, or Softlayer account)
  • Elasticsearch cluster (e.g. Free trial on Compose.io)

Setup Instructions

  • Clone this repository git clone https://github.com/snowch/bluemix-spark-examples.git
  • Copy connection.properties_template to connection.properties
  • Save your vcap.json in the cloned folder (see the vcap.json_template for an example and the bluemix docs for more information)
  • Follow the instructions in the README.md for your chosen example

Testing

  • Follow the above setup instructions making sure to add connection properties for all services you wish to test.
  • Run ./gradlew check

Contributing

Contributions are welcome. Please send a pull request or contact me at chris.snow@uk.ibm.com to get involved.

About

This repository contains example projects to help you quickly get started with Spark as a Service, spark-submit.sh.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages