bbuzz14-stream-mining

A Scala starter pack for the stream mining hackday at BBUZZ 2014.

This repository should help you getting started by providing the boilerplate of how to obtains tweets.

See also

• Clojure starter: https://github.com/sojoner/stromer
• Python starter: https://github.com/truemped/bbhack-2014
• Scala starter (this repository): https://github.com/knutwalker/bbuzz14-stream-mining

Requirements

• Java 1.6 or later
• If you have a bash or a similar shell at hand, you can use the provided sbt starter, otherwise, you have to install sbt
• (git)

Usage

checkout

git clone https://github.com/knutwalker/bbuzz14-stream-mining.git && cd bbuzz14-stream-mining

Use at bbuzz hackday 2014-05-28

./sbt run

otherwise

compile

./sbt compile

run an example

./sbt run

open the REPL

./sbt console

using the sbt shell

./sbt

Use re-start to start an example and re-stop to stop an example.

Start hacking

Have a look at the provided examples. You have to specify two things:

1. How you want to deal with Tweets.

Implement your own TweetConsumer.

2. Choose a TweetProvider

By mixing in a concrete TweetProvider and filling in the required parameters (such as host), you create a mainable object, that you can run.

If you're unsure about what parameters are required — the compiler will tell you when something's missing.

Scaladoc

The scaladoc is available at this github page.

License

This project, twitter4j, RxJava, and Json4s are available under Apache Software License 2.0.

Dispatch and JeroMQ are distributed unter LGPLv3 License.

Jedis is available under MIT License.

The sbt starter is available under BSD License