From aeea51e0120c80a306c89d5b007ed9087fb9df76 Mon Sep 17 00:00:00 2001 From: manuzhang Date: Wed, 8 Jun 2016 09:46:16 +0800 Subject: [PATCH] update Storm module README --- docs/dev-storm.md | 12 +++++----- experiments/storm/README.md | 46 ++++++++++++++++++++++++++----------- 2 files changed, 39 insertions(+), 19 deletions(-) diff --git a/docs/dev-storm.md b/docs/dev-storm.md index 129f38e34..ea5ecbd0c 100644 --- a/docs/dev-storm.md +++ b/docs/dev-storm.md @@ -101,16 +101,16 @@ This section shows how to run an existing Storm jar in a local Gearpump cluster. Users are able to configure their applications through following options - * `jar` - set the path of a Storm application jar - * `config` - submit the custom configuration file generated when launching Nimbus + * `jar` - set the path of a Storm application jar + * `config` - submit the custom configuration file generated when launching Nimbus b. submit Storm application through UI - 1. Click on the "Create" button on the applications page on UI. - 2. Click on the "Submit Storm Application" item in the pull down menu. - 3. In the popup console, upload the Storm application jar and the configuration file generated when launching Nimbus, + 1. Click on the "Create" button on the applications page on UI. + 2. Click on the "Submit Storm Application" item in the pull down menu. + 3. In the popup console, upload the Storm application jar and the configuration file generated when launching Nimbus, and fill in `storm.starter.ExclamationTopology exclamation` as arguments. - 4. Click on the "Submit" button + 4. Click on the "Submit" button Either way, check the dashboard and you should see data flowing through your topology. diff --git a/experiments/storm/README.md b/experiments/storm/README.md index d02bc6d5f..9fb4e740a 100644 --- a/experiments/storm/README.md +++ b/experiments/storm/README.md @@ -3,25 +3,45 @@ on Gearpump. This documentation illustrates how to do so in a local Gearpump clu ## How to run a Storm application over Gearpump - 1. Launch a local cluster - - ```bash - ./target/pack/bin/local +1. launch a local cluster + + ``` + bin/local + ``` - ``` +2. start a Gearpump Nimbus server - 2. Submit a topology from storm-starter + Users need server's address(`nimbus.host` and `nimbus.thrift.port`) to submit topologies later. The address is written to a yaml config file set with `-output` option. + Users can provide an existing config file where only the address will be overwritten. If not provided, a new file `app.yaml` is created with the config. - ```bash - bin/storm -verbose -config storm.yaml -jar storm-starter-${STORM_VERSION}.jar storm.starter.ExclamationTopology exclamation + ``` + bin/storm nimbus -output [conf ] + ``` + +3. submit Storm applications - ``` + Users can either submit Storm applications through command line or UI. + + a. submit Storm applications through command line + + ``` + bin/storm app -verbose -config app.yaml -jar storm-starter-${STORM_VERSION}.jar storm.starter.ExclamationTopology exclamation + ``` - Users are able to configure their applications through following options. - * `jar` - set the path of a storm application jar - * `config` - submit a customized storm configuration file + Users are able to configure their applications through following options + + * `jar` - set the path of a Storm application jar + * `config` - submit the custom configuration file generated when launching Nimbus - That's it. Check the dashboard and you should see data flowing through your topology. + b. submit Storm application through UI + + 1. Click on the "Create" button on the applications page on UI. + 2. Click on the "Submit Storm Application" item in the pull down menu. + 3. In the popup console, upload the Storm application jar and the configuration file generated when launching Nimbus, + and fill in `storm.starter.ExclamationTopology exclamation` as arguments. + 4. Click on the "Submit" button + + Either way, check the dashboard and you should see data flowing through your topology. ## Limitations