Permalink
Fetching contributors…
Cannot retrieve contributors at this time
31 lines (25 sloc) 1.29 KB

Storm Ledger Importer

The ledger importer utilizes Storm to process incoming ledgers and transactions in real time. Transactions are parsed into formats useful for analytics and reporting, and aggregated in various ways suitable for reporting network statistics, monitoring, and visualizing data.

Dependencies

The Storm Ledger Importer requires the following software installed first:

Installation Process

  • install dependencies
  • clone this repository
  • from the main directory, run npm install
  • update config/import.config.json to point to your Hbase thrift server
  • to run locally:
    • adjust storm parallelism as needed in storm/local/config.properties
    • from the command line, run `storm/local/deploy.sh'
  • to deploy to a storm cluster:
    • adjust storm parallelism as needed in storm/production/config.properties
    • from the command line, run: storm/production/importer.sh start to start, storm/production/importer.sh stop to stop, or storm/production/importer.sh restart to restart