Tools for exporting blockchain data to analytical databases
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
coinmetrics-all-blockchains turn tabs into spaces Oct 2, 2018
coinmetrics-bitcoin
coinmetrics-cardano turn tabs into spaces Oct 2, 2018
coinmetrics-eos turn tabs into spaces Oct 2, 2018
coinmetrics-ethereum fix ethereum suicide action export from trace Nov 14, 2018
coinmetrics-export split readme into separate readmes for utilities Oct 6, 2018
coinmetrics-iota
coinmetrics-monero
coinmetrics-monitor split readme into separate readmes for utilities Oct 6, 2018
coinmetrics-nem better handling of repeating in nem Oct 4, 2018
coinmetrics-neo turn tabs into spaces Oct 2, 2018
coinmetrics-ripple apply correction to ripple close_time when fetched from node Nov 16, 2018
coinmetrics-stellar turn tabs into spaces Oct 2, 2018
coinmetrics-tron allow for missing "value" in tron transactions Oct 18, 2018
coinmetrics-waves
coinmetrics
.gitignore add readme and .gitignore, add command-line helpers, rename block-siz… Jan 24, 2018
.travis-build.sh put travis build sequence and docker deploy into separate scripts, de… Oct 24, 2018
.travis-deploy.sh put travis build sequence and docker deploy into separate scripts, de… Oct 24, 2018
.travis.yml
Dockerfile coinmetrics-monitor: build packages, include in docker image, mention… Sep 25, 2018
LICENSE add license Jan 24, 2018
README.md split readme into separate readmes for utilities Oct 6, 2018
stack.yaml upgrade to lts-12.16 for ghc-8.4.4 Oct 29, 2018

README.md

Travis CI Build Status Docker Repository on Quay

Haskell-based CoinMetrics.io tools

These tools are used by CoinMetrics.io team for exporting data from blockchains into analytical databases and monitoring full nodes synchronization state.

Utilities

  • coinmetrics-export - utility for exporting data from blockchains in formats suitable for inserting into analytics databases (SQL, Avro).
  • coinmetrics-monitor - utility for monitoring blockchain nodes and providing Prometheus-compatible metrics.

Status

The project is in early alpha deep development seems-like-its-working-oh-crap state. Command line interface is more or less stable but may change. Please use with caution.

Supported blockchains:

Binaries (experimental)

There're no stable releases yet. All binaries are "bleeding edge" ones built on Travis CI.

One easy way to run the tools is to use docker.

Pull the latest version:

docker pull quay.io/coinmetrics/haskell-tools

Run e.g. coinmetrics-export tool:

docker run -it --rm --net host quay.io/coinmetrics/haskell-tools coinmetrics-export <arguments>

Alternatively you can download executables:

Or packages:

Or setup package repository to receive updates:

For .deb:

echo 'deb https://dl.bintray.com/coinmetrics/haskell-tools-deb unstable main' > /etc/apt/sources.list.d/coinmetrics-haskell-tools.list
curl 'https://bintray.com/user/downloadSubjectPublicKey?username=bintray' | apt-key add -
apt update
apt install coinmetrics-export

For .rpm:

(cd /etc/yum.repos.d/ && curl -JOL https://bintray.com/coinmetrics/haskell-tools-rpm/rpm)
yum install coinmetrics-export

Packages have the advantage of providing bash completion support out of the box.

Building from source

Get stack.

Run stack build --install-ghc --copy-bins --local-bin-path <path for executables>. Executables will be built and placed by specified path.

The code is only tested on Linux (but maybe works on other OSes too).