Skip to content

Latest commit

 

History

History
65 lines (42 loc) · 2.22 KB

README.md

File metadata and controls

65 lines (42 loc) · 2.22 KB
Raw

Command line app rebuilddb2

The rebuilddb2 app is used for maintenance of dcrdata's dcrpg database that uses PostgreSQL to store a nearly complete record of the Decred blockchain data.

IMPORTANT: When performing a bulk data import (e.g. full chain scan from genesis block), be sure to configure PostgreSQL appropriately. Please see postgresql-tuning.conf for tips.

Installation

Be able to build dcrdata (see ../../README.md). In short:

  • Install dep, the dependency management tool

    go get -u -v github.com/golang/dep/cmd/dep

  • Clone the dcrdata repository

    git clone https://github.com/decred/dcrdata $GOPATH/src/github.com/decred/dcrdata

  • Populate vendor folder with dep ensure

    cd $GOPATH/src/github.com/decred/dcrdata
dep ensure

  • Build rebuilddb2

    # build rebuilddb2 executable in workspace:
cd $GOPATH/src/github.com/decred/dcrdata/cmd/rebuilddb2
go build
# or to install dcrdata and other tools into $GOPATH/bin:
go install ./cmd/rebuilddb2

Usage

First edit rebuilddb2.conf, using sample-rebuilddb2.conf to start. You will need to follow a typical PostgreSQL setup process, creating a new database/scheme and a new role that has permissions/owns that database.

A fresh rebuild of the database is accomplished via:

./rebuilddb2 -D  # drop any existing tables
./rebuilddb2     # rebuild tables from scratch

Remember to update your PostgreSQL config (postgresql.conf) before and after bulk data imports. Namely, before normal dcrdata operation, ensure that fsync=true and other setting are adjusted for efficient queries.

Details

Rebuilding the dcrdata tables from scratch involves the following steps:

  • Connect to the PostgreSQL database using the settings in rebuilddb2.conf
  • Create the tables (i.e. "blocks", "transactions", "vins", etc).
  • Starting from genesis block, process each block and store in tables.
  • Create indexes for each table.

See rebuilddb2 --help for more information on how to tweak the operating mode.

License

See LICENSE at the base of the dcrdata repository.