Roasbeef blockchain/indexers: fix bug in indexer re-org catch up
In this commit, we fix an existing bug in the re-org catch up logic for
the `IndexManager`. Before this commit, we would assign the block to the
_local_ scope rather than the outer scope. As a result, we would never
properly bisect the chain to find the fork point to be able to reconcile
the index state to the main chain only after a re-org occurs.

Fixes #1261
Latest commit be191ca Aug 23, 2018
Permalink
..
Failed to load latest commit information.
fullblocktests btcd/multi: fix a number of typos in comments. Jan 26, 2018
indexers blockchain/indexers: fix bug in indexer re-org catch up Aug 23, 2018
testdata multi: Rework utxoset/view to use outpoints. May 27, 2018
README.md blockchain: Fix typos in README.md. Jan 26, 2018
accept.go blockchain: Persist block status changes to disk. Jan 29, 2018
bench_test.go blockchain: Consolidate tests into package. Aug 20, 2017
blockindex.go blockchain: Persist block status changes to disk. Jan 29, 2018
chain.go blockchain: during fastAdd or if block wasn't already valid, mark as … Aug 9, 2018
chain_test.go blockchain: Implement IntervalBlockHashes method. May 23, 2018
chainio.go blockchain: in initChainState mark ancestors of best tip as valid if … Aug 9, 2018
chainio_test.go blockchain: publicly export spentTxOut and all attributes May 31, 2018
chainview.go blockchain: Refactor to use new chain view. Aug 24, 2017
chainview_test.go multi: correct all import paths May 23, 2018
checkpoints.go blockchain: Refactor to use new chain view. Aug 24, 2017
common_test.go multi: Rework utxoset/view to use outpoints. May 27, 2018
compress.go multi: Rework utxoset/view to use outpoints. May 27, 2018
compress_test.go multi: Rework utxoset/view to use outpoints. May 27, 2018
difficulty.go blockchain: Refactor to use new chain view. Aug 24, 2017
difficulty_test.go blockchain: Consolidate tests into package. Aug 20, 2017
doc.go Relicense to the btcsuite developers. May 1, 2015
error.go blockchain: Track block validation status in block index. Oct 23, 2017
error_test.go blockchain: Track block validation status in block index. Oct 23, 2017
example_test.go blockchain: Fix typo in example_test.go. Jan 31, 2018
fullblocks_test.go blockchain: Consolidate tests into package. Aug 20, 2017
log.go all: Remove seelog logger. Jun 19, 2017
mediantime.go Relicense to the btcsuite developers. May 1, 2015
mediantime_test.go btcd/multi: fix a number of typos in comments. Jan 26, 2018
merkle.go BIP0141+blockchain: add functions for extracting and validating witne… Aug 14, 2017
merkle_test.go blockchain: Consolidate tests into package. Aug 20, 2017
notifications.go blockchain: Consistency pass on subscribe code. Aug 15, 2017
notifications_test.go multi: correct all import paths May 23, 2018
process.go blockchain: Remove BFDryRun behaviour flag. Oct 12, 2017
scriptval.go multi: Rework utxoset/view to use outpoints. May 27, 2018
scriptval_test.go blockchain: Consolidate tests into package. Aug 20, 2017
thresholdstate.go btcd/multi: fix a number of typos in comments. Jan 26, 2018
thresholdstate_test.go blockchain: Remove threshold state db cache. Aug 15, 2017
timesorter.go blockchain: Use int64 timestamps in block nodes. Jan 31, 2017
timesorter_test.go blockchain: Consolidate tests into package. Aug 20, 2017
upgrade.go multi: Rework utxoset/view to use outpoints. May 27, 2018
upgrade_test.go multi: Rework utxoset/view to use outpoints. May 27, 2018
utxoviewpoint.go blockchain: publicly export spentTxOut and all attributes May 31, 2018
validate.go blockchain: publicly export spentTxOut and all attributes May 31, 2018
validate_test.go blockchain: Remove BFDryRun behaviour flag. Oct 12, 2017
versionbits.go blockchain: Refactor to use new chain view. Aug 24, 2017
weight.go multi: Rework utxoset/view to use outpoints. May 27, 2018

README.md

blockchain

Build Status ISC License GoDoc

Package blockchain implements bitcoin block handling and chain selection rules. The test coverage is currently only around 60%, but will be increasing over time. See test_coverage.txt for the gocov coverage report. Alternatively, if you are running a POSIX OS, you can run the cov_report.sh script for a real-time report. Package blockchain is licensed under the liberal ISC license.

There is an associated blog post about the release of this package here.

This package has intentionally been designed so it can be used as a standalone package for any projects needing to handle processing of blocks into the bitcoin block chain.

Installation and Updating

$ go get -u github.com/btcsuite/btcd/blockchain

Bitcoin Chain Processing Overview

Before a block is allowed into the block chain, it must go through an intensive series of validation rules. The following list serves as a general outline of those rules to provide some intuition into what is going on under the hood, but is by no means exhaustive:

  • Reject duplicate blocks
  • Perform a series of sanity checks on the block and its transactions such as verifying proof of work, timestamps, number and character of transactions, transaction amounts, script complexity, and merkle root calculations
  • Compare the block against predetermined checkpoints for expected timestamps and difficulty based on elapsed time since the checkpoint
  • Save the most recent orphan blocks for a limited time in case their parent blocks become available
  • Stop processing if the block is an orphan as the rest of the processing depends on the block's position within the block chain
  • Perform a series of more thorough checks that depend on the block's position within the block chain such as verifying block difficulties adhere to difficulty retarget rules, timestamps are after the median of the last several blocks, all transactions are finalized, checkpoint blocks match, and block versions are in line with the previous blocks
  • Determine how the block fits into the chain and perform different actions accordingly in order to ensure any side chains which have higher difficulty than the main chain become the new main chain
  • When a block is being connected to the main chain (either through reorganization of a side chain to the main chain or just extending the main chain), perform further checks on the block's transactions such as verifying transaction duplicates, script complexity for the combination of connected scripts, coinbase maturity, double spends, and connected transaction values
  • Run the transaction scripts to verify the spender is allowed to spend the coins
  • Insert the block into the block database

Examples

  • ProcessBlock Example
    Demonstrates how to create a new chain instance and use ProcessBlock to attempt to add a block to the chain. This example intentionally attempts to insert a duplicate genesis block to illustrate how an invalid block is handled.

  • CompactToBig Example
    Demonstrates how to convert the compact "bits" in a block header which represent the target difficulty to a big integer and display it using the typical hex notation.

  • BigToCompact Example
    Demonstrates how to convert a target difficulty into the compact "bits" in a block header which represent that target difficulty.

GPG Verification Key

All official release tags are signed by Conformal so users can ensure the code has not been tampered with and is coming from the btcsuite developers. To verify the signature perform the following:

  • Download the public key from the Conformal website at https://opensource.conformal.com/GIT-GPG-KEY-conformal.txt

  • Import the public key into your GPG keyring:

    gpg --import GIT-GPG-KEY-conformal.txt
  • Verify the release tag with the following command where TAG_NAME is a placeholder for the specific tag:

    git tag -v TAG_NAME

License

Package blockchain is licensed under the copyfree ISC License.