concordium-node

Concordium node implementation

Dependencies to build the project

• Rust (stable 1.73 for using static libraries)
• binutils >= 2.22
  • For macOS one should use the binutils provided by Xcode.
• cmake >= 3.8.0
• flatc v22.12.06 is what we currently use. Either build from the v22.12.06 tag of the repository using CMake and copy the flatc binary somewhere in your PATH, or download a released binary from https://github.com/google/flatbuffers/releases/tag/v22.12.06 and place it somewhere in your PATH.
• protobuf >= 3.15
• LLVM and Clang >= 3.9
• As noted in the caveats section below, you need to build the Concordium Consensus project before building this project. So you also need the dependencies listed in the README for Concordium Consensus.

Optional dependencies

• Haskell stack if not building using static libraries

Supported features

• network_dump - makes the network dumping capabilites available.
• static - build against static haskell libraries (Linux only)
• profiling - build against haskell libraries with profiling support enabled (Linux only)
• dedup_benchmarks - enable support in the benchmarks for deduplication queues

Building the node

The build.rs script links with a number of Haskell libraries and supports a number of configuration options that can be configured in two different ways, either via environment variables or Cargo features.

Features

The package supports the following features related to linking with the Haskell component.

• static: This feature enables linking with static Haskell libraries on linux They are expected to be available in ./deps/static-libs/linux/vanilla.

  These static libraries can be built using the docker image built from [../scripts/static-libraries/static-libraries.Dockerfile] by doing the following from the root of the repository.

  docker build -t concordium/static-libraries -f scripts/static-libraries/static-libraries.Dockerfile .
  mkdir out
  docker run -v $(pwd)/out:/out concordium/static-libraries
  mkdir -p concordium-node/deps/static-libs/linux
  tar -xf out/static-consensus-9.6.4.tar.gz --strip-components=1 -C concordium-node/deps/static-libs/linux

  (this is assuming a GNU version of tar)

• profiling: This will link with Haskell libraries built with profiling support. This option implies static, with the difference that the libraries must be available in ./deps/static-libs/linux/profiling. The same process and Dockerfile can be used to build them. In fact both versions of static libraries are always built.

By default none of these features are enabled.

Building a node with any of these features, e.g., cargo build --release --features=static produces a mostly statically linked binary concordium-node, apart from system libraries.

Environment variables

Environment variables only apply to the default build. This links with shared Haskell libraries.

• CONCORDIUM_HASKELL_ROOT should, if present, be a directory containing

  • libconcordium-consensus.so
  • libHSconcordium-consensus-0.1.0.0.so
  • libHSconcordium-base-0.1.0.0.so
  • libHSlmdb-0.2.5.so

  This only applies to non-windows platforms. It is not used on other platforms. On Windows the Concordium haskell package is built with a standalone option which embeds all dependent libraries into one single DLL. This option does not work on linux, hence the more elaborate linking process.

  If this flag is not present the build script will try to automatically discover all the Haskell libraries by using stack path.

• HASKELL_RTS_VARIANT applies to all platforms and is the prefix of the GHC runtime library that should be linked. This defaults to libHSrts-1.0.2_thr- for the threaded version.

• HASKELL_GHC_LIBDIR applies to all platforms and should be the location of the GHC libraries directory (by GHC libraries we mean the base runtime system libraries, base haskell libraries, and dependenencies). If not given the script will try to discover the value by running stack ghc -- --print-libdir.

CAVEATS

• Note that build.rs will not automatically build the Haskell dependencies, it will only try to discover them. Building should be done before by running stack build inside ../concordium-consensus/ or running

  stack --stack-yaml ../concordium-consensus/stack.yaml build

  Once the node is built it can be run as

  cargo run -- --config-dir <CONCORDIUM_NODE_CONFIG_DIR> --data-dir <CONCORDIUM_NODE_DATA_DIR>

  or

  cargo run --release -- --config-dir <CONCORDIUM_NODE_CONFIG_DIR> --data-dir <CONCORDIUM_NODE_DATA_DIR>

  to be run in release mode for improved performance. Note that the concordium-consensus dependency is the same regardless of how the node itself is built, the --release only applies to the optimization of the rust node components.

Documentation about what <CONCORDIUM_NODE_CONFIG_DIR> and <CONCORDIUM_NODE_DATA_DIR> is seen at https://github.com/Concordium/concordium-node/blob/main/VARIABLES.md#common

• The node built with Haskell library auto-discovery is not suitable for distribution to other machines. It is a dynamically linked binary with a large number of shared library dependencies.

MacOS Specific

You may need to add the following entries to your ~/.stack/config.yaml for the libraries installed via brew:

extra-lib-dirs:
- /opt/homebrew/lib

extra-include-dirs:
- /opt/homebrew/include/

M1 and M2 MacOS specific

You may need to add the following entry to your ~/.stack/config.yaml for the libffi include:

extra-include-dirs:
- /Library/Developer/CommandLineTools/SDKs/MacOSX12.3.sdk/usr/include/ffi/

To determine the exact path to the libffi include directory, run the following command:

pkg-config --cflags libffi

Building on Windows

Dependencies

Before building the node, you should install the following dependencies:

• Haskell stack
• Rust
  • For building the node, the toolchain 1.73-x86_64-pc-windows-gnu is required, which can be installed with the command: rustup toolchain install 1.73-x86_64-pc-windows-gnu.
  • For building the node runner service (optional), the toolchain 1.73-x86_64-pc-windows-msvc is required, which can be installed with the command: rustup toolchain install 1.73-x86_64-pc-windows-msvc.
• GCC is required for building some library dependencies. WinLibs provides a standalone build of GCC with MinGW-w64. Download the latest release version (Win64, without LLVM) and extract it (e.g. to C:\mingw64) and ensure that the bin directory is on the path. (Installing gcc under stack's msys2 installation does not seem to work when building the node.)
• flatc 22.12.06 (should be in the path)
• protoc >= 3.15
• LMDB should be installed under stack's msys2 installation, which can be done with the following commands:

stack exec -- pacman -Syuq --noconfirm
stack exec -- pacman -Syq mingw-w64-x86_64-lmdb --noconfirm

• If building the installer, the WiX Toolset (v3) is required, and should be in the path.

Building and Running

The simplest way to build the complete node, as well as the service runner and installer is with the build-all.ps1 powershell script. The script takes a -nodeVersion argument that must be of the form X.Y.Z[-B] or X.Y.Z[.B] where X.Y.Z should be the node binary version and the optional B is to be the build version. X.Y.Z[.B] is used as the product version in the installer.

The node binary will be built at .\target\release\concordium-node.exe. However, running the node requires the consensus DLL, which is compiled to "$(stack path --local-install-root)\lib\concordium-consensus.dll". If you wish to run the node directly, you should copy concordium-consensus.dll to the location of concordium-node.exe. The node also depends on a liblmdb.dll, which is part of stack's msys2 installation. It also depends on the DLLs concordium_base.dll, sha_2.dll and concordium_smart_contract_engine.dll that are built as part of the build process. To run the node with these DLLs in the path, you can use stack exec, as in:

stack exec -- concordium-node.exe --help

Build issue: long paths

If the root directory of the repository is too long, then the build may fail with No such file or directory errors, such as:

concordium-consensus   >   = note: x86_64-w64-mingw32-gcc.exe: error: C:\msys64\jenkins-agent\workspace\concordium-node-windows\concordium-consensus\smart-contracts\wasm-chain-integration\target\release\build\winapi-x86_64-pc-windows-gnu-0838443214203ebf\build_script_build-0838443214203ebf.build_script_build.8py00u3m-cgu.0.rcgu.o: No such file or directory

This is caused by the path exceeding the Windows maximum path length. The simplest solution for this is to clone the repository into a shorter root path.

Running a bootstrapper node

The bootstrapper node uses a configuration similar to the one of a normal node. Using --help will show all the available flags.

There is one mandatory parameter that must be set: --regenesis-block-hashes. This parameter accepts a list of block hashes that will be shared when performing a handshake with a node to only accept nodes whose list of regenesis block hashes is a prefix of the one from the bootstrapper, or viceversa, indicating that both nodes belong to the same network.

As the bootstrapper node doesn't have a running consensus inside, it will not update the regenesis block hashes list, so it should be updated whenever the bootstrapper node is restarted (and there had been a protocol update).

The format would be the following:

p2p_boostrapper-cli ... --regenesis-block-hashes 0e8a30009f9cf7c7ab76929cf6bad057a20b7002fee6fe0be48682d32b331b91 c8ebf79db99dec96e5f32a09dbcdfd31744a88526e70bb3305837dcb8147241a ...

Running all tests

$> cargo test --all

Obtaining documentation

The output is placed in ./target/doc by default.

$> cargo doc

To automatically open the browser with the documentation once it is generated use the --open flag.

$> cargo doc --open