Holochain-rust

This is the home of the Holochain Rust libraries, being rewritten from Go into Rust, and extended.

Code Status: Rust version is currently Pre-Alpha. Not for production use. The code has not yet undergone a security audit. We expect to destructively restructure code APIs and data chains until Beta. Prototype go version was unveiled at our first hackathon (March 2017), with go version Alpha 0 released October 2017. Alpha 1 was released May 2018.

There are 4 developer preview releases of the Rust version.

Holochain Links:	FAQ	Developer Docs	White Paper

Overview

This holochain-rust repository implements a number of distinct yet overlapping aspects of the Holochain framework.

1. A library for the core Holochain functionality for defining and running DNA instances: core
2. A library and syntax for use in Rust based development of Zomes within DNAs, called Holochain Development Kit: hdk-rust
3. A library for managing instances and connecting them to interfaces: conductor-api
4. A Rust based Conductor that uses the conductor_api: conductor
5. A nodejs based Conductor for running tests: nodejs-conductor
6. A command line developer tool: hc
7. A sample application that we use to demonstrate the current functionality and drive development: app-spec

Core

The core folder contains the code that implements the core functionality of Holochain. It is the aspect that takes in an application DNA, and an agent, and securely runs peer-to-peer applications by exposing the API functions to Zomes. It draws on other top level definitions and functions such as dna, cas_implementations, agent, and core_types.

HDK Rust

Holochain applications have been designed to consist at the low-level of WebAssembly (WASM) running in a virtual machine environment. However, most languages will be easiest to use with some stub code to connect into the WASM runtime environment, because of some constraints with WASM. That is the main reason why a "Developer Kit" for a language exists. It is a library, and a syntax, for writing Zome code in that language.

hdk-rust is a solid reference implementation of this, that enables Zomes to be written in the Rust language (the same, somewhat confusingly, as Holochain Core).

Within this repository, some aspects cross over between core and hdk-rust, such as core_types, since they get stored into WASM memory in core, and then loaded from WASM memory, within hdk-rust. Related, wasm_utils is used on both sides to actually perform the storing, and loading, of values into and from WASM memory.

Other HDKs and language options

Any language that compiles to WASM and can serialize/deserialize JSON data can be available as an option for programmers to write Holochain applications.

An HDK for Assemblyscript is under experimental development at hdk-assemblyscript.

We expect many more languages to be added by the community, and there is even an article on how to write a kit for a new language.

Conductor API

Core only implements the logic for the execution of a single DNA. Because the Holochain app ecosystem relies on DNA composibility, we need to be able to load and instantiate multiple DNAs. We call an executable that can do this a Conductor. The first such Conductors we implemented were the Qt C++ GUI driven holosqape and the CLI driven hcshell Conductor which we used for running javascript based tests.

These gave us the experience from which we abstracted the conductor_api crate which specifies and implements a standard way for building conductors, including specifying the various interfaces that might be available for executing calls on a particular DNA, i.e. websockets, HTTP, Unix domain sockets, carrier pigeon network, etc...

If you need to implement your own conductor, conductor_api should provide you with the needed types and functions to do so easily.

To implement a conductor in a C based language, the core_api_c_binding [NEEDS UPDATING] code could be used, such as HoloSqape does.

Rust Conductor

The conductor crate uses the conductor_api to implement an executable which is intended to become the main, highly configurable and GUI less conductor implementation that can be run as a background system service.

Nodejs Conductor

The nodejs_conductor directory implements a node package that creates a conductor that wraps the Holochain core Rust implementation so we can access it from node. This is crucial especially for creating a test-driven development environment for developing Holochain DNA. The hc command-line tool relies on it to run tests.

HC Command-line developer tool.

The cli crate implements our command line developer tool which allows you to create DNA scaffold, run tests, and finally package your DNA for running in a Conductor. For more details see the crate README.

App Spec Driven Development

We use a practice for coordinating additions and features that starts with adding a feature to a sample application so that we know we have a working example all the times. You can read about the details here

Documentation: The Book on Holochain

There is a work-in-progress book of documentation being written about holochain-rust. See the published version at the associated GitHub Pages for this repo, https://developer.holochain.org/guide/latest. See instructions for how to contribute to the book at doc/holochain_101/src/how_to_contribute.md.

Installation & Usage

Important: the instructions in this readme are for developers intending work on Holochain code-base itself, not Holochain application developers. If you want to use Holochain, please proceed to the instructions on the quick start installation guide: https://developer.holochain.org/start.html

The following instructions are for developing Holochain Core or the HDK itself

There are two components needed currently to run Holochain applications, the core (what's in this repo) and also the networking engine. You can install and work on core using the built-in mock network following the instructions below, but if you want to actually test out your apps using the real networking, you will have to install the networking component following the instructions in the readme there. (Note: please see the instructions in the hc command-line tool readme or the contuctor readme for how to configure the tools to use and activate the networking component.

There are three approaches to building and testing Holochain: using make, docker or nix:

Make (ubuntu and macOS only)

For Ubuntu/OSX you can install the prerequisites with :

cd path/to/holochain
. ./scripts/install/auto.sh

Note: the script will install homebrew on mac os x

After the install script completes successfully, you can start local development using make

Running the make command will:

1. install (or update to) the correct version of rust
2. build all the rust libraries from the source code in this repository.
3. build and install the command-line tools.

Note: it's very important to use the rust version specified in the Makefile! Since we are using nightly rust builds, the language is changing rapidly and sometimes introduces breaking changes that we haven't adapted to yet. Don't just use the latest nightly.

Docker

We also use docker. The docker folder contains scripts to build and run docker images.

Windows

You will need to install rust manually.

Rustup https://rustup.rs/# is likely the best option.

The rust language moves very fast on the nightly channel.

It is very important to be using the correct nightly version.

Currently this is:

nightly-2019-01-24-x86_64-pc-windows-msvc

The nightly version we test/develop against can always be found in the .travis.yml file.

NixOS

If you have nix-shell then feel free to use our .nix files.

shell.core.nix and shell.tools.nix are split to mirror the versioning behaviour in the makefile.

Not everything in the Makefile is implemented in nix, and a lot of things don't need to be. Notably the cross-platform and defensive installation of dependencies is not included.

If you have a nix friendly system, this is the fastest way to develop and test.

Running tests

Run:

. docker/run-test

or

make test

or

nix-shell --run hc-test

Note that there are also make commands for running the tests of just core, or the command-line line tools or app_spec separately:

make test_cli
make test_holochain
make test_app_spec
make build_nodejs_conductor

Building for Android

Note there is an article written on how to build Holochain for Android, read it here.

Contribute

Holochain is an open source project. We welcome all sorts of participation and are actively working on increasing surface area to accept it. Please see our contributing guidelines for our general practices and protocols on participating in the community, as well as specific expectations around things like code formatting, testing practices, continuous integration, etc.

Some helpful links:

• Chat with us on our Chat Server or Gitter

License

Copyright (C) 2018, Holochain Foundation

This program is free software: you can redistribute it and/or modify it under the terms of the license p rovided in the LICENSE file (GPLv3). This program is distributed in the hope that it will be useful, bu t WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Note: We are considering other 'looser' licensing options (like MIT license) but at this stage are using GPL while we're getting the matter sorted out. See this article for some of our thinking on licensing for distributed application frameworks.