Cardano cluster, on-fly genesis, Chairman service & NixOS test #177

deepfire · 2019-09-06T17:25:50Z

Turn the cardano-node.service into instanced set of cardano-node@NODE-ID.service, systemd-unit-wise
Define a cardano-cluster target.
Generate genesis on fly for the cluster.
Chairman service, with a factored script generator..
Chairman's cluster NixOS test.

disassembler

I don't see how this can be ran without having systemd. Can you please provide an example of how the scripts attribute would utilize this service?

disassembler · 2019-09-06T17:31:03Z

nix/nixos/cardano-node-options.nix

@@ -109,7 +110,7 @@ in {

      stateDir = mkOption {
        type = types.str;
-        default = "/var/lib/cardano-node";
+        default = "/var/lib/cardano-node-%i";


lets not pollute lib. Maybe optionally if multiple instances are running, do /var/lib/cardano-node/%i

Fixed -- we now have an instanced option to the NixOS service, that guides the choice of:

systemd service name (if instanced is false, the service is not instanced)

node id & port

disassembler · 2019-09-06T17:34:20Z

nix/nixos/cardano-node-service.nix

@@ -27,7 +27,7 @@ in {
      uid = 10016;
      group = "cardano-node";
    };
-    systemd.services.cardano-node = {
+    systemd.services."cardano-node@" = {


we should optionally do this if it's a cluster vs just a single node

deepfire · 2019-09-06T20:58:36Z

I don't see how this can be ran without having systemd

Absolutely, it needs systemd.

disassembler · 2019-09-10T18:48:06Z

Breaks connect scripts:

nix-build -A scripts.mainnet.node
error: The option `services.cardano-node.port' defined in `<unknown-file>' does not exist.

disassembler

Breaks the scripts.

deepfire · 2019-09-11T20:19:21Z

Breaks the scripts.

Hmm, @disassembler, are you sure you tested the latest commit?
My apologies, I might have been pushing things yesterday in parallel..

nix-shell:~/cardano-node]$ git diff

[nix-shell:~/cardano-node]$ grev
7d998a6155cf16eecb698d8b6fbaefbe34e66591 Tue Sep 10 21:06:48 2019 +0300 cardano-cluster-service:  a flock of cardano-node@NODE-ID services

[nix-shell:~/cardano-node]$ nix-build -A scripts.mainnet.node
/nix/store/c586rsqmd211gjlxbciacax7x4k317dr-cardano-node-mainnet

[nix-shell:~/cardano-node]$ /nix/store/c586rsqmd211gjlxbciacax7x4k317dr-cardano-node-mainnet
Starting cardano-node with --node-id 0 --port 3001 --topology /nix/store/g8fb0sjaq39dbxnvv35dqcwafgvc26vx-topology.yaml --log-config /nix/store/jw29jyvvzdfdwccdc96qckwjbywva6c5-log-configuration.yaml
[iohk.cardano.node.CoreId 0:Debug:4] [2019-09-11 20:17:43.67 UTC] tracing verbosity = normal
[iohk.cardano.node.CoreId 0:Debug:4] [2019-09-11 20:17:44.14 UTC] System started at SystemStart {getSystemStart = 2017-09-23 21:44:51 UTC}

See: https://fedoramagazine.org/systemd-template-unit-files/ Signed-off-by: Kosyrev Serge <serge.kosyrev@iohk.io>

deepfire · 2019-09-24T18:34:17Z

bors r+

177: Cardano cluster, on-fly genesis, Chairman service & NixOS test r=deepfire a=deepfire 1. Turn the `cardano-node.service` into instanced set of `cardano-node@NODE-ID.service`, systemd-unit-wise 2. Define a `cardano-cluster` target. 3. Generate genesis on fly for the cluster. 4. Chairman service, with a factored script generator.. 5. Chairman's cluster NixOS test. Co-authored-by: Kosyrev Serge <serge.kosyrev@iohk.io>

deepfire added the WIP Work In Progress (cannot be merged yet) label Sep 6, 2019

deepfire changed the base branch from master to serge/cli-cleanup-further September 6, 2019 17:26

disassembler approved these changes Sep 6, 2019

View reviewed changes

disassembler self-requested a review September 6, 2019 17:37

deepfire force-pushed the serge/cardano-cluster-service branch from af44a71 to 354c6db Compare September 6, 2019 20:18

deepfire force-pushed the serge/cli-cleanup-further branch from 6ae275e to 549e5d8 Compare September 10, 2019 15:19

deepfire force-pushed the serge/cardano-cluster-service branch 3 times, most recently from 466b231 to d364119 Compare September 10, 2019 17:24

deepfire marked this pull request as ready for review September 10, 2019 17:26

deepfire removed the WIP Work In Progress (cannot be merged yet) label Sep 10, 2019

deepfire force-pushed the serge/cardano-cluster-service branch 3 times, most recently from 326244e to 7d998a6 Compare September 10, 2019 18:06

deepfire requested a review from cleverca22 September 10, 2019 18:09

disassembler requested changes Sep 10, 2019

View reviewed changes

deepfire force-pushed the serge/cli-cleanup-further branch 7 times, most recently from 77a0555 to e17765d Compare September 11, 2019 19:43

deepfire changed the base branch from serge/cli-cleanup-further to master September 11, 2019 20:51

deepfire force-pushed the serge/cardano-cluster-service branch 3 times, most recently from d511894 to 4764ea5 Compare September 12, 2019 16:02

deepfire force-pushed the serge/cardano-cluster-service branch 14 times, most recently from d8e322c to b6f7d41 Compare September 23, 2019 13:56

deepfire requested a review from disassembler September 24, 2019 17:43

cleverca22 approved these changes Sep 24, 2019

View reviewed changes

deepfire added 7 commits September 24, 2019 21:23

cardno-node-service: convert to instanced style

28d883a

See: https://fedoramagazine.org/systemd-template-unit-files/ Signed-off-by: Kosyrev Serge <serge.kosyrev@iohk.io>

cardano-cluster-service: a flock of cardano-node@NODE-ID services

3fc50b9

nix: chairman service

f4a6307

scripts | chairman: nix-build -A scripts.mainnet.chairman

4807e2e

chairman's cluster: a NixOS test

a6fc35c

tests: disable the edge test, since it's subsumed by chairman

c0c56f8

node service: add a TODO regarding systemd/sd_notify integration

29b047e

deepfire force-pushed the serge/cardano-cluster-service branch from b6f7d41 to 29b047e Compare September 24, 2019 18:29

iohk-bors bot merged commit 29b047e into master Sep 25, 2019

iohk-bors bot deleted the serge/cardano-cluster-service branch September 25, 2019 08:07

coot mentioned this pull request Sep 26, 2019

Run a small demo cluster on CI together with chairman application #106

Closed

4 tasks

deepfire mentioned this pull request Sep 26, 2019

Cluster-based tests #211

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cardano cluster, on-fly genesis, Chairman service & NixOS test #177

Cardano cluster, on-fly genesis, Chairman service & NixOS test #177

deepfire commented Sep 6, 2019 •

edited

Loading

disassembler left a comment

disassembler Sep 6, 2019

deepfire Sep 6, 2019

deepfire Sep 10, 2019 •

edited

Loading

disassembler Sep 6, 2019

deepfire Sep 6, 2019

deepfire Sep 10, 2019

deepfire commented Sep 6, 2019

disassembler commented Sep 10, 2019

disassembler left a comment

deepfire commented Sep 11, 2019 •

edited

Loading

deepfire commented Sep 24, 2019

Cardano cluster, on-fly genesis, Chairman service & NixOS test #177

Cardano cluster, on-fly genesis, Chairman service & NixOS test #177

Conversation

deepfire commented Sep 6, 2019 • edited Loading

disassembler left a comment

Choose a reason for hiding this comment

disassembler Sep 6, 2019

Choose a reason for hiding this comment

deepfire Sep 6, 2019

Choose a reason for hiding this comment

deepfire Sep 10, 2019 • edited Loading

Choose a reason for hiding this comment

disassembler Sep 6, 2019

Choose a reason for hiding this comment

deepfire Sep 6, 2019

Choose a reason for hiding this comment

deepfire Sep 10, 2019

Choose a reason for hiding this comment

deepfire commented Sep 6, 2019

disassembler commented Sep 10, 2019

disassembler left a comment

Choose a reason for hiding this comment

deepfire commented Sep 11, 2019 • edited Loading

deepfire commented Sep 24, 2019

deepfire commented Sep 6, 2019 •

edited

Loading

deepfire Sep 10, 2019 •

edited

Loading

deepfire commented Sep 11, 2019 •

edited

Loading