New Fedimint Docker Downloader #5043

Kodylow · 2024-04-19T23:07:43Z

New Fedimint Downloader, currently points at this branch if you want to try testing it with:

curl -sSL https://raw.githubusercontent.com/Kodylow/fedimint/kl/docker-deploy/docker/downloader.sh | bash

Works for Fedimint Guardians and Gateways on mutinynet and mainnet (couldn't get the testnet one working but can be a follow on)

TonyGiorgio · 2024-04-23T16:50:20Z

docker/downloader.sh

+  esac
+done
+
+DOCKER_COMPOSE_FILE="https://raw.githubusercontent.com/Kodylow/fedimint/kl/docker-deploy/docker/latest/${INSTALL_TYPE}/${TLS_DIR}/docker-compose.yaml"


nit: reminder to switch it back to fedimint right before merging

tracking ty

docker/gateway/tls/docker-compose.yaml

docker/guardian/tls/docker-compose.yaml

docker/gateway/tls/docker-compose.yaml

docker/guardian/tls/docker-compose.yaml

docker/tls-download-mutinynet.sh

TonyGiorgio · 2024-04-23T17:00:43Z

Some minor things I have noticed. I like the structure of the new script. I still need to play around with it to double check the various scenarios.

TonyGiorgio · 2024-05-04T22:24:33Z

I ran this and it went into an infinite loop at the beginning.

Kodylow · 2024-05-05T00:28:37Z

are you running it from inside another docker container or something? just retried locally and worked on my mac and nix boxes fine. it's looping for all the configurations to require your input match one of the enum options, if you're running as a background or outside an interactive shell that might be causing it?

TonyGiorgio · 2024-05-05T01:01:46Z

I'm running it in a digital ocean shell

Kodylow · 2024-05-05T01:17:01Z

This one works, might have to remove the loop checking then, piping into bash directly doesn't start interactive, was just running the downloader.sh not the curl script,

curl -sSL https://raw.githubusercontent.com/Kodylow/fedimint/kl/docker-deploy/docker/downloader.sh > downloader.sh && chmod +x downloader.sh && ./downloader.sh

TonyGiorgio · 2024-05-05T01:20:04Z

Neither of those work. Doing it from my own terminal instance through ssh doesn't work either.

Kodylow · 2024-05-05T01:39:32Z

@TonyGiorgio sorry I'm an idiot just had to move the echo out of the loop in a couple places, fixed

TonyGiorgio · 2024-05-05T01:43:19Z

right after typing the first yes

Kodylow · 2024-05-05T01:49:39Z

1 more time, missing </dev/tty

TonyGiorgio · 2024-05-05T01:51:27Z

After saying yes to the alpha disclaimer

TonyGiorgio · 2024-05-05T02:24:26Z

docker/downloader.sh

+    echo "Do you want to setup an xmpp chat server on this instance? [yes/no]"
+    while true; do
+      read -r -n 1 -p "Your choice (yes/no): " choice </dev/tty
+      echo
+      case $choice in
+      y | Y)
+        SETUP_XMPP=true
+        break
+        ;;
+      n | N)
+        SETUP_XMPP=false
+        # remove xmpp service from services list
+        SERVICES=$(echo $SERVICES | sed -e 's/xmpp//g')
+        # remove xmpp meta from fedimintd setup
+        sed -i '/FM_EXTRA_DKG_META=chat_server_domain=xmpp.fedimint.my-super-host.com/d' $path
+        # remove xmpp section from docker-compose.yaml
+        sed -i '/### START_XMPP ###/,/### END_XMPP ###/d' $path
+        # remove prosody volume from docker-compose.yaml
+        sed -i '/prosody_datadir:/d' $path
+        break
+        ;;
+      *)
+        echo "Invalid option. Please type 'yes' or 'no'."
+        ;;
+      esac
+    done


nit: you're asking for 'yes' or 'no' like you do the rest, but you're accepting y or 'n' instead. Causing issues when the user is typing yes fast and it goes ahead and starts filling in the next prompt.

TonyGiorgio · 2024-05-05T03:37:26Z

docker/downloader.sh

+    read -p "Enter the Esplora URL you'd like to use to get $NETWORK_TYPE blockdata from, or click enter to use the network default: [$DEFAULT_ESPLORA_URL]: " ESPLORA_URL </dev/tty
+    ESPLORA_URL=${ESPLORA_URL:-$DEFAULT_ESPLORA_URL}
+    echo "Using Esplora URL: $ESPLORA_URL"
+
+    # Set the esplora URL in the docker-compose file
+    sed -i "s|FM_BITCOIN_RPC_URL=https://blockstream.info/api/|FM_BITCOIN_RPC_URL=$ESPLORA_URL|" ./docker-compose.yaml
+
+    # Set the bitcoin network in the docker-compose file if not mutinynet default
+    if [ "$NETWORK_TYPE" != "mutinynet" ]; then
+      sed -i "s|FM_BITCOIN_NETWORK=signet|FM_BITCOIN_NETWORK=$NETWORK_TYPE|" ./docker-compose.yaml
+    fi
+
+  else # Using Bitcoin Node for Guardian blockchain data
+    echo "You will need to provide the Bitcoin Node RPC URL to get blockchain data."
+    read -p "Enter the RPC URL for your Bitcoin node (ex. https://mynode.m.voltageapp.io:8332): " -a bitcoin_rpc_url </dev/tty
+    if [[ -z ${bitcoin_rpc_url[*]} ]]; then
+      echo 'Error: You must set a Bitcoin RPC URL if you configure the guardian with an existing Bitcoin node' >&2
+      exit 1
+    fi
+    echo "Using Bitcoin RPC URL: $bitcoin_rpc_url"
+
+    # Set the bitcoin RPC URL in the docker-compose file
+    sed -i "s|FM_BITCOIN_RPC_URL=https://blockstream.info/api/|FM_BITCOIN_RPC_URL=$bitcoin_rpc_url|" ./docker-compose.yaml
+  fi
+fi


Going through the esplora flow still launches the bitcoind docker container and starts syncing the chain. I think you should probably strip out or insert the bitcoind part of the docker-compose.yaml file based on the results here.

TonyGiorgio · 2024-05-05T03:41:09Z

docker/downloader.sh

+    if [ "$NETWORK_TYPE" != "mutinynet" ]; then
+      sed -i "s|FM_BITCOIN_NETWORK=signet|FM_BITCOIN_NETWORK=$NETWORK_TYPE|" ./docker-compose.yaml
+    fi


for mainnet, it's bitcoin I believe, not mainnet. I'm getting this:

root-fedimintd-1 | For more information, try '--help'. root-fedimintd-1 | Starting fedimintd root-fedimintd-1 | error: invalid value 'mainnet' for '--network <NETWORK>': Unknown network (type mainnet)

Kodylow requested review from a team as code owners April 19, 2024 23:07

TonyGiorgio requested changes Apr 23, 2024

View reviewed changes

TonyGiorgio reviewed Apr 23, 2024

View reviewed changes

docker/tls-download-mutinynet.sh Outdated Show resolved Hide resolved

Kodylow force-pushed the kl/docker-deploy branch 2 times, most recently from dcea8b7 to 53c238f Compare April 24, 2024 07:31

Kodylow force-pushed the kl/docker-deploy branch from 53c238f to 492212b Compare May 5, 2024 00:21

Kodylow force-pushed the kl/docker-deploy branch 2 times, most recently from f40f81b to b0e527d Compare May 5, 2024 01:29

Kodylow force-pushed the kl/docker-deploy branch 2 times, most recently from dc232fd to 4d44b98 Compare May 5, 2024 01:48

Kodylow force-pushed the kl/docker-deploy branch from 4d44b98 to 2bd2fe9 Compare May 5, 2024 01:56

Kodylow marked this pull request as draft May 5, 2024 01:57

Kodylow force-pushed the kl/docker-deploy branch 3 times, most recently from be52144 to 4ec20fa Compare May 5, 2024 02:03

TonyGiorgio reviewed May 5, 2024

View reviewed changes

elsirion mentioned this pull request May 16, 2024

feat: minimal mainnet fedimintd docker setup #5042

Merged

Kodylow force-pushed the kl/docker-deploy branch from 4ec20fa to 2b67f96 Compare May 17, 2024 16:36

TonyGiorgio and others added 13 commits May 17, 2024 18:22

v0.2.2 mainnet scripts

b17eaf4

Update for 0.3.0 and include xmpp by default

92c52e5

feat: new downloader

e851fef

fix: remove traefik for no tls

52979ad

chore: bump 0.3.0

12b6793

fix: add instructions

a7107c1

fix: docker compose link

495b574

fix: tony nits

1d93c6d

fix: xmpp back in

a197f56

fix: require interactive shell

4e9fea6

fix: fix

21c9cd7

fix: move echos out of loop

1d756da

fix: final tony nits

92810ca

Kodylow force-pushed the kl/docker-deploy branch from 2b67f96 to 92810ca Compare May 18, 2024 01:22

fix: downloader

5e73dd0

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

New Fedimint Docker Downloader #5043

New Fedimint Docker Downloader #5043

Kodylow commented Apr 19, 2024

TonyGiorgio Apr 23, 2024

Kodylow Apr 23, 2024

TonyGiorgio commented Apr 23, 2024

TonyGiorgio commented May 4, 2024

Kodylow commented May 5, 2024

TonyGiorgio commented May 5, 2024

Kodylow commented May 5, 2024 •

edited

TonyGiorgio commented May 5, 2024

Kodylow commented May 5, 2024

TonyGiorgio commented May 5, 2024 •

edited

Kodylow commented May 5, 2024 •

edited

TonyGiorgio commented May 5, 2024

TonyGiorgio May 5, 2024

TonyGiorgio May 5, 2024

TonyGiorgio May 5, 2024

New Fedimint Docker Downloader #5043

Are you sure you want to change the base?

New Fedimint Docker Downloader #5043

Conversation

Kodylow commented Apr 19, 2024

TonyGiorgio Apr 23, 2024

Choose a reason for hiding this comment

Kodylow Apr 23, 2024

Choose a reason for hiding this comment

TonyGiorgio commented Apr 23, 2024

TonyGiorgio commented May 4, 2024

Kodylow commented May 5, 2024

TonyGiorgio commented May 5, 2024

Kodylow commented May 5, 2024 • edited

TonyGiorgio commented May 5, 2024

Kodylow commented May 5, 2024

TonyGiorgio commented May 5, 2024 • edited

Kodylow commented May 5, 2024 • edited

TonyGiorgio commented May 5, 2024

TonyGiorgio May 5, 2024

Choose a reason for hiding this comment

TonyGiorgio May 5, 2024

Choose a reason for hiding this comment

TonyGiorgio May 5, 2024

Choose a reason for hiding this comment

Kodylow commented May 5, 2024 •

edited

TonyGiorgio commented May 5, 2024 •

edited

Kodylow commented May 5, 2024 •

edited