[Discussion] installing c-lightning: need some help #857

real-doman · 2021-12-27T22:32:58Z

What & why

Add installation of c-lightning to give have more choises on which LN implementation you want to use on your raspibolt
I don't know if this should be a part of the bonus section or if it should be put elsewhere

I am far from being a system expert, nevertheless I started the guide.

The current guide is still in progress, because I run into an issue while the initial setup. You can find the draft guide here

I have tried to install c-lightning on the raspibolt, but unfortunately I don't get it running properly. To get an idea of the installation process I used the raspiblitz c-lightning installation file

The installation worked well for me, but I have troubles with the config file. When I try to run c-lightning for the first time I get a permisson error:

$ lightningd --conf=/data/lightningd/config
> lightning_connectd: Could not open Tor cookie file '/run/tor/control.authcookie': Permission denied (version 0.10.2)
> 0x557b311ae3 send_backtrace
        common/daemon.c:33
> 0x557b317e73 status_failed
        common/status.c:209
> 0x557b30db03 negotiate_auth
        connectd/tor_autoservice.c:260
> 0x557b30e2e7 tor_fixed_service
        connectd/tor_autoservice.c:350
> 0x557b308d7f setup_listeners
        connectd/connectd.c:1427
> 0x557b309017 connect_init
        connectd/connectd.c:1512
> 0x557b30ab4f recv_req
        connectd/connectd.c:1921
> 0x557b311c73 handle_read
        common/daemon_conn.c:30
> 0x557b348903 next_plan
        ccan/ccan/io/io.c:59
> 0x557b348edb do_plan
        ccan/ccan/io/io.c:407
> 0x557b348f9b io_ready
        ccan/ccan/io/io.c:417
> 0x557b34ae9b io_loop
        ccan/ccan/io/poll.c:453
> 0x557b30b1f3 main
        connectd/connectd.c:2006
> 0x7fbdd64217 ???
        ???:0
> 0x557b305647 ???
        ???:0
>  ightningd: connectd failed (exit status 242), exiting.

My cl user is part of the debian-tor group and should have read permisson. So I don't know why the permisson is denied :(

The text was updated successfully, but these errors were encountered:

VajraOfIndra · 2021-12-29T18:25:07Z

Great initiative, it'd be awesome to have a guide for c-lightning (and later related add-ons) somewhere in the guide. The bonus section seems the easiest choice for now. If it were to become part of the main guide we would probably have to think about to deal with the split between LND and c-lightning... dual-install? (probably unnecessary for most users), either-or choice (nice but requires a very clear presentation to avoid risks of confusion for new users..). Anyways, just my 2 sats, looking forward to hear what others have to say! :)

The current guide is still in progress, because I run into an issue while the initial setup. You can find the draft guide here

Nice! I'll give it a try in the next few days/weeks.

The installation worked well for me, but I have troubles with the config file. When I try to run c-lightning for the first time I get a permisson error:

Could it be because you run lightningd with the "admin" user? (based on the end of your guide). The "admin" user is not part of the "debian-tor" group so wouldn't be able to read the cookie. Do you get the same error if you run lightningd with the cl user?

openoms · 2022-01-05T20:50:59Z

I run the ligthningd.service and keep plugins, config etc. under the bitcoin user, the same running lnd and bitcoind.
It might work your way, but surely would need to run lightningd as the cl user.
CL needs access to bitcoin-cli and the Tor cookie as well.
The bitcoin-cli access with a different group can be problematic because its default dir (and conf) would need to be specified, but you will see this in a later step.

For the the Tor cookie auth check in your /etc/tor/torrc if the lines:

CookieAuthentication 1
CookieAuthFileGroupReadable 1

are present.

openoms · 2022-02-21T20:04:51Z

@real-doman did you get c-lightning working yet? Would be really good to see a guide on this, would be happy to contribute.

real-doman · 2022-02-22T12:29:19Z

@openoms no. I gave the installation a new try and updated the guide a bit.
To get an idea about all of this I am using the c-lightning install script from raspiblitz. At that part an error is thrown. Can I create this file manually somehow or why is the file even missing?

(edit: My error (output) can be found in the guide)

openoms · 2022-02-22T20:15:06Z

unfortunately the error you ran into is because you are installing from the zip file. This will be sorted for the next CL release, but until then install from source. See: raspiblitz/raspiblitz#2936 and ElementsProject/lightning#4962 (comment)
I will probably stick to installing from the source anyway as it is easier to update to the latest commits or PRs from it.

real-doman · 2022-02-24T15:23:07Z

Thats sad, because I am more familiar with this way. I can stick to the current lnd installation guide more easily. How ever, I tried to clone the repository now, unfortunately the error still appears.

And for now I skipped the verification part because I don't know exactly how to do so :(

ElementsProject/lightning#4962 (comment)

I looked into it and did these steps in my guide aswell:

$ git reset --hard v0.10.2
> HEAD is now at 12689674c doc: Update CHANGELOG.md for v0.10.2 release

$ pip3 install --user ./contrib/pyln-client

The "missing file" error is fixed, but I got a new one now :/

real-doman · 2022-02-25T19:47:41Z

I was able to fix my issues and afaik the installation of c-lightning was successful.
My guide would continue with the first manual start of c-lightning, but I am not familiar with all of the commands, so I would need help for this part.

For now the verification process is still missing in my guide. that needs to be added aswell.

kendricng · 2022-03-08T02:15:51Z

@real-doman It seems like I am getting some permission errors when trying to run lightningd. See below:

cl@raspibolt:~ $ lightningd --conf=/data/lightning/config
error starting plugin '/home/cl/.lightning/plugins/bcli': opening pipe: Permission denied

How can I trace where the permissions are breaking down? It seems like I'm not able to open the config file. I tried changing the file ownership using sudo chown but that also didn't work.

admin@raspibolt:~ $ ls -al /data/lightning/plugins
-rwxr-xr-x  1 cl cl 3062192 Mar  8 01:52 bcli

admin@raspibolt:~ $ ls -al /data/lightning
-rw-r--r--  1 cl      cl         227 Mar  8 02:12 config

openoms · 2022-03-08T18:12:54Z

@kendricng
run ls -al /data/.lightning/plugins with the cl user to test. Fix the permissions of the upstream directories also if there is an issue.
bcli needs bitcoin-cli afaik so make sure the cl user can start bitcoin-cli as well.

Will probably need to symlink the bitcoin direcrory to the default path in cl to appear as:
/home/cl/.bitcoin
the bitcoin directory also needs to be group readable and cl to be part of the group bitcoin.

In the raspiblitz we kept C-lightning under the bitcoin user to prevent these issues.

kendricng · 2022-03-10T14:45:00Z

@openoms This is what I found when running ls -al /data/lightning:

cl@raspibolt:~ $ ls -al /data/lightning
total 2092
drwxr-xr-x 25 cl cl   4096 Mar 10 14:36 .
drwxr-xr-x  8 cl cl   4096 Mar  8 02:01 ..
-rw-r--r--  1 cl cl    161 Mar  8 01:43 action.yml
drwxr-xr-x  3 cl cl   4096 Mar  8 02:03 bitcoin
drwxr-xr-x  5 cl cl   4096 Mar  8 01:44 ccan
-rw-r--r--  1 cl cl   2512 Mar  8 01:44 ccan-asort.o
...
-rw-r--r--  1 cl cl   8224 Mar  8 01:44 ccan-utf8.o
-rw-r--r--  1 cl cl 117742 Mar  8 01:43 CHANGELOG.md
drwxr-xr-x  3 cl cl   4096 Mar  8 01:49 channeld
-rw-r--r--  1 cl cl    141 Mar  8 01:43 .clang-format
drwxr-xr-x  3 cl cl   4096 Mar  8 01:51 cli
drwxr-xr-x  2 cl cl   4096 Mar  8 01:49 closingd
drwxr-xr-x  3 cl cl  12288 Mar  8 01:52 common
-rw-r--r--  1 cl cl    227 Mar 10 14:36 config
-rwxr-xr-x  1 cl cl  12891 Mar  8 01:43 configure
-rw-r--r--  1 cl cl   2250 Mar  8 01:44 config.vars
drwxr-xr-x  3 cl cl   4096 Mar  8 01:49 connectd
drwxr-xr-x 13 cl cl   4096 Mar  8 01:43 contrib
drwxr-xr-x  2 cl cl   4096 Mar  8 01:52 devtools
-rw-r--r--  1 cl cl    193 Mar  8 01:43 .dir-locals.el
drwxr-xr-x  4 cl cl  12288 Mar  8 01:57 doc
-rw-r--r--  1 cl cl   4438 Mar  8 01:43 Dockerfile
-rw-r--r--  1 cl cl    316 Mar  8 01:43 .editorconfig
drwxr-xr-x  9 cl cl   4096 Mar  8 01:45 external
drwxr-xr-x  9 cl cl   4096 Mar  8 01:58 .git
-rw-r--r--  1 cl cl    483 Mar  8 01:43 .gitattributes
drwxr-xr-x  4 cl cl   4096 Mar  8 01:43 .github
-rw-r--r--  1 cl cl    946 Mar  8 01:43 .gitignore
-rw-r--r--  1 cl cl   1418 Mar  8 01:43 .gitlab-ci.yml
-rw-r--r--  1 cl cl    665 Mar  8 01:43 .gitmodules
drwxr-xr-x  3 cl cl   4096 Mar  8 01:48 gossipd
-rw-r--r--  1 cl cl   1365 Mar  8 01:47 header_versions_gen.h
drwxr-xr-x  2 cl cl   4096 Mar  8 01:47 hsmd
-rw-r--r--  1 cl cl   1208 Mar  8 01:43 LICENSE
lrwxrwxrwx  1 cl cl     15 Mar  8 02:38 lightning -> /data/lightning
drwxr-xr-x  3 cl cl   4096 Mar  8 01:51 lightningd
-rw-r--r--  1 cl cl  33549 Mar  8 01:43 Makefile
drwxr-xr-x  3 cl cl   4096 Mar  8 01:49 onchaind
drwxr-xr-x  2 cl cl   4096 Mar  8 01:49 openingd
drwxr-xr-x  4 cl cl   4096 Mar  8 01:53 plugins
-rw-r--r--  1 cl cl  11801 Mar  8 01:43 README.md
-rw-r--r--  1 cl cl   3471 Mar  8 01:43 requirements.lock
-rw-r--r--  1 cl cl    260 Mar  8 01:43 requirements.txt
drwxr-xr-x  6 cl cl   4096 Mar  8 01:43 tests
drwxr-xr-x  4 cl cl   4096 Mar  8 01:58 tools
-rw-r--r--  1 cl cl     52 Mar  8 01:47 version_gen.h
drwxr-xr-x  3 cl cl   4096 Mar  8 01:51 wallet
drwxr-xr-x  3 cl cl   4096 Mar  8 01:53 wire

Will I need to recursively change access to 755 (i.e. rwxr-xr-x)? I think what happened was that I installed c-lightning using admin first, mv to /data/lightning and then did the symlink.

Checked bitcoin-cli and the symlinks and I think they're good:

cl@raspibolt:~ $ bitcoin-cli --version
Bitcoin Core RPC client version v22.0.0

cl@raspibolt:~ $ ls -al
lrwxrwxrwx 1 cl   cl     13 Mar  8 02:41 .bitcoin -> /data/bitcoin
lrwxrwxrwx 1 cl   cl     15 Mar  8 02:42 .lightning -> /data/lightning

cl@raspibolt:~ $ ls -al /data
drwxr-xr-x  5 cl   cl    4096 Mar 10 14:13 bitcoin
drwxr-xr-x 25 cl   cl    4096 Mar 10 14:36 lightning

Quickly: I can seem to run lightning-cli but not lightningd. Might help:

cl@raspibolt:~ $ lightning-cli --version
v0.10.2
cl@raspibolt:~ $ lightningd --conf=/data/lightning/config
error starting plugin '/home/cl/.lightning/plugins/bcli': opening pipe: Permission denied

openoms · 2022-03-10T14:46:50Z

@kendricng be aware of the dot front of .lightning

kendricng · 2022-03-10T14:49:11Z

@openoms Yup. I'm aware. Also double checking the Raspibolt guide that I followed when I initially installed bitcoin and lnd and they didn't have the dots in front of them as well.

https://raspibolt.org/guide/lightning/lightning-client.html

openoms · 2022-03-10T14:52:54Z

LND has nothing to do with this.
the lightning directory has the source code from which the binaries are built.
the .lightning contains the C-lightning data like the hsm_secret , lightning.sqlite3 and config file.

kendricng · 2022-03-10T15:08:08Z

I understand. What I mean is that I mirrored the guide from Raspibolt from the instructions there and followed @real-doman 's test guide for c-lightning here.

https://github.com/real-doman/RaspiBolt/blob/c-lightning/c-lightning.md

I don't see the .lightning directory in this version so am not sure where the C-lightning data would be stored. Because for some reason I don't have the .lightning set up:

cl@raspibolt:~ $ ls -al /data/.lightning
ls: cannot access '/data/.lightning': No such file or directory

Edit: It makes sense now. I went through the symlinking again using ./lightning and it works now. Thanks for your patience @openoms.

@real-doman I'll probably propose a few tweaks to your guide so it points properly.

kendricng · 2022-03-10T15:25:21Z

@real-doman in the Data Directory portion of your guide, instead of moving over the binary files for cl to the new file, I would just create a new directory and use that to symlink, a la (from the Raspiblitz shell file):

admin@raspibolt:~ $ sudo rm -rf /home/cl/.lightning
admin@raspibolt:~ $ sudo mkdir -p /data/.lightning
admin@raspibolt:~ $ sudo ln -s /data/.lightning /home/cl
admin@raspibolt:~ $ sudo chown -R cl:cl /data/.lightning
admin@raspibolt:~ $ sudo chown -R cl:cl /home/cl
admin@raspibolt:~ $ ln -s /data/.lightning /home/admin/.lightning

I propose this change because the cl user didn't know how to access the files needed to run lightningd and hence I was getting Permission Denied errors.

real-doman · 2022-03-10T15:40:58Z

I propose this change because the cl user didn't know how to access the files needed to run lightningd and hence I was getting Permission Denied errors.

Agree, that part needs to be changed. Using mv command feels a bit strange for me aswell.

But I can't say anything to the permisson denied errors... For me the guide worked if I run everything in exactly same order as in the guide. I don't run into permisson denied error on my raspibolt for some reason.

openoms · 2022-04-04T17:58:27Z

did a cleaned script with which you can run line by line and use for reference to install CLN on raspibolt: https://gist.github.com/openoms/ef2d71f98d0f6ee6441e91f840b89e4c
note it was not tested, but should work as quickly changed the user and paths to the raspibolt environment
can also comment below
feel free to use it to start a new guide or correct the one already there

For example simplified the symlinks I would use:

# Store the lightning data in /data and symlink to /home/cl/"
sudo rm -rf /home/cl/.lightning # not a symlink, delete
sudo mkdir -p /data/.lightning
sudo ln -s /data/.lightning /home/cl/

# Create a symbolic link, which points from your admin home directory into the lightning directory
sudo ln -s /data/.lightning /home/admin/

then there are things like:

git verification
creating an hsm_secret from seed
systemd service
setting up the backup plugin
hsm_secret encryption

which are automated in the raspiblitz and can be tackled one by one after the basic installation is working.

openoms · 2022-04-05T08:23:24Z

@real-doman I would suggest to open a PR on to the raspibolt repo (can make it a draft until it is ready to be merged) then your guide becomes visible, people can review, comment on the code and will get there soon

openoms · 2022-04-10T08:11:34Z

Note the introduction of poetry for the pyhton depandencies and other changes: https://github.com/ElementsProject/lightning/blob/master/doc/INSTALL.md#to-build-on-ubuntu

The install script will need to be refactored, see changes in: raspiblitz/raspiblitz#3054

openoms · 2022-05-02T17:29:13Z

note #1005 fixes this so can be closed

VajraOfIndra · 2022-05-03T08:01:14Z

Fixed with #1005, will now close the Issue.

real-doman added the support Help, I'm stuck somehow label Dec 27, 2021

VajraOfIndra closed this as completed May 3, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Discussion] installing c-lightning: need some help #857

[Discussion] installing c-lightning: need some help #857

real-doman commented Dec 27, 2021

VajraOfIndra commented Dec 29, 2021

openoms commented Jan 5, 2022 •

edited

openoms commented Feb 21, 2022

real-doman commented Feb 22, 2022 •

edited

openoms commented Feb 22, 2022 •

edited

real-doman commented Feb 24, 2022 •

edited

real-doman commented Feb 25, 2022

kendricng commented Mar 8, 2022

openoms commented Mar 8, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

openoms commented Mar 10, 2022

kendricng commented Mar 10, 2022 •

edited

openoms commented Mar 10, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

real-doman commented Mar 10, 2022

openoms commented Apr 4, 2022 •

edited

openoms commented Apr 5, 2022

openoms commented Apr 10, 2022

openoms commented May 2, 2022

VajraOfIndra commented May 3, 2022

[Discussion] installing c-lightning: need some help #857

[Discussion] installing c-lightning: need some help #857

Comments

real-doman commented Dec 27, 2021

What & why

VajraOfIndra commented Dec 29, 2021

openoms commented Jan 5, 2022 • edited

openoms commented Feb 21, 2022

real-doman commented Feb 22, 2022 • edited

openoms commented Feb 22, 2022 • edited

real-doman commented Feb 24, 2022 • edited

real-doman commented Feb 25, 2022

kendricng commented Mar 8, 2022

openoms commented Mar 8, 2022 • edited

kendricng commented Mar 10, 2022 • edited

openoms commented Mar 10, 2022

kendricng commented Mar 10, 2022 • edited

openoms commented Mar 10, 2022 • edited

kendricng commented Mar 10, 2022 • edited

kendricng commented Mar 10, 2022 • edited

real-doman commented Mar 10, 2022

openoms commented Apr 4, 2022 • edited

openoms commented Apr 5, 2022

openoms commented Apr 10, 2022

openoms commented May 2, 2022

VajraOfIndra commented May 3, 2022

openoms commented Jan 5, 2022 •

edited

real-doman commented Feb 22, 2022 •

edited

openoms commented Feb 22, 2022 •

edited

real-doman commented Feb 24, 2022 •

edited

openoms commented Mar 8, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

openoms commented Mar 10, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

kendricng commented Mar 10, 2022 •

edited

openoms commented Apr 4, 2022 •

edited