Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote Backup Fails if both backup and remote system have the same hostname #117

Closed
Dar1in9s opened this issue Jun 28, 2023 · 14 comments
Closed
Labels
environment problems probably environment related support Usage/support questions.

Comments

@Dar1in9s
Copy link

Version used
1.9.26

Describe the bug
root@ubuntu:/tmp# virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test -l full -o /tmp/back/
[2023-06-28 03:58:57] INFO lib common - printVersion [MainThread]: Version: 1.9.26 Arguments: /usr/local/bin/virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test -l full -o /tmp/back/
[2023-06-28 03:58:57] INFO root virtnbdbackup - main [MainThread]: Backup level: [full]
root@192.168.207.167's password:
[2023-06-28 03:58:58] INFO root virtnbdbackup - main [MainThread]: Libvirt library version: [8000000]
[2023-06-28 03:58:58] INFO root disktype - Optical [MainThread]: Skipping attached [cdrom] device: [sda].
[2023-06-28 03:58:58] INFO root virtnbdbackup - main [MainThread]: Backup will save [1] attached disks.
[2023-06-28 03:58:58] INFO root virtnbdbackup - main [MainThread]: Concurrent backup processes: [1]
[2023-06-28 03:58:58] INFO root checkpoint - redefine [MainThread]: Loading checkpoint list from: [/tmp/back//checkpoints]
[2023-06-28 03:58:58] INFO root checkpoint - create [MainThread]: Checkpoint handling.
[2023-06-28 03:58:58] INFO root checkpoint - create [MainThread]: Using checkpoint name: [virtnbdbackup.0].
[2023-06-28 03:58:58] INFO root virtnbdbackup - main [MainThread]: Local NBD Endpoint socket: [/var/tmp/virtnbdbackup.3327]
[2023-06-28 03:58:58] INFO root virtnbdbackup - main [MainThread]: Temporary scratch file target directory: [/var/tmp]
[2023-06-28 03:58:58] INFO root virtnbdbackup - startBackupJob [MainThread]: Starting backup job.
[2023-06-28 03:58:58] WARNING fs fs - freeze [MainThread]: Guest agent is not responding: QEMU guest agent is not connected
[2023-06-28 03:58:58] INFO root virtnbdbackup - main [MainThread]: Started backup job with checkpoint, saving information.
[2023-06-28 03:58:58] INFO root checkpoint - backup [MainThread]: Saving checkpoint config to: [/tmp/back//checkpoints/virtnbdbackup.0.xml]
[2023-06-28 03:58:58] INFO nbd client - printVersion [vda]: libnbd version: 1.10.5
[2023-06-28 03:58:58] INFO nbd client - connect [vda]: Waiting until NBD server at [nbd+unix:///vda?socket=/var/tmp/virtnbdbackup.3327] is up.
[2023-06-28 03:58:59] INFO nbd client - connect [vda]: Waiting for NBD Server, Retry: 0
[2023-06-28 03:58:59] ERROR root virtnbdbackup - main [MainThread]: Disk backup failed: [NBD endpoint: [Unix(exportName='vda', metaContext='', backupSocket='/var/tmp/virtnbdbackup.3327', tls=False)]: connection failed: [Unable to connect nbd server: nbd_connect_uri: connect: No such file or directory (ENOENT)]]
[2023-06-28 03:58:59] INFO root virtnbdbackup - main [MainThread]: Backup jobs finished, stopping backup task.
[2023-06-28 03:58:59] INFO root metadata - backupConfig [MainThread]: Saving VM config to: [/tmp/back//vmconfig.virtnbdbackup.0.xml]
[2023-06-28 03:58:59] ERROR libvirtnbdbackup.qemu.command command - run [MainThread]: CMD: qemu-img info /root/kvm/image/ubuntu.qcow2 --output json --force-share
[2023-06-28 03:58:59] WARNING root metadata - backupDiskInfo [MainThread]: Failed to read qcow image info: [Unable to start [qemu-img] error: [qemu-img: Could not open '/root/kvm/image/ubuntu.qcow2': Could not open '/root/kvm/image/ubuntu.qcow2': No such file or directory]]
[2023-06-28 03:58:59] ERROR root virtnbdbackup - main [MainThread]: Error during backup

Expected behavior
A clear and concise description of what you expected to happen.

Hypervisor information:

  • OS: ubuntu22.04
  • HV type: plain libvirt

Is there something wrong with the way I use it?

@Dar1in9s Dar1in9s added the bug Something isn't working label Jun 28, 2023
@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

[2023-06-28 03:58:57] INFO root virtnbdbackup - main [MainThread]: Backup level: [full]
root@192.168.207.167's password:

it asks for a password here, did you enter this password? It seems it is unable to connect to the remote via ssh and
attempts to execute an local backup, which of course wont work.

For remote backup to work, you must setup ssh-agent or passwordless ssh key to remote system and ssh user you are attempting to use.

@abbbi abbbi added support Usage/support questions. and removed bug Something isn't working labels Jun 28, 2023
@Dar1in9s
Copy link
Author

sure! It got my image path correctly: /root/kvm/image/ubuntu.qcow2, which means I entered the correct password

@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

is DNS resolution working for the IP specified in the Qemu URI?

it seems its not entering the code passage to execute remote backup at all, because it determines if remote backup is
attempted via dns lookup:

https://github.com/abbbi/virtnbdbackup/blob/master/libvirtnbdbackup/virt/client.py#L149

the informational logging its attempting to connect a remote host is missing entirely in your output.
Maybe it helps to diagnose this issue if you attempt to backup with debug loglevel (-v)

@Dar1in9s
Copy link
Author

is DNS resolution working for the IP specified in the Qemu URI?

it seems its not entering the code passage to execute remote backup at all, because it determines if remote backup is attempted via dns lookup:

https://github.com/abbbi/virtnbdbackup/blob/master/libvirtnbdbackup/virt/client.py#L149

the informational logging its attempting to connect a remote host is missing entirely in your output. Maybe it helps to diagnose this issue if you attempt to backup with debug loglevel (-v)

ubuntu@ubuntu:~$ virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test -l full -o /tmp/backup -v
[2023-06-28 05:28:20] INFO lib common - printVersion [MainThread]: Version: 1.9.26 Arguments: /usr/local/bin/virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test -l full -o /tmp/backup -v
[2023-06-28 05:28:20] INFO root virtnbdbackup - main [MainThread]: Backup level: [full]
[2023-06-28 05:28:20] DEBUG virt client - _connect [MainThread]: Libvirt URI: [qemu+ssh://root@192.168.207.167/system]
[2023-06-28 05:28:20] DEBUG virt client - _connect [MainThread]: Login information specified, connect libvirtd using openAuth function.
The authenticity of host '192.168.207.167 (192.168.207.167)' can't be established.
ED25519 key fingerprint is SHA256:hi3mwcr9Fw71Qpo4IgabZUGBQMWZ5egC/LzvhJup8l0.
This host key is known by the following other names/addresses:
~/.ssh/known_hosts:1: [hashed name]
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
root@192.168.207.167's password:
[2023-06-28 05:28:24] INFO root virtnbdbackup - main [MainThread]: Libvirt library version: [8000000]
[2023-06-28 05:28:24] DEBUG root checkpoint - _hasForeign [MainThread]: Found foreign checkpoint: [virtnbdbackup.0]
[2023-06-28 05:28:24] DEBUG root checkpoint - _hasForeign [MainThread]: Found foreign checkpoint: [virtnbdbackup.1]
[2023-06-28 05:28:24] DEBUG root checkpoint - _hasForeign [MainThread]: Found foreign checkpoint: [virtnbdbackup.2]
[2023-06-28 05:28:24] DEBUG virt client - getDomainDisks [MainThread]: Disk [vda]: file notation
[2023-06-28 05:28:24] INFO root disktype - Optical [MainThread]: Skipping attached [cdrom] device: [sda].
[2023-06-28 05:28:24] DEBUG virt client - getDomainDisks [MainThread]: Device list: [DomainDisk(target='vda', format='qcow2', filename='ubuntu.qcow2', path='/root/kvm/image/ubuntu.qcow2', backingstores=[])]
[2023-06-28 05:28:24] DEBUG virt client - getDomainInfo [MainThread]: No setting [loader] found: 'NoneType' object has no attribute 'text'
[2023-06-28 05:28:24] DEBUG virt client - getDomainInfo [MainThread]: No setting [nvram] found: 'NoneType' object has no attribute 'text'
[2023-06-28 05:28:24] DEBUG virt client - getDomainInfo [MainThread]: No setting [kernel] found: 'NoneType' object has no attribute 'text'
[2023-06-28 05:28:24] DEBUG virt client - getDomainInfo [MainThread]: No setting [initrd] found: 'NoneType' object has no attribute 'text'
[2023-06-28 05:28:24] DEBUG virt client - getDomainInfo [MainThread]: Domain Info: [{}]
[2023-06-28 05:28:24] INFO root virtnbdbackup - main [MainThread]: Backup will save [1] attached disks.
[2023-06-28 05:28:24] INFO root virtnbdbackup - main [MainThread]: Concurrent backup processes: [1]
[2023-06-28 05:28:24] INFO root checkpoint - redefine [MainThread]: Loading checkpoint list from: [/tmp/backup/checkpoints]
[2023-06-28 05:28:24] INFO root checkpoint - create [MainThread]: Checkpoint handling.
[2023-06-28 05:28:24] DEBUG root checkpoint - removeAll [MainThread]: Cleaning up persistent storage /tmp/backup/checkpoints
[2023-06-28 05:28:24] DEBUG root checkpoint - delete [MainThread]: Attempt to remove checkpoint: [virtnbdbackup.0]
[2023-06-28 05:28:24] DEBUG root checkpoint - delete [MainThread]: Removed checkpoint: [virtnbdbackup.0]
[2023-06-28 05:28:24] DEBUG root checkpoint - delete [MainThread]: Attempt to remove checkpoint: [virtnbdbackup.1]
[2023-06-28 05:28:24] DEBUG root checkpoint - delete [MainThread]: Removed checkpoint: [virtnbdbackup.1]
[2023-06-28 05:28:24] DEBUG root checkpoint - delete [MainThread]: Attempt to remove checkpoint: [virtnbdbackup.2]
[2023-06-28 05:28:24] DEBUG root checkpoint - delete [MainThread]: Removed checkpoint: [virtnbdbackup.2]
[2023-06-28 05:28:24] INFO root checkpoint - create [MainThread]: Using checkpoint name: [virtnbdbackup.0].
[2023-06-28 05:28:24] DEBUG root checkpoint - create [MainThread]: Checkpoint info: [{'name': 'virtnbdbackup.0', 'parent': '', 'file': '/tmp/backup/kvm_test.cpt'}].
[2023-06-28 05:28:24] INFO root virtnbdbackup - main [MainThread]: Local NBD Endpoint socket: [/var/tmp/virtnbdbackup.3513]
[2023-06-28 05:28:24] INFO root virtnbdbackup - main [MainThread]: Temporary scratch file target directory: [/var/tmp]
[2023-06-28 05:28:24] INFO root virtnbdbackup - startBackupJob [MainThread]: Starting backup job.
[2023-06-28 05:28:24] DEBUG virt client - _createBackupXml [MainThread]: Using scratch file: /var/tmp/backup.8JLSW.vda
[2023-06-28 05:28:24] DEBUG root xml - indent [MainThread]:








[2023-06-28 05:28:24] DEBUG root xml - indent [MainThread]:

Backup checkpoint
virtnbdbackup.0




[2023-06-28 05:28:24] DEBUG fs fs - freeze [MainThread]: Attempting to freeze filesystems.
[2023-06-28 05:28:24] WARNING fs fs - freeze [MainThread]: Guest agent is not responding: QEMU guest agent is not connected
[2023-06-28 05:28:24] DEBUG virt client - startBackup [MainThread]: Starting backup job via libvirt API.
[2023-06-28 05:28:24] DEBUG virt client - startBackup [MainThread]: Started backup job via libvirt API.
[2023-06-28 05:28:24] DEBUG root virtnbdbackup - startBackupJob [MainThread]: Backup job started.
[2023-06-28 05:28:24] INFO root virtnbdbackup - main [MainThread]: Started backup job with checkpoint, saving information.
[2023-06-28 05:28:24] INFO root checkpoint - backup [MainThread]: Saving checkpoint config to: [/tmp/backup/checkpoints/virtnbdbackup.0.xml]
[2023-06-28 05:28:24] INFO nbd client - printVersion [vda]: libnbd version: 1.10.5
[2023-06-28 05:28:24] INFO nbd client - connect [vda]: Waiting until NBD server at [nbd+unix:///vda?socket=/var/tmp/virtnbdbackup.3513] is up.
[2023-06-28 05:28:25] INFO nbd client - connect [vda]: Waiting for NBD Server, Retry: 0
[2023-06-28 05:28:25] ERROR root virtnbdbackup - main [MainThread]: Disk backup failed: [NBD endpoint: [Unix(exportName='vda', metaContext='', backupSocket='/var/tmp/virtnbdbackup.3513', tls=False)]: connection failed: [Unable to connect nbd server: nbd_connect_uri: connect: No such file or directory (ENOENT)]]
[2023-06-28 05:28:25] INFO root virtnbdbackup - main [MainThread]: Backup jobs finished, stopping backup task.
[2023-06-28 05:28:25] INFO root metadata - backupConfig [MainThread]: Saving VM config to: [/tmp/backup/vmconfig.virtnbdbackup.0.xml]
[2023-06-28 05:28:25] DEBUG libvirtnbdbackup.qemu.command command - run [MainThread]: CMD: qemu-img info /root/kvm/image/ubuntu.qcow2 --output json --force-share
[2023-06-28 05:28:25] DEBUG libvirtnbdbackup.qemu.command command - run [MainThread]: Return code: 1
[2023-06-28 05:28:25] ERROR libvirtnbdbackup.qemu.command command - run [MainThread]: CMD: qemu-img info /root/kvm/image/ubuntu.qcow2 --output json --force-share
[2023-06-28 05:28:25] DEBUG libvirtnbdbackup.qemu.command command - run [MainThread]: Read error messages from logfile
[2023-06-28 05:28:25] WARNING root metadata - backupDiskInfo [MainThread]: Failed to read qcow image info: [Unable to start [qemu-img] error: [qemu-img: Could not open '/root/kvm/image/ubuntu.qcow2': Could not open '/root/kvm/image/ubuntu.qcow2': Permission denied]]
[2023-06-28 05:28:25] ERROR root virtnbdbackup - main [MainThread]: Error during backup

@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

this is really really strange, i cant reproduce this on my systems.

Connected to remote host

is entirely missing in your logging so it does not attempt to use an remote NBD connection at all.
Please try with recent commits from the dev branch with more additional debug logging added:

42d8af3

it seems the check if the hostnames differ doesnt work in some way and as such the remotehost variable
is not set and virtnbdbackup attempts local backup instead of remote.

@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

virtnbdbackup is using the hostname from libvirt.getHostname() call after beeing connected to the remote system.
If the local hostname and the remote hostname differs it sets the remoteHost variable and decides to use NBD over network instead of the local socket for transport.

What i guess what happens is that gethostname() on the system you are executing virtnbdbackup on and the libvirt daemon on the remote host might return "localhost" or some other default value because of DNS not beeing setup correctly. As a result, even if its connected to a remote system, attempts to use the local unix socket for data transport and fails.

@abbbi abbbi added the need-info Additional information or logfiles required to solve issue. label Jun 28, 2023
@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

what does following python script return executed on the system you start virtnbdbackup on?

python3
>>> import libvirt
>>> from socket import gethostname
>>> gethostname()
>>> conn = libvirt.open("qemu+ssh://root@192.168.207.167/system")
[..] enter password [..]
>>> conn.getHostname()

@Dar1in9s
Copy link
Author

what does following python script return executed on the system you start virtnbdbackup on?

python3
>>> import libvirt
>>> from socket import gethostname
>>> gethostname()
>>> conn = libvirt.open("qemu+ssh://root@192.168.207.167/system")
[..] enter password [..]
>>> conn.getHostname()
ubuntu@ubuntu:~$ python3
Python 3.10.6 (main, May 29 2023, 11:10:38) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import libvirt
>>> from socket import gethostname
>>> gethostname()
'ubuntu'
>>> conn = libvirt.open("qemu+ssh://root@192.168.207.167/system")
root@192.168.207.167's password: 
>>> conn.getHostname()
'ubuntu'

I figured it out because the two machines have the same hostname!I modified the hostname of a machine, and the another issue arises.

root@ubuntu2:~# ssh root@192.168.207.167
Welcome to Ubuntu 22.04 LTS (GNU/Linux 5.15.0-56-generic x86_64)

 * Documentation:  https://help.ubuntu.com
 * Management:     https://landscape.canonical.com
 * Support:        https://ubuntu.com/advantage

  System information as of Wed Jun 28 07:22:13 AM UTC 2023

  System load:  0.0390625          Users logged in:          2
  Usage of /:   73.7% of 37.23GB   IPv4 address for docker0: 172.17.0.1
  Memory usage: 52%                IPv4 address for ens33:   192.168.207.167
  Swap usage:   15%                IPv4 address for virbr0:  192.168.122.1
  Processes:    273

 * Strictly confined Kubernetes makes edge and IoT secure. Learn how MicroK8s
   just raised the bar for easy, resilient and secure K8s cluster deployment.

   https://ubuntu.com/engage/secure-kubernetes-at-the-edge

121 updates can be applied immediately.
To see these additional updates run: apt list --upgradable

Failed to connect to https://changelogs.ubuntu.com/meta-release-lts. Check your Internet connection or proxy settings


*** System restart required ***
Last login: Wed Jun 28 07:12:51 2023 from 192.168.207.1
root@ubuntu:~# exit
logout
Connection to 192.168.207.167 closed.
root@ubuntu2:~#
root@ubuntu2:~#
root@ubuntu2:~#
root@ubuntu2:~# virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test  -o /tmp/backup -v
[2023-06-28 07:22:20] INFO lib common - printVersion [MainThread]: Version: 1.9.26 Arguments: /usr/local/bin/virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test -o /tmp/backup -v
[2023-06-28 07:22:20] INFO root virtnbdbackup - main [MainThread]: Backup level: [copy]
[2023-06-28 07:22:20] DEBUG virt client - _connect [MainThread]: Libvirt URI: [qemu+ssh://root@192.168.207.167/system]
[2023-06-28 07:22:20] DEBUG virt client - _connect [MainThread]: Login information specified, connect libvirtd using openAuth function.
[2023-06-28 07:22:20] INFO virt client - _connect [MainThread]: Connected to remote host: [ubuntu], local host: [ubuntu2]
[2023-06-28 07:22:20] INFO root virtnbdbackup - main [MainThread]: Libvirt library version: [8000000]
[2023-06-28 07:22:20] DEBUG virt client - getDomainDisks [MainThread]: Disk [vda]: file notation
[2023-06-28 07:22:20] INFO root disktype - Optical [MainThread]: Skipping attached [cdrom] device: [sda].
[2023-06-28 07:22:20] DEBUG virt client - getDomainDisks [MainThread]: Device list: [DomainDisk(target='vda', format='qcow2', filename='ubuntu.qcow2', path='/root/kvm/image/ubuntu.qcow2', backingstores=[])] 
[2023-06-28 07:22:20] DEBUG virt client - getDomainInfo [MainThread]: No setting [loader] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:22:20] DEBUG virt client - getDomainInfo [MainThread]: No setting [nvram] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:22:20] DEBUG virt client - getDomainInfo [MainThread]: No setting [kernel] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:22:20] DEBUG virt client - getDomainInfo [MainThread]: No setting [initrd] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:22:20] DEBUG virt client - getDomainInfo [MainThread]: Domain Info: [{}]
[2023-06-28 07:22:20] INFO root virtnbdbackup - main [MainThread]: Backup will save [1] attached disks.
[2023-06-28 07:22:20] INFO root virtnbdbackup - main [MainThread]: Concurrent backup processes: [1]
[2023-06-28 07:22:20] INFO root checkpoint - redefine [MainThread]: Loading checkpoint list from: [/tmp/backup/checkpoints]
[2023-06-28 07:22:20] INFO root checkpoint - create [MainThread]: Checkpoint handling.
[2023-06-28 07:22:20] DEBUG root checkpoint - create [MainThread]: Checkpoint info: [{'name': 'virtnbdbackup.0', 'parent': '', 'file': '/tmp/backup/kvm_test.cpt'}].
[2023-06-28 07:22:20] INFO ssh client - connect [MainThread]: Connecting remote system [ubuntu] via ssh, username: [root]
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: starting thread (client mode): 0x668223b0
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Local version/idstring: SSH-2.0-paramiko_3.2.0
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Remote version/idstring: SSH-2.0-OpenSSH_8.9p1 Ubuntu-3
[2023-06-28 07:22:20] INFO paramiko.transport transport - _log [Thread-1]: Connected (version 2.0, client OpenSSH_8.9p1)
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: === Key exchange possibilities ===
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: kex algos: curve25519-sha256, curve25519-sha256@libssh.org, ecdh-sha2-nistp256, ecdh-sha2-nistp384, ecdh-sha2-nistp521, sntrup761x25519-sha512@openssh.com, diffie-hellman-group-exchange-sha256, diffie-hellman-group16-sha512, diffie-hellman-group18-sha512, diffie-hellman-group14-sha256
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: server key: rsa-sha2-512, rsa-sha2-256, ecdsa-sha2-nistp256, ssh-ed25519
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: client encrypt: chacha20-poly1305@openssh.com, aes128-ctr, aes192-ctr, aes256-ctr, aes128-gcm@openssh.com, aes256-gcm@openssh.com
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: server encrypt: chacha20-poly1305@openssh.com, aes128-ctr, aes192-ctr, aes256-ctr, aes128-gcm@openssh.com, aes256-gcm@openssh.com
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: client mac: umac-64-etm@openssh.com, umac-128-etm@openssh.com, hmac-sha2-256-etm@openssh.com, hmac-sha2-512-etm@openssh.com, hmac-sha1-etm@openssh.com, umac-64@openssh.com, umac-128@openssh.com, hmac-sha2-256, hmac-sha2-512, hmac-sha1
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: server mac: umac-64-etm@openssh.com, umac-128-etm@openssh.com, hmac-sha2-256-etm@openssh.com, hmac-sha2-512-etm@openssh.com, hmac-sha1-etm@openssh.com, umac-64@openssh.com, umac-128@openssh.com, hmac-sha2-256, hmac-sha2-512, hmac-sha1
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: client compress: none, zlib@openssh.com
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: server compress: none, zlib@openssh.com
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: client lang: <none>
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: server lang: <none>
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: kex follows: False
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: === Key exchange agreements ===
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Kex: curve25519-sha256@libssh.org
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: HostKey: ssh-ed25519
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Cipher: aes128-ctr
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: MAC: hmac-sha2-256
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Compression: none
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: === End of kex handshake ===
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: kex engine KexCurve25519 specified hash_algo <built-in function openssl_sha256>
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Switch to new keys ...
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [MainThread]: Adding ssh-ed25519 host key for ubuntu: b'1587955b61613cd538cc04505991cb7d'
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Got EXT_INFO: {'server-sig-algs': b'ssh-ed25519,sk-ssh-ed25519@openssh.com,ssh-rsa,rsa-sha2-256,rsa-sha2-512,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ecdsa-sha2-nistp256@openssh.com,webauthn-sk-ecdsa-sha2-nistp256@openssh.com', 'publickey-hostbound@openssh.com': b'0'}
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [MainThread]: Trying discovered key b'5aea609fe671c5c86f92cb8eb099c4a5' in /root/.ssh/id_rsa
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: userauth is OK
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Finalizing pubkey algorithm for key of type 'ssh-rsa'
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Our pubkey algorithm list: ['rsa-sha2-512', 'rsa-sha2-256', 'ssh-rsa']
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Server-side algorithm list: ['ssh-ed25519', 'sk-ssh-ed25519@openssh.com', 'ssh-rsa', 'rsa-sha2-256', 'rsa-sha2-512', 'ssh-dss', 'ecdsa-sha2-nistp256', 'ecdsa-sha2-nistp384', 'ecdsa-sha2-nistp521', 'sk-ecdsa-sha2-nistp256@openssh.com', 'webauthn-sk-ecdsa-sha2-nistp256@openssh.com']
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Agreed upon 'rsa-sha2-512' pubkey algorithm
[2023-06-28 07:22:20] INFO paramiko.transport transport - _log [Thread-1]: Authentication (publickey) failed.
[2023-06-28 07:22:20] WARNING lib common - sshSession [MainThread]: Failed to setup SSH connection: [AuthenticationException occurred; did you remember to generate an SSH key? Authentication failed.]
[2023-06-28 07:22:20] ERROR root virtnbdbackup - main [MainThread]: Remote backup detected but ssh session setup failed
root@ubuntu2:~# 

I added the ssh private key and was able to log in. But it is reported that I failed to log in?

@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

Theres two seperate ssh connections, the first one is the one used by the libvirt api (using qemu+ssh) and the second
one is the one virtnbdbackup sets up for copying files from the remote host to the backup host via paramiko ssh library. The second one is failing because the remote system denies login via specified public key for user root.

I dont see any obvious from the paramiko logs, so you may have to check sshd logfiles on the remote system to get more grasp why it denys the public key login.

Is the key used in question the right one? From the log:

[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Got EXT_INFO: {'server-sig-algs': b'ssh-ed25519,sk-ssh-ed25519@openssh.com,ssh-rsa,rsa-sha2-256,rsa-sha2-512,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ecdsa-sha2-nistp256@openssh.com,webauthn-sk-ecdsa-sha2-nistp256@openssh.com', 'publickey-hostbound@openssh.com': b'0'}
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [MainThread]: Trying discovered key b'5aea609fe671c5c86f92cb8eb099c4a5' in /root/.ssh/id_rsa
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: userauth is OK
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Finalizing pubkey algorithm for key of type 'ssh-rsa'
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Our pubkey algorithm list: ['rsa-sha2-512', 'rsa-sha2-256', 'ssh-rsa']
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Server-side algorithm list: ['ssh-ed25519', 'sk-ssh-ed25519@openssh.com', 'ssh-rsa', 'rsa-sha2-256', 'rsa-sha2-512', 'ssh-dss', 'ecdsa-sha2-nistp256', 'ecdsa-sha2-nistp384', 'ecdsa-sha2-nistp521', 'sk-ecdsa-sha2-nistp256@openssh.com', 'webauthn-sk-ecdsa-sha2-nistp256@openssh.com']
[2023-06-28 07:22:20] DEBUG paramiko.transport transport - _log [Thread-1]: Agreed upon 'rsa-sha2-512' pubkey algorithm

maybe check for differences between "ssh -vvv root@ubuntu" and the paramiko session (different algos used? unsupported ssh settings such as disabled algorithms paramiko is attempting?)

@abbbi abbbi changed the title Remote Backup Failed? Remote Backup Fails if both backup and remote system have the same hostname Jun 28, 2023
@abbbi abbbi added the environment problems probably environment related label Jun 28, 2023
@Dar1in9s
Copy link
Author

Yes! I can connect ssh successful!But it seems occur another issue.

root@ubuntu2:~# virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test  -o /tmp/backup -v
[2023-06-28 07:40:51] INFO lib common - printVersion [MainThread]: Version: 1.9.26 Arguments: /usr/local/bin/virtnbdbackup -U qemu+ssh://root@192.168.207.167/system --ssh-user root -d kvm_test -o /tmp/backup -v
[2023-06-28 07:40:51] INFO root virtnbdbackup - main [MainThread]: Backup level: [copy]
[2023-06-28 07:40:51] DEBUG virt client - _connect [MainThread]: Libvirt URI: [qemu+ssh://root@192.168.207.167/system]
[2023-06-28 07:40:51] DEBUG virt client - _connect [MainThread]: Login information specified, connect libvirtd using openAuth function.
[2023-06-28 07:40:51] INFO virt client - _connect [MainThread]: Connected to remote host: [ubuntu], local host: [ubuntu2]
[2023-06-28 07:40:52] INFO root virtnbdbackup - main [MainThread]: Libvirt library version: [8000000]
[2023-06-28 07:40:52] DEBUG virt client - getDomainDisks [MainThread]: Disk [vda]: file notation
[2023-06-28 07:40:52] INFO root disktype - Optical [MainThread]: Skipping attached [cdrom] device: [sda].
[2023-06-28 07:40:52] DEBUG virt client - getDomainDisks [MainThread]: Device list: [DomainDisk(target='vda', format='qcow2', filename='ubuntu.qcow2', path='/root/kvm/image/ubuntu.qcow2', backingstores=[])] 
[2023-06-28 07:40:52] DEBUG virt client - getDomainInfo [MainThread]: No setting [loader] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:40:52] DEBUG virt client - getDomainInfo [MainThread]: No setting [nvram] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:40:52] DEBUG virt client - getDomainInfo [MainThread]: No setting [kernel] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:40:52] DEBUG virt client - getDomainInfo [MainThread]: No setting [initrd] found: 'NoneType' object has no attribute 'text'
[2023-06-28 07:40:52] DEBUG virt client - getDomainInfo [MainThread]: Domain Info: [{}]
[2023-06-28 07:40:52] INFO root virtnbdbackup - main [MainThread]: Backup will save [1] attached disks.
[2023-06-28 07:40:52] INFO root virtnbdbackup - main [MainThread]: Concurrent backup processes: [1]
[2023-06-28 07:40:52] INFO root checkpoint - redefine [MainThread]: Loading checkpoint list from: [/tmp/backup/checkpoints]
[2023-06-28 07:40:52] INFO root checkpoint - create [MainThread]: Checkpoint handling.
[2023-06-28 07:40:52] DEBUG root checkpoint - create [MainThread]: Checkpoint info: [{'name': 'virtnbdbackup.0', 'parent': '', 'file': '/tmp/backup/kvm_test.cpt'}].
[2023-06-28 07:40:52] INFO ssh client - connect [MainThread]: Connecting remote system [ubuntu] via ssh, username: [root]
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: starting thread (client mode): 0x54323520
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Local version/idstring: SSH-2.0-paramiko_3.2.0
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Remote version/idstring: SSH-2.0-OpenSSH_8.9p1 Ubuntu-3
[2023-06-28 07:40:52] INFO paramiko.transport transport - _log [Thread-1]: Connected (version 2.0, client OpenSSH_8.9p1)
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: === Key exchange possibilities ===
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: kex algos: curve25519-sha256, curve25519-sha256@libssh.org, ecdh-sha2-nistp256, ecdh-sha2-nistp384, ecdh-sha2-nistp521, sntrup761x25519-sha512@openssh.com, diffie-hellman-group-exchange-sha256, diffie-hellman-group16-sha512, diffie-hellman-group18-sha512, diffie-hellman-group14-sha256
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: server key: rsa-sha2-512, rsa-sha2-256, ecdsa-sha2-nistp256, ssh-ed25519
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: client encrypt: chacha20-poly1305@openssh.com, aes128-ctr, aes192-ctr, aes256-ctr, aes128-gcm@openssh.com, aes256-gcm@openssh.com
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: server encrypt: chacha20-poly1305@openssh.com, aes128-ctr, aes192-ctr, aes256-ctr, aes128-gcm@openssh.com, aes256-gcm@openssh.com
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: client mac: umac-64-etm@openssh.com, umac-128-etm@openssh.com, hmac-sha2-256-etm@openssh.com, hmac-sha2-512-etm@openssh.com, hmac-sha1-etm@openssh.com, umac-64@openssh.com, umac-128@openssh.com, hmac-sha2-256, hmac-sha2-512, hmac-sha1
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: server mac: umac-64-etm@openssh.com, umac-128-etm@openssh.com, hmac-sha2-256-etm@openssh.com, hmac-sha2-512-etm@openssh.com, hmac-sha1-etm@openssh.com, umac-64@openssh.com, umac-128@openssh.com, hmac-sha2-256, hmac-sha2-512, hmac-sha1
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: client compress: none, zlib@openssh.com
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: server compress: none, zlib@openssh.com
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: client lang: <none>
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: server lang: <none>
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: kex follows: False
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: === Key exchange agreements ===
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Kex: curve25519-sha256@libssh.org
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: HostKey: ssh-ed25519
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Cipher: aes128-ctr
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: MAC: hmac-sha2-256
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Compression: none
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: === End of kex handshake ===
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: kex engine KexCurve25519 specified hash_algo <built-in function openssl_sha256>
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Switch to new keys ...
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Got EXT_INFO: {'server-sig-algs': b'ssh-ed25519,sk-ssh-ed25519@openssh.com,ssh-rsa,rsa-sha2-256,rsa-sha2-512,ssh-dss,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ecdsa-sha2-nistp256@openssh.com,webauthn-sk-ecdsa-sha2-nistp256@openssh.com', 'publickey-hostbound@openssh.com': b'0'}
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [MainThread]: Trying discovered key b'5aea609fe671c5c86f92cb8eb099c4a5' in /root/.ssh/id_rsa
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: userauth is OK
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Finalizing pubkey algorithm for key of type 'ssh-rsa'
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Our pubkey algorithm list: ['rsa-sha2-512', 'rsa-sha2-256', 'ssh-rsa']
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Server-side algorithm list: ['ssh-ed25519', 'sk-ssh-ed25519@openssh.com', 'ssh-rsa', 'rsa-sha2-256', 'rsa-sha2-512', 'ssh-dss', 'ecdsa-sha2-nistp256', 'ecdsa-sha2-nistp384', 'ecdsa-sha2-nistp521', 'sk-ecdsa-sha2-nistp256@openssh.com', 'webauthn-sk-ecdsa-sha2-nistp256@openssh.com']
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Agreed upon 'rsa-sha2-512' pubkey algorithm
[2023-06-28 07:40:52] INFO paramiko.transport transport - _log [Thread-1]: Authentication (publickey) successful!
[2023-06-28 07:40:52] INFO root virtnbdbackup - main [MainThread]: Remote NBD Endpoint host: [ubuntu]
[2023-06-28 07:40:52] INFO root virtnbdbackup - main [MainThread]: Temporary scratch file target directory: [/var/tmp]
[2023-06-28 07:40:52] INFO root virtnbdbackup - startBackupJob [MainThread]: Starting backup job.
[2023-06-28 07:40:52] DEBUG virt client - _createBackupXml [MainThread]: Using scratch file: /var/tmp/backup.HFQWB.vda
[2023-06-28 07:40:52] DEBUG root xml - indent [MainThread]: 
<domainbackup mode="pull">
  <server tls="no" name="ubuntu" port="10809"/>
  <disks>
    <disk name="vda">
      <scratch file="/var/tmp/backup.HFQWB.vda"/>
    </disk>
  </disks>
</domainbackup>
[2023-06-28 07:40:52] DEBUG fs fs - freeze [MainThread]: Attempting to freeze filesystems.
[2023-06-28 07:40:52] WARNING fs fs - freeze [MainThread]: Guest agent is not responding: QEMU guest agent is not connected
[2023-06-28 07:40:52] DEBUG virt client - startBackup [MainThread]: Starting backup job via libvirt API.
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Received global request "hostkeys-00@openssh.com"
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Rejecting "hostkeys-00@openssh.com" global request from server.
[2023-06-28 07:40:52] DEBUG paramiko.transport transport - _log [Thread-1]: Debug msg: b'/root/.ssh/authorized_keys:1: key options: agent-forwarding port-forwarding pty user-rc x11-forwarding'
[2023-06-28 07:40:52] DEBUG virt client - startBackup [MainThread]: Started backup job via libvirt API.
[2023-06-28 07:40:52] DEBUG root virtnbdbackup - startBackupJob [MainThread]: Backup job started.
[2023-06-28 07:40:52] INFO nbd client - printVersion [vda]: libnbd version: 1.10.5
[2023-06-28 07:40:52] INFO nbd client - connect [vda]: Waiting until NBD server at [nbd://ubuntu:10809/vda] is up.
[2023-06-28 07:40:53] ERROR root virtnbdbackup - main [MainThread]: Disk backup failed: [NBD endpoint: [TCP(exportName='vda', metaContext='', hostname='ubuntu', tls=False, port=10809, backupSocket='')]: connection failed: [Unable to connect nbd server: nbd_connect_uri: recv: Connection refused (ECONNREFUSED)]]
[2023-06-28 07:40:53] INFO root virtnbdbackup - main [MainThread]: Backup jobs finished, stopping backup task.
[2023-06-28 07:40:53] INFO root metadata - backupConfig [MainThread]: Saving VM config to: [/tmp/backup/vmconfig.copy.xml]
[2023-06-28 07:40:53] DEBUG ssh client - run [MainThread]: Executing remote command: [qemu-img info /root/kvm/image/ubuntu.qcow2 --output json --force-share]
[2023-06-28 07:40:53] DEBUG paramiko.transport channel - _log [MainThread]: [chan 0] Max packet in: 32768 bytes
[2023-06-28 07:40:53] DEBUG paramiko.transport channel - _log [Thread-1]: [chan 0] Max packet out: 32768 bytes
[2023-06-28 07:40:53] DEBUG paramiko.transport transport - _log [Thread-1]: Secsh channel 0 opened.
[2023-06-28 07:40:53] DEBUG paramiko.transport channel - _log [Thread-1]: [chan 0] Sesch channel 0 request ok
[2023-06-28 07:40:53] DEBUG paramiko.transport channel - _log [Thread-1]: [chan 0] EOF received (0)
[2023-06-28 07:40:53] DEBUG paramiko.transport channel - _log [MainThread]: [chan 0] EOF sent (0)
[2023-06-28 07:40:53] INFO root metadata - backupDiskInfo [MainThread]: Saved qcow image config to: [/tmp/backup/vda.copy.qcow.json]
[2023-06-28 07:40:53] ERROR root virtnbdbackup - main [MainThread]: Error during backup

I use netstat in my remote system, and it shows the port 10809 is listening. but only 127.0.0.1?

root@ubuntu:~# netstat -pantu
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name    
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      3369/sshd: /usr/sbi 
tcp        0      0 127.0.0.53:53           0.0.0.0:*               LISTEN      7166/systemd-resolv 
tcp        0      0 192.168.122.1:53        0.0.0.0:*               LISTEN      1140/dnsmasq        
tcp        0      0 127.0.0.1:6011          0.0.0.0:*               LISTEN      93019/sshd: root@pt 
tcp        0      0 0.0.0.0:5901            0.0.0.0:*               LISTEN      4730/qemu-system-x8 
tcp        0      0 0.0.0.0:5900            0.0.0.0:*               LISTEN      3479/qemu-system-x8 
tcp        0      0 127.0.1.1:10809         0.0.0.0:*               LISTEN      3479/qemu-system-x8 
tcp        0      0 192.168.207.167:22      192.168.207.171:45430   ESTABLISHED 93904/sshd: root@no 
tcp        0      0 192.168.207.167:5901    192.168.207.1:9724      ESTABLISHED 4730/qemu-system-x8 
tcp        0    248 192.168.207.167:22      192.168.207.1:1086      ESTABLISHED 93019/sshd: root@pt 
tcp        0      0 192.168.207.167:22      192.168.207.171:45446   ESTABLISHED 93965/sshd: root    
tcp        0      0 192.168.207.167:5900    192.168.207.1:9721      ESTABLISHED 3479/qemu-system-x8 
tcp6       0      0 :::22                   :::*                    LISTEN      3369/sshd: /usr/sbi 
tcp6       0      0 ::1:6011                :::*                    LISTEN      93019/sshd: root@pt 
udp        0      0 127.0.0.53:53           0.0.0.0:*                           7166/systemd-resolv 
udp        0      0 192.168.122.1:53        0.0.0.0:*                           1140/dnsmasq        
udp        0      0 0.0.0.0:67              0.0.0.0:*                           1140/dnsmasq        
udp        0      0 192.168.207.167:68      0.0.0.0:*                           7159/systemd-networ 

@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

yes, thats probably due to hostname "ubuntu" resolving to 127.0.0.1. So libvirt starts the backup endpoint on 127.0.0.1 instead of the public ip.

the libvirt backup job shows:

<server tls="no" name="ubuntu" port="10809"/>

Either specify --nbd-ip via command line to make virtnbdbackup start backup port on another IP (the public one) or fix DNS so hostname "ubuntu" resolves to the public IP of the system, not 127.0.0.1

-I NBD_IP, --nbd-ip NBD_IP
                      IP used to bind remote NBD service on (default: hostname returned by libvirtd)

abbbi added a commit that referenced this issue Jun 28, 2023
@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

enhanced README regards remote backup. Guess this issue can be closed, its not really a "bug"
you might consider opening an discussion if anything else gives you trouble. Thanks.

@abbbi abbbi closed this as completed Jun 28, 2023
@abbbi abbbi removed the need-info Additional information or logfiles required to solve issue. label Jun 28, 2023
@Dar1in9s
Copy link
Author

enhanced README regards remote backup. Guess this issue can be closed, its not really a "bug" you might consider opening an discussion if anything else gives you trouble. Thanks.

Yes! I added the -I parameter and it worked!
Thanks!

@abbbi
Copy link
Owner

abbbi commented Jun 28, 2023

thanks for the update, consider hitting the sponsor button,thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
environment problems probably environment related support Usage/support questions.
Projects
None yet
Development

No branches or pull requests

2 participants