Skip to content

Latest commit

 

History

History
264 lines (171 loc) · 10.4 KB

README.md

File metadata and controls

264 lines (171 loc) · 10.4 KB

wyng-util-qubes

A wrapper for the Wyng backup system that saves and restores both data and settings for Qubes VMs.

Requirements

  • Qubes OS 4.1 in a thin-LVM, Btrfs or XFS configuration
  • Wyng backup v0.8beta4 or later

Installation quick start

See here for instructions on verifying downloaded code with git. Placing wyng and wyng-util-qubes together in the same directory ensures that the util can find & run Wyng; in the example below /usr/local/bin is used, but you can choose a different location.

[user@dom0 ~]$ sudo qubes-dom0-update python3-pycryptodomex python3-zstd

[user@dom0 ~]$ sudo cp -a wyng-backup/src/wyng wyng-util-qubes/src/wyng-util-qubes /usr/local/bin

Command usage

wyng-util-qubes is run in the Admin VM (dom0):

 wyng-util-qubes backup [--dedup] [-i] [qube_names...]
 wyng-util-qubes restore [--session=YYYYMMDD-HHMMSS] [--pool=poolname] [qube_names...]
 wyng-util-qubes verify [--session=YYYYMMDD-HHMMSS] [qube_names...]
 wyng-util-qubes prune [--autoprune=opt] [--all-before] [--session=YYYYMMDD-HHMMSS[,YYYYMMDD-HHMMSS]] [qube_names...]
 wyng-util-qubes delete <qube_name>
 wyng-util-qubes list [--session=YYYYMMDD-HHMMSS] [qube_names...]

Command summary

Command Description
backup Store Qubes VMs in the Wyng archive as a session (i.e. snapshot)
restore Restore Qubes VMs from the Wyng archive
verify Verify archive data integrity
prune Remove older backup sessions from archive
delete Remove VMs from the Wyng archive
list Show contents of archive

Parameters/Options summary

Option Description
--dest=URL URL location of archive.
--includes, -i Select all Qubes VMs marked as "include in backups". (backup)
--exclude=qube_name Exclude a specific VM from the operation (backup, restore, verify)
--dedup, -d Use deduplication. (backup)
--session=date-time[,date-time] Select a session or session range by date-time or tag (restore, list, prune).
--all Show all VM names and backup sessions (list)
--all-before Select all sessions before the specified --session date-time (prune).
--autoprune=<off|on|full> Automatic pruning. See Wyng docs for details.
--pool=qubespool Override default Qubes local storage pool. (restore)
--pool-info Show local disk storage (list)
--pref=pspec Skip or override VM prefs (restore)
--include-disposable=<off|on> Include disposable VMs (restore, list)
--authmin=N Retain authentication for N minutes
--no-auto-rename Don't rename volumes between LVM <-> Reflink formats (backup)
--unattended, -u Operate without prompts.
--meta-dir=path Use a different metadata dir than the default.
-w wyng_option_spec Pass an option directly to Wyng using the form -w optname[=value]

Examples


$ # Start by creating a fresh Wyng archive:
$ sudo wyng arch-init --dest=file:/mnt/backups/laptop3.backup


$ # Make wyng backups of the VMs _work_ and _personal_
$ sudo wyng-util-qubes backup work personal --dest=file:/mnt/backups/laptop3.backup


$ # Restore VM _personal_ from a wyng archive
$ sudo wyng-util-qubes restore personal --dest=file:/mnt/backups/laptop3.backup

The above examples show the creation and use of an archive named 'laptop3.backup' located in the local '/mnt/backups' path. For non-local archives, use one of the other URL types supported by Wyng, such as 'qubes://' for backing up to a VM filesystem, or 'qubes-ssh://' for backing up to remote via an ssh-equipped VM...

$ sudo wyng arch-init --dest=qubes://sys-backup/mnt/backups/laptop3.backup

$ sudo wyng arch-init --dest=qubes-ssh://sys-backup:user@192.168.1.10/mnt/backups/laptop3.backup

Commands

Note that --dest is assumed to be specified along with each of the commands below.

list

list [vm names] [--session=YYYYMMDD-HHMMSS] [--all] [--pool-info]

Shows a directory of archive contents. If no parameters are given, a list of qube / VM names is given. Disposable VMs will not be shown unless a session is specified along with the --include-disposable=on option.

backup

backup [vm names] [--includes] [--exclude=vmname] [--dedup] [--autoprune]

Backs up Qubes VMs to a Wyng archive. A list of invdividual VM names may be specified, or the --includes option may be used to include all VMs that are flagged in Qubes for automatic inclusion in backups. The --dedup option will attempt to detect duplicate data chunks and reduce the amount of data sent to and disk space taken by the archive. Automatic pruning is also possible; see the Wyng Readme doc for details.

restore

restore [vm names] [--session=YYYYMMDD-HHMMSS] [--exclude=vmname] [--include-disposable] [--pool=poolname]

Restores VMs from a Wyng archive into a Qubes system. VM names and/or a session (containing one or more VMs) may be specified. If a session is not specified, the last session will be auto-selected; if only a session is specified, all of the VMs in the session will be selected.

verify

verify [vm names] [--session=YYYYMMDD-HHMMSS] [--exclude=vmname]

Verifies the integrity of archived VMs. Specifying a session by itself will verify all VMs in that session.

prune

prune [vm names] [--session=YYYYMMDD-HHMMSS] [--autoprune=<off|on|full>]

Removes older backup sessions from the archive to reclaim space. The latest session cannot be selected for removal. See Wyng documentation for specifics on using --autoprune.

delete

delete <vm name>

Deletes a VM from the archive. Only one VM may be specified at a time. To remove a session, see the prune command.

Options

--dest=URL

This (non-optional) option specifies where to access the archive. It accepts one of the following forms:

URL Form Destination Type
file:/path Local filesystem
ssh://user@example.com[:port][/path] SSH server
qubes://vm-name[/path] Qubes virtual machine
qubes-ssh://vm-name:me@example.com[:port][/path] SSH server via a Qubes VM

Note that paths are optional for all except file: and they are always absolute.

--includes, -i

When backing up, select all Qubes VMs marked as "include in backups".

--exclude=qube_name

Exclude a specific VM from the backup, restore, or verify operation. May be specified more than once.

--dedup, -d

Use deduplication when backing up. To dedup an entire archive at once, see the Wyng documentation on arch-deduplicate command.

--session=date-time[,date-time]

Select a session or session range by date-time or tag. Used with restore, list, and prune.

--pool=poolname

When restore creates new VMs in the system, use the Qubes pool specified by for local storage instead of the system default.

--pref=prefname::x

Control how Qubes VM pref 'prefname' is handled during restore where '::x' indicates skipping the specified pref instead of trying to set it.

Notes

To address the thorny issue of restoring VM settings on Qubes OS, a best-effort process is used for individually setting, resetting or removing each value depending on whether the property exists in the backup and whether its writable and has a default value according to Qubes. This differs from the qubes-backup method which often creates new, differently-named VMs when restoring, often resulting in extra, unwanted VMs which don't connect to each other or reference appropriate templates as the user originally intended. Since users' security expectations, scripts and configuration are likely to hinge on VM names, wyng-util-qubes addresses a security risk posed by Qubes' built-in tools.

For each regular qube/VM, both private and root volumes are backed up if the qube type is either template or standalone. Otherwise, the backup will include only a private volume. A 'wyng-qubes-metadata' volume will also be added to the backup session. By default, only backup sessions which include this metadata volume will be accessible for restore operations. DispVMs do not have any disk volume, and their definitions are always included in backup sessions.

Use of --pool is optional with restore, but should be used if you have setup any non-default Qubes pools. Otherwise, the Qubes default pool will be used when possible.

Most of the notes and tips on using Wyng also apply to wyng-util-qubes usage. It is recommended to read or at least skim them to gain general familiarity with Wyng.

Limitations

Apart from data, which is restored verbatim, restoration of VM settings may be imperfect. There is currently no way to ensure a complete match of settings in Qubes. However, VM names are preserved and existing VMs with matching names will be overwritten.

License and Warranty

GPL3 License.

Warranty: None. Use at your own risk!

History

2024-04-24: v0.9beta Support reflink (i.e. Btrfs, XFS) in addition to lvmthin.

2024-03-30: v0.8beta Ease of use update.

2023-07-19: v0.7beta Works with Wyng v0.8beta.

2023-02-10: v0.4b Beta. Adds option passthrough and delete command.

2023-02-03: v0.4a Adds verify & prune commands plus selection options for vms and sessions

2023-01-28: v0.2a Alpha. Adds list command plus more detailed handling of metadata, session and passphrase options for Wyng 0.4a.

2023-01-20: v0.1b Beta. Removes/resets a setting in existing VM when setting is not in the backup.

2023-01-19: v0.1a Initial alpha

Donations

Donate using Liberapay

Buy me a coffee!

Donate with Patreon

If you like this project, monetary contributions are welcome and can be made through Liberapay or Buymeacoffee or Patreon.