Support mounting remote archives

[fkorotkov]

Allow to pass an HTTPS link instead of a local path to tart run --dir argument. HTTPS link should point to a gzipped Tar archive aka *.tar.gz file.

In this situation Tart will download an archive by the link if necessary, will cache it and will unarchive it into a temporary folder inside $TART_HOME to be mounted to the VM.

This use case is useful for mounting something external that updates faster than the VM itself. For example, GitHub Actions Runner installation.

[edigaryev]

I think sanitizeDirectoryShareConfiguration()'s is a bit overloaded and it name seems to be misleading because what it really does is:

1. Parse()
2. Fetch()
3. Unarchive()

What do you think about:

1. Keeping the DirectoryShare() call as it was before
2. Moving the Parse() part of sanitizeDirectoryShareConfiguration() into DirectoryShare()
   • we could also preserve :ro there (e.g. http://127.0.0.1:8080/archive.tar.gz:ro would set readOnly to true)
3. Calling Fetch() and Unarchive() from DirectoryShare() if we're dealing with an URL

[fkorotkov]

Did a bit different and moved the logic to DirectoryShare#createConfiguration method. See 8c0f8f4.

[fkorotkov]

Fixed tests in d70fff2. @edigaryev PTAL

[fkorotkov]

@ruimarinho FYI with Tart 2.1.0 you can mount a remote archives, for example:

tart clone ghcr.io/cirruslabs/macos-sonoma-base:latest sonoma-base
tart run --dir=ghar:https://github.com/actions/runner/releases/download/v2.309.0/actions-runner-osx-arm64-2.309.0.tar.gz sonoma-base

This way your Tart VM will have the latest GHA Runner mounted to /Volumes/My Shared Files/ghar folder.

[Jon889]

@fkorotkov Have you got this working with the Github Action runner. I seem to have a problem where any run: step in the GitHub actions workflow fails with the error: /bin/bash: /Volumes/My: No such file or directory even just run: echo "hello"

it seems like the runner can't be in directory whose path has spaces in it.

If I change the workflow to:

shell: bash -e "{0}"
run: echo "hello"

Then it all works. The default is without the quotes as specified here: https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstepsshell

[fkorotkov]

Yeah, seems GHA runner is not happy with such paths. Most actions can handle it though! You can change the mount point by running the following commands:

sudo umount "/Volumes/My Shared Files"
mkdir ~/workspace
mount_virtiofs com.apple.virtio-fs.automount ~/workspace

Then your runner will be in /Users/admin/workspace/ghar folder.

[Jon889]

Thanks! I'll try that. I added a PR to the runner, but it seems it's a deliberate choice to not have the argument in quotes.

[ruimarinho]

@fkorotkov this is very cool! In theory with orchard we just need to do --host-dirs= ghar:https://github.com/actions/runner/releases/download/v2.309.0/actions-runner-osx-arm64-2.309.0.tar.gz right?

[fkorotkov]

Yep, should work with Orchard as well. I've also created this discussion so maybe GotHub folks will remove version number from the archive so it's easy to always point to the latest one. https://github.com/orgs/community/discussions/68788

[ruimarinho]

@fkorotkov seems like Orchard has a stricter host dir policy. I've created a ticket to look into it.