docs: Update INSTALL.md for 3.9.2 #473
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Match CI to docs update for go 1.17.5
wobito
approved these changes
Dec 10, 2021
dtrudg
added a commit
to dtrudg/singularity
that referenced
this pull request
Dec 10, 2021
Squashed commit of the following: commit 90bbb38 Merge: dbe4f32 8c3143d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 13:41:10 2021 -0600 Merge pull request sylabs#473 from dtrudg/392-docs docs: Update INSTALL.md for 3.9.2 commit dbe4f32 Merge: 0cea468 a26bc7d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 13:40:47 2021 -0600 Merge pull request sylabs#472 from dtrudg/loopdev-39 Pick loop device discovery change sylabs#458 & sylabs#464 commit 8c3143d Author: David Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 11:54:57 2021 -0600 docs: Update INSTALL.md for 3.9.2 Match CI to docs update for go 1.17.5 commit a26bc7d Author: David Trudgian <david.trudgian@sylabs.io> Date: Tue Dec 7 17:52:02 2021 -0600 Refactor loop.AttachFromFile The loop.AttachFromFile code, used to attach an image to a free loop device, or to find a shared loop device has been refactored. Previously, a complex loop handled both finding shared loop devices and attaching to new free devices. The logic was difficult to follow, especially with regard to tracking which errors were fatal and would bubble up, vs result in loop continuation, or retries. The shared and 'fresh' attachment have been separated into two functions. Some additional logging / error detail has been added. The test code has been modified to prevent a leak of a loop device. Fixes sylabs#463 commit a88d915 Author: Tom Schoonjans <Tom.Schoonjans@genomicsplc.com> Date: Tue Dec 7 20:52:25 2021 +0000 Apply @dtrudg's comments commit af42c8a Author: Tom Schoonjans <Tom.Schoonjans@genomicsplc.com> Date: Tue Nov 30 20:48:37 2021 +0000 AttachFromFile: rewrite retry loop When the CmdSetStatus64 syscall returns EAGAIN or EBUSY, move on to try the next loop device instead of aborting. Rename AttachFromFile to attachFromFile and run in a loop while no valid loop devices were found but EAGAIN or EBUSY was encountered. This fixes an intermittent issue encountered on Arvados Crunch (https://dev.arvados.org/issues/18489) commit 0cea468 Merge: 3908ad2 b871d84 Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 11:12:26 2021 -0600 Merge pull request sylabs#469 from dtrudg/keyidx-39 Clarify source of key index (3.9) commit b871d84 Author: Richard Hattersley <rhattersley@gmail.com> Date: Thu Nov 25 09:29:02 2021 +0000 Clarify source of key index (3.9) commit 3908ad2 Merge: 471b3fc 5c00c11 Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 10:11:16 2021 -0600 Merge pull request sylabs#467 from dtrudg/issue465-39 fix: do not require working keyserver config in local build (3.9) commit 5c00c11 Author: David Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 12:59:48 2021 -0600 fix: do not require working keyserver config in local build (3.9) At the CLI level, local builds had a hard fail if a keyserver config could not be retrieved. 1) Warn instead of fail. For builds that perform verification of a SIF it may still be possbile to verify using the local keyring. 2) Don't attempt to get a keyserver config at all, unless build definition has a bootstrap that will, or may provide a SIF source image (library/localimage/oras/shub). Fixes sylabs#465 commit 471b3fc Merge: de3dbb7 9fd911d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 16:17:53 2021 -0600 Merge pull request sylabs#470 from dtrudg/clog-shfix docs: Note mvdan.cc/sh related bug fixes in changelog commit 9fd911d Merge: 38b50cb fb84d7d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 15:53:54 2021 -0600 Merge pull request sylabs#468 from dtrudg/godep39 fix: ensure gengodep uses vendor dir if present (3.9) commit de3dbb7 Merge: 38b50cb fb84d7d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 15:53:54 2021 -0600 Merge pull request sylabs#468 from dtrudg/godep39 fix: ensure gengodep uses vendor dir if present (3.9) commit fb84d7d Author: David Trudgian <david.trudgian@sylabs.io> Date: Tue Dec 7 13:20:25 2021 -0600 fix: ensure gengodep uses vendor dir if present (3.9) In a previous PR, initialization of the `srcdir` varible was removed from `makeit/gengodep`. However, the `gengodep` script was still using `srcdir` when checking for a `${srcdir}/vendor/modules.txt`. sylabs@48e7fab As a result, the vendor dir is never found, and `go` was run with `-mod=readonly`, which would lead to downloads. Since go 1.14 the presence of a vendor dir infers `-mod=vendor` automatically, so we can just remove the handling here. Fixes sylabs#461
dtrudg
added a commit
to dtrudg/singularity
that referenced
this pull request
Dec 10, 2021
Squashed commit of the following: commit 90bbb38 Merge: dbe4f32 8c3143d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 13:41:10 2021 -0600 Merge pull request sylabs#473 from dtrudg/392-docs docs: Update INSTALL.md for 3.9.2 commit dbe4f32 Merge: 0cea468 a26bc7d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 13:40:47 2021 -0600 Merge pull request sylabs#472 from dtrudg/loopdev-39 Pick loop device discovery change sylabs#458 & sylabs#464 commit 8c3143d Author: David Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 11:54:57 2021 -0600 docs: Update INSTALL.md for 3.9.2 Match CI to docs update for go 1.17.5 commit a26bc7d Author: David Trudgian <david.trudgian@sylabs.io> Date: Tue Dec 7 17:52:02 2021 -0600 Refactor loop.AttachFromFile The loop.AttachFromFile code, used to attach an image to a free loop device, or to find a shared loop device has been refactored. Previously, a complex loop handled both finding shared loop devices and attaching to new free devices. The logic was difficult to follow, especially with regard to tracking which errors were fatal and would bubble up, vs result in loop continuation, or retries. The shared and 'fresh' attachment have been separated into two functions. Some additional logging / error detail has been added. The test code has been modified to prevent a leak of a loop device. Fixes sylabs#463 commit a88d915 Author: Tom Schoonjans <Tom.Schoonjans@genomicsplc.com> Date: Tue Dec 7 20:52:25 2021 +0000 Apply @dtrudg's comments commit af42c8a Author: Tom Schoonjans <Tom.Schoonjans@genomicsplc.com> Date: Tue Nov 30 20:48:37 2021 +0000 AttachFromFile: rewrite retry loop When the CmdSetStatus64 syscall returns EAGAIN or EBUSY, move on to try the next loop device instead of aborting. Rename AttachFromFile to attachFromFile and run in a loop while no valid loop devices were found but EAGAIN or EBUSY was encountered. This fixes an intermittent issue encountered on Arvados Crunch (https://dev.arvados.org/issues/18489) commit 0cea468 Merge: 3908ad2 b871d84 Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 11:12:26 2021 -0600 Merge pull request sylabs#469 from dtrudg/keyidx-39 Clarify source of key index (3.9) commit b871d84 Author: Richard Hattersley <rhattersley@gmail.com> Date: Thu Nov 25 09:29:02 2021 +0000 Clarify source of key index (3.9) commit 3908ad2 Merge: 471b3fc 5c00c11 Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Fri Dec 10 10:11:16 2021 -0600 Merge pull request sylabs#467 from dtrudg/issue465-39 fix: do not require working keyserver config in local build (3.9) commit 5c00c11 Author: David Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 12:59:48 2021 -0600 fix: do not require working keyserver config in local build (3.9) At the CLI level, local builds had a hard fail if a keyserver config could not be retrieved. 1) Warn instead of fail. For builds that perform verification of a SIF it may still be possbile to verify using the local keyring. 2) Don't attempt to get a keyserver config at all, unless build definition has a bootstrap that will, or may provide a SIF source image (library/localimage/oras/shub). Fixes sylabs#465 commit 471b3fc Merge: de3dbb7 9fd911d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 16:17:53 2021 -0600 Merge pull request sylabs#470 from dtrudg/clog-shfix docs: Note mvdan.cc/sh related bug fixes in changelog commit 9fd911d Merge: 38b50cb fb84d7d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 15:53:54 2021 -0600 Merge pull request sylabs#468 from dtrudg/godep39 fix: ensure gengodep uses vendor dir if present (3.9) commit de3dbb7 Merge: 38b50cb fb84d7d Author: Dave Trudgian <david.trudgian@sylabs.io> Date: Thu Dec 9 15:53:54 2021 -0600 Merge pull request sylabs#468 from dtrudg/godep39 fix: ensure gengodep uses vendor dir if present (3.9) commit fb84d7d Author: David Trudgian <david.trudgian@sylabs.io> Date: Tue Dec 7 13:20:25 2021 -0600 fix: ensure gengodep uses vendor dir if present (3.9) In a previous PR, initialization of the `srcdir` varible was removed from `makeit/gengodep`. However, the `gengodep` script was still using `srcdir` when checking for a `${srcdir}/vendor/modules.txt`. sylabs@48e7fab As a result, the vendor dir is never found, and `go` was run with `-mod=readonly`, which would lead to downloads. Since go 1.14 the presence of a vendor dir infers `-mod=vendor` automatically, so we can just remove the handling here. Fixes sylabs#461
This was referenced Dec 14, 2021
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Before submitting a PR, make sure you have done the following:
make checkand tested this PR locally with amake test, andmake testallif possible (see CONTRIBUTING.md).