Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tool cache install from a manifest file #382

Merged
merged 17 commits into from
May 19, 2020
Merged

Conversation

bryanmacfarlane
Copy link
Member

@bryanmacfarlane bryanmacfarlane commented Mar 16, 2020

If a setup-* tool is cached to insulate against target disriptions and the repo contains a versions-manifest.json advertising versions available by platform, version and arch, this api will match a semver spec (ranges, etc.) against the latest and discover where to pull it from. The abstraction allows for putting on a CDN and changing locations later which are opaque and non breaking to the consumers (the setup-* tasks).

This also allows the hosted images to cache n versions directly on the image for instant resolution and as older versions roll off the image, it still works but may incur a performance of typically 10s of seconds to pull from the CDN cache. On miss, the setup task can ultimately still pull from the origin (the source tools distribution) JIT.

@bryanmacfarlane
Copy link
Member Author

Adding @ericsciple to have a glance. This is early exploration on an idea in the referenced ADR. Basically if a repo has a json file in the root with all the tool binary distributions as releases in that repo, then a setup-*** need only pull that file, at a couple lines and it just works. It also protects against external service distruptions. See the ADR referenced.

@bryanmacfarlane bryanmacfarlane changed the title Prototype WIP: Tool cache install from a manifest file WIP: Tool cache install from a manifest file Apr 7, 2020
@bryanmacfarlane bryanmacfarlane changed the title WIP: Tool cache install from a manifest file Tool cache install from a manifest file Apr 8, 2020
export type IToolRelease = mm.IToolRelease
export type IToolReleaseFile = mm.IToolReleaseFile

export async function getManifestFromUrl(url: string): Promise<IToolRelease[]> {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How confident do you feel about the behavior?

To buy leeway, I'm wondering if whether it would be good to add a function description, indicating experimental and behavior may change.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good suggestion. I may go one step further and release a actions/tool-cache@preview out of this branch. Same on the setup-node side. Start a v2-beta


let chk = item.arch === archFilter && item.platform === platFilter
if (chk && item.platform_version) {
const osVersion = module.exports._getOsVersion()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since _getOsVersion() is heavy (launches a process (mac) or reads a file from disk (linux)), consider caching the result.

For example:

          if (osVersion === undefined) {
            osVersion = _getOsVersion()
          }

}

if (match && file) {
// clone since we're mutating the file list to be only the file that matches
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for cloning the object :)

Copy link
Contributor

@ericsciple ericsciple left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This approach sounds promising. Very nice.

@@ -18,7 +18,7 @@
"@typescript-eslint/await-thenable": "error",
"@typescript-eslint/ban-ts-ignore": "error",
"camelcase": "off",
"@typescript-eslint/camelcase": "error",
"@typescript-eslint/camelcase": "off",
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I got tired of adding all the line by line exceptions. Fact is as we deserialize these requests into structures dictated externally, many have non camel cased properties.

@@ -32,7 +34,8 @@ const userAgent = 'actions/tool-cache'
*/
export async function downloadTool(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we update the function's description to include this new input?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants