Skip to content

build: streamline ci#1909

Merged
qued merged 9 commits into
mainfrom
build/streamline-ci
Oct 27, 2023
Merged

build: streamline ci#1909
qued merged 9 commits into
mainfrom
build/streamline-ci

Conversation

@qued
Copy link
Copy Markdown
Contributor

@qued qued commented Oct 27, 2023

Updated CI to shave time off in some conditions with no real downside.

  • When the base cache already exists, we don't download it during setup, and we skip all other steps as well.
  • During ingest setup, we check if the ingest cache exists before downloading the base cache, and if the ingest cache already exists, we skip everything else.
  • check-deps doesn't have to wait on setup or download a cache, as the dependencies aren't needed, only pip.
CI version Setup (on hit) Ingest Setup (on hit) Check deps (on hit)
Old 2:06-2:31 3:07-3:31 3:19-6:26
New 0:08-0:09 0:07-0:09 2:05-2:23

Testing

  • Results of cache hits (best case scenario) can be seen here.
  • Results of old cache hits can be seen here.

@qued qued marked this pull request as ready for review October 27, 2023 06:09
Copy link
Copy Markdown
Contributor

@cragwolfe cragwolfe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tricky

@qued qued merged commit 450e7f0 into main Oct 27, 2023
@qued qued deleted the build/streamline-ci branch October 27, 2023 07:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants