Skip to content

Run some charm tests on Push/PR using Github Actions#611

Merged
jnsgruk merged 4 commits intocanonical:masterfrom
jnsgruk:add-charm-tests
Sep 27, 2021
Merged

Run some charm tests on Push/PR using Github Actions#611
jnsgruk merged 4 commits intocanonical:masterfrom
jnsgruk:add-charm-tests

Conversation

@jnsgruk
Copy link
Copy Markdown
Member

@jnsgruk jnsgruk commented Sep 14, 2021

This PR makes some changes to the CI setup for this repo:

  • Renames the existing YAML config for Github Actions from ci.yaml to framework-tests.yaml
  • Adds a suite of tests that clone some of the observability charms, updates their requirements.txt files to use the latest commit in a PR/branch, then runs the tests using tox
  • Adds a suite of tests that runs the test suites from "Hello, Kubecon" and "Hello, Juju!"

The idea here is to catch any low hanging fruit/errors in changes to the framework or Harness.

This does imply a dependency on the upstream charm tests actually being correct, but that doesn't stop judgement being applied by the people merging PRs in this repo as to why the tests are failing. Once the Observability have their releasing more defined with CI, we can point at the branch that is associated with latest/stable for each charm, where there is a stronger expectation that all tests will pass. The Hello, * charms are much more static, and the tests are unlikely to change often.

Copy link
Copy Markdown
Contributor

@Vultaire Vultaire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Quick comment re: potential conflict with #607.

strategy:
matrix:
os: [ubuntu-latest, macos-latest, windows-latest]
python-version: [3.5, 3.6, 3.7, 3.8, 3.9]
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note: if #607 is merged, 3.5 probably needs to be dropped here

@jnsgruk
Copy link
Copy Markdown
Member Author

jnsgruk commented Sep 15, 2021

Agreed, though I think this will merge prior to that PR. We'll just need to be careful to ensure we catch that! Thanks 😊

Copy link
Copy Markdown
Collaborator

@niemeyer niemeyer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As discussed live, looks good, thanks.

@jnsgruk jnsgruk merged commit 28c96ba into canonical:master Sep 27, 2021
@jnsgruk jnsgruk deleted the add-charm-tests branch September 27, 2021 12:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants