Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: add jammy to spread executions #11274

Merged
merged 4 commits into from
Jan 24, 2022

Conversation

sergiocazzolato
Copy link
Collaborator

This change includes new ubuntu Jammy as part of the regular spread executions.

…d7d23..dc6be12e76

dc6be12e76 Merge pull request #3 from snapcore/update-os-query
403242c037 Include jammy as part of the supported systems in os.query
8e2dca12b7 Merge branch 'main' of github.com:snapcore/snapd-testing-tools into main
217fadaf0d Run tests on pull requests
2e905b73ca Merge pull request #2 from snapcore/add-new-tools-doc
2cdc7691f2 Upda docs based on graham comments
fe151f4427 Adding a new section to the doc

git-subtree-dir: tests/lib/external/snapd-testing-tools
git-subtree-split: dc6be12e763a55d86e6f7126f3e77c78b479e880
Fix os.query test, initially was done:
https://github.com/snapcore/snapd-testing-tools.git main --squash

Also fixed cgroup tests
Copy link
Contributor

@stolowski stolowski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, but a few comments about changes that look unrelated.

@@ -1,8 +1,11 @@
name: Jobs
on:
pull_request:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this change intended for this PR?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@stolowski thanks for the review, I had to import snapd-testing-tools to support jammy and when I do that It includes all the changes in that project since the last import.

When we do the import we import the main branch by doing:

git subtree pull --prefix tests/lib/external/snapd-testing-tools/ https://github.com/snapcore/snapd-testing-tools.git main --squash

push:
branches:
- '**' # matches every branch
- main
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same.

Comment on lines +36 to +48
## Adding new tools

The tools included in this project are intended to be reused by other projects.

Read the following considerations before adding new tools:

- Each tool needs to be accompanied by at least 1 spread test in `tests/<tool-name>/`
- At least 1 spread test needs to be included in the tests directory for each tool
- If the tool is a shell script, it needs to first pass a [ShellCheck](https://github.com/koalaman/shellcheck) assessment
- All tools need to be as generic as possible
- Each tool must also provide a command line interface (CLI), including _help_ output


Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same.

@codecov-commenter
Copy link

Codecov Report

Merging #11274 (a8de286) into master (1126fd3) will decrease coverage by 0.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #11274      +/-   ##
==========================================
- Coverage   78.37%   78.36%   -0.02%     
==========================================
  Files         927      927              
  Lines      105610   105700      +90     
==========================================
+ Hits        82774    82831      +57     
- Misses      17693    17720      +27     
- Partials     5143     5149       +6     
Flag Coverage Δ
unittests 78.36% <ø> (-0.02%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
overlord/hookstate/hookmgr.go 74.67% <0.00%> (-0.65%) ⬇️
cmd/snap/cmd_debug_state.go 70.18% <0.00%> (-0.46%) ⬇️
overlord/snapstate/handlers.go 70.88% <0.00%> (-0.28%) ⬇️
overlord/ifacestate/handlers.go 64.87% <0.00%> (-0.15%) ⬇️
cmd/snap/cmd_userd.go 8.98% <0.00%> (-0.11%) ⬇️
wrappers/core18.go 0.00% <0.00%> (ø)
cmd/snap/cmd_run.go 60.60% <0.00%> (ø)
overlord/snapstate/snapmgr.go 80.35% <0.00%> (ø)
overlord/snapshotstate/snapshotmgr.go 80.00% <0.00%> (ø)
overlord/snapstate/backend/copydata.go 51.82% <0.00%> (ø)
... and 6 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1126fd3...a8de286. Read the comment docs.

Copy link
Contributor

@stolowski stolowski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@mvo5 mvo5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you

Copy link
Collaborator

@bboozzoo bboozzoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

@@ -276,6 +276,7 @@ jobs:
- ubuntu-20.04-64
- ubuntu-21.04-64
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we drop 21.04 in a followup then?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes

@@ -1,6 +1,6 @@
summary: measuring basic properties of device cgroup

# Disable the test on all systems that boot with cgroup v2
systems: [ -fedora-33-*, -fedora-34-*, -fedora-35-*, -debian-11-*, -debian-sid-*, -arch-*, -opensuse-tumbleweed-*, -ubuntu-21.10-*]
systems: [ -fedora-33-*, -fedora-34-*, -fedora-35-*, -debian-11-*, -debian-sid-*, -arch-*, -opensuse-tumbleweed-*, -ubuntu-21.10-*, -ubuntu-22.04-*]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reminds me we should probably clean up fedora 33 at some point.

@mvo5
Copy link
Contributor

mvo5 commented Jan 21, 2022

The tests fail right now with:

2022-01-20 18:36:56 Cannot allocate google:ubuntu-22.04-64: cannot find any Google image matching "ubuntu-os-cloud-devel/ubuntu-2204-lts" on project "ubuntu-os-cloud-devel"

@sergiocazzolato
Copy link
Collaborator Author

@mvo5, thanks for the review, the tests are failing because the image ubuntu-os-cloud-devel/ubuntu-2204-lts is in the second page and as spread doesn't have pagination for google backend, it can't get the image. I tested the image by using a local fork of spread but we need the pagination to get that image from the ubuntu-os-cloud-devel project.

@mvo5 mvo5 merged commit edc1417 into snapcore:master Jan 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants