Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: identify and mark non-exclusive tests #2265

Closed
wants to merge 3 commits into from

Conversation

Adam0Brien
Copy link
Member

Added Exclusive false to kola tests to make it easier to distinguish what tests can run together in a single vm.

#1229

@Adam0Brien Adam0Brien self-assigned this Feb 28, 2023
Copy link
Contributor

@bgilbert bgilbert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a number of tests here that reboot the machine or reconfigure it in some way. We'd need to decide how aggressive we want to be in assuming that those tests won't interfere with each other, or with a test that's added later.

tests/kola/ignition/remote/test.sh Outdated Show resolved Hide resolved
tests/kola/clhm/ignition-warnings/test.sh Outdated Show resolved Hide resolved
@@ -34,7 +34,7 @@ case ${arch} in
device=$(realpath /dev/disk/by-partlabel/PowerPC-PReP-boot)
# sync grub2-install parameter according to image build script
# https://github.com/coreos/coreos-assembler/blob/main/src/create_disk.sh
grub_install_args="--no-nvram"
grub_install_args="--no-nvram"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not a big deal here, but normally we'd put formatting changes in a separate commit.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry about that, i have vs code set up to auto trim white space..

@dustymabe
Copy link
Member

dustymabe commented Mar 1, 2023

There are a number of tests here that reboot the machine or reconfigure it in some way. We'd need to decide how aggressive we want to be in assuming that those tests won't interfere with each other, or with a test that's added later.

I think probably a safe rule of thumb here is that if a test has a butane config (or Ignition config) then we should probably assume it's exclusive and not mark it exclusive: false.

Maybe that means that there are no remaining tests to mark as exclusive? I'm not sure

@@ -20,3 +20,4 @@ echo 'grp1:*::somebody.a1,somebody.a2,somebody.a3,somebody.a4,somebody.a5,somebo
echo 'grp2:*::root' >> /etc/gshadow
systemd-sysusers
echo "ok sysusers gshadow"

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this isn't a meaningful change.. delete?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This originally added a newline and is now removing one. On Unix systems, text files traditionally end with a single newline.

@bgilbert
Copy link
Contributor

bgilbert commented Mar 1, 2023

I think probably a safe rule of thumb here is that if a test has a butane config (or Ignition config) then we should probably assume it's exclusive and not mark it exclusive: false.

Also, if there are reboots, the test may be changing the system, or at least is distinguishing between first and second boots. Multiple tests can't do that, either in series or in parallel.

@bgilbert
Copy link
Contributor

bgilbert commented Mar 1, 2023

All of the remaining tests specify test-specific kernel arguments, and some also configure additional network devices. I think we should probably just close this.

@dustymabe
Copy link
Member

I think we should probably just close this.

Yeah probably. Sorry Adam for the goose chase. At least we can probably close #1229 now.

@Adam0Brien
Copy link
Member Author

I think we should probably just close this.

Yeah probably. Sorry Adam for the goose chase. At least we can probably close #1229 now.

No problem still learned alot about kola tests 👍

@dustymabe dustymabe closed this Mar 2, 2023
@Adam0Brien Adam0Brien deleted the kola-testing branch July 6, 2023 19:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants