Skip to content
This repository has been archived by the owner on Feb 7, 2023. It is now read-only.

Adapt the 'rpm-ostree' test suite to continue on failure #404

Merged
merged 7 commits into from
Jun 1, 2018

Conversation

miabbott
Copy link
Collaborator

This adapts the rpm-ostree test suite to the continue on failure model. As part of the work, I made some slight changes to the 'compose' portion of the test suite to make it a bit more resilient.

Additionally, I snuck in a change to the .gitignore file to ignore the .log files that are being generated.

Partially addresses #375

This changes the `rpm-ostree` test suite to use the 'continue on
failure' model.

Partially addresses projectatomic#375
This worked well on a pristine system, but I was getting tripped up
when re-using a test sytsem.  This cleans up some of the transient
artifacts that can be generated by the compose.

Additionally, I added a `wait_for` to make sure the HTTP server
starts.
@miabbott
Copy link
Collaborator Author

bot, retest this please

1 similar comment
@miabbott
Copy link
Collaborator Author

bot, retest this please

We were seeing instances where variable values passed to `import_role`
where not being respected each time it was called.  I thought that
each time an 'import' was done the changed variables would be
respected, but that doesn't appear to be the case.

Using `include_role` will allow us to dynamically load in variables
each time the role is used.  This is kind of troubling as we made a
large switch to using `include_role` in most places, but we've not run
into any problems like this yet.
This is a forward-port of functionality from projectatomic#405 which corrects an
assumption about how Ansible was handling failures.
Copy link
Collaborator

@mike-nguyen mike-nguyen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good overall. We should either move the ostree admin status test to a separate test or remove it completely and add it to the improved-sanity-test

- name: Run ostree admin status as a quick sanity check
command: ostree admin status
tags:
- ostree_admin_status
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this be moved into a separate test?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably a good candidate for the sanity test

@miabbott
Copy link
Collaborator Author

miabbott commented Jun 1, 2018

Oof...that was a lazy commit. Trying to use a task among the roles: 😞

Working on a fix...

In projectatomic#381, a sanity check for `ostree admin status` was added to the
`rpm-ostree` test suite.  It is probably better suited to the 'sanity'
test suite so we are able to catch any regressions earlier in the
testing cycle.

I created a dumb role for the `ostree admin status` command since that
was easier than trying to wedge it into an existing role.
@mike-nguyen
Copy link
Collaborator

mike-nguyen commented Jun 1, 2018

LGTM!

@mike-nguyen mike-nguyen merged commit 70b21a7 into projectatomic:master Jun 1, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants