Debian spread tests #74

Closed
wants to merge 4 commits into
from

Conversation

Projects
None yet
2 participants
Collaborator

zyga commented Jul 7, 2016

This patch just removes various blacklists that kept tests from running
on Jessie. Now that we have a Sid image we can run tests there.

zyga added some commits Jul 7, 2016

Tweak VENDOR_ARGS
This patch changes VENDOR_ARGS in two ways, first on Ubuntu we get
—enable-nvidia-ubuntu. In the past this was always on which was never
really tested

Second, now —enable-roofs-is-core-snap is enabled by default. All the
distributions (including Ubuntu) are shipping it now so it’s time for
Debian to follow.

Lastly (did I say two?) the —disable-confinement option is replaced by
—disable-apparmor.
Replace debian-8 with debian-sid-grub
This patch switches from Jessie to Sid. Sid has snapd and enough of
recent userspace bits to compile and run everything we need.
Split hello-world test
This patch splits the hello-world test so that the basic
install-and-runs test is ran everywhere. There is a 2nd test that
ensures hello-world.evil is failing (because of confinement) that is
only started on ubuntu.
Remove debian-8 blacklists
This patch just removes various blacklists that kept tests from running
on Jessie. Now that we have a Sid image we can run tests there.
@@ -0,0 +1,13 @@
+summary: Check that hello-world.evil is confined
@niemeyer

niemeyer Jul 7, 2016

What's actually being tested here? We're of course not very interested in hello world itself.

@niemeyer

niemeyer Jul 7, 2016

Reading the logic, this might be "Check that confinement works", and the test name might be "confined-blocked" or similar.

+restore: |
+ snap remove hello-world
+execute: |
+ cd /
@niemeyer

niemeyer Jul 7, 2016

Seems unnecessary.

+ cd /
+ echo Run some hello-world stuff
+ snap install hello-world
+ hello-world.echo | grep Hello
@niemeyer

niemeyer Jul 7, 2016

This test may be ported to use test-snapd-tools, which offers saner apps for this sort of testing. Rather than "evil", try to exercise the system in some way that is expected to break with "cat /foo", for example.

Collaborator

zyga commented Aug 16, 2016

I'll close this for now. I will reopen it with new way to support Debian.

@zyga zyga closed this Aug 16, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment