implement CI tests as xtask

[spookyvision]

this xtask implementation fixes #366 and

• collects all test errors in one grand result vec and displays them at the end
• has commands for test-all, test-host, test-cross etc.
• has -k switch to keep targets that were installed as required dependency
• displays colored diff for failed snapshot tests
• puts "macos book build fixes" in separate commit ( c847772 ) - please review
• updates the ci yaml to use this xtask

not done:

• install os specific packages like libusb (out of scope, IMO)

[Urhengulas]

I checked if you missed to transfer any tests, but seems good to me.

fn test_single_snapshot looks a bit messy to me, but from what I understand it does the same as firmware/qemu/test.sh.

One question I am unsure about: Why is the --deny-warnings only looked at in test_host and not the other tests as well?

[Urhengulas]

const 🎉

[spookyvision]

I checked if you missed to transfer any tests, but seems good to me.

fn test_single_snapshot looks a bit messy to me, but from what I understand it does the same as firmware/qemu/test.sh.

One question I am unsure about: Why is the --deny-warnings only looked at in test_host and not the other tests as well?

@jonas-schievink what do you think?

[jonas-schievink]

test_single_snapshot seems okay for now, we can clean it up later though.

One question I am unsure about: Why is the --deny-warnings only looked at in test_host and not the other tests as well?

I don't think there was a particular reason we did this, but if there's a .cargo/config.toml then RUSTFLAGS overrides that, which would break the build, so we can't always set it.

[Urhengulas]

test_single_snapshot seems okay for now, we can clean it up later though.

One question I am unsure about: Why is the --deny-warnings only looked at in test_host and not the other tests as well?

I don't think there was a particular reason we did this, but if there's a .cargo/config.toml then RUSTFLAGS overrides that, which would break the build, so we can't always set it.

I don't really question the existence of the cmdline-arg, but rather why it is only taken into account for some tests and not also e.g. the test_cross.

[Urhengulas]

I checked the test.sh and as far as I could understand you translated it properly. Can we delete the old file then?

Also I discovered another small nit while looking through the code xD

[spookyvision]

bors r+

[bors]

Build succeeded:

• ci

[Urhengulas]

🎉