Optimize CI

Currently we're doing the full build for every variant, but only the gpu.o build is really affected by unbound/large_biomes changes, as far as I'm aware.

We should probably do an incremental compile here for each without the matrix.