Building the binaries in all workflows allows to test changes in the
natives in verification builds immediately on all platforms and not only
on Linux because Jenkins re-builds the binaries.
Additionally this saves a lot of precious Git-LFS bandwidth.