dockerfile: smoke tests for binaries

[crazy-max]

follow-up #4356 (comment)

Our pipeline run tests regardless if binaries are broken. This adds smoke test to built binaries (runc, buildctl, buildkitd) and also makes test job depends on binaries one so we avoid unnecessary build queues.

[tonistiigi]

So this is to test possible cross-compilation errors? Did we hit any of such errors (not clear about conditions in #4356 (comment)) ?

If this is desired then why not just check the binary after building it? Where we currently run xx-verify.

[crazy-max]

So this is to test possible cross-compilation errors? Did we hit any of such errors (not clear about conditions in #4356 (comment)) ?

Yes for cross-comp as well, we got an issue when running validate-docs target and integration tests as well https://github.com/moby/buildkit/actions/runs/6586246066/job/17894326770?pr=4356#step:8:12727

0.094 + buildctl --version
0.106 error: cannot merge resource due to conflicting Schema URL

0.094 + buildkitd --version
0.106 error: cannot merge resource due to conflicting Schema URL

So I think before running any tests we should make sure binaries are not broken.

If this is desired then why not just check the binary after building it? Where we currently run xx-verify.

Yes it would better in this stage, I will make some changes.

[tonistiigi]

0.094 + buildctl --version
0.106 error: cannot merge resource due to conflicting Schema URL

But this would show up in integration tests (unless cross-comp only). Is this to fail before running any test suites for this specific case.

[crazy-max]

0.094 + buildctl --version
0.106 error: cannot merge resource due to conflicting Schema URL

But this would show up in integration tests (unless cross-comp only). Is this to fail before running any test suites for this specific case.

Yes the idea is to avoid running tests if binaries are broken so we avoid unnecessary build queues.