Enable Releasing Compiled Test Binaries

[kalverra]

Is your feature request related to a problem? Please describe.

I'd like to release some binaries of my compiled tests, usually achieved with the following command.

go test -c ./path/to/tests -o binary.name

I'd love to use goreleaser for this, but it seems to lack this option. I tried using

gobinary: "go test -c"

with no luck.

Describe the solution you'd like

Enable an option like

# Have this build compile go tests using `go test -c` instead of using the typical `go build`
# true (default), or false
compile_tests: true

Describe alternatives you've considered

Right now it looks like I'm going to be explicitly compiling these test binaries and using something like this tool to release them.

Search

• I did search for other open and closed issues before opening this.

Code of Conduct

• I agree to follow this project's Code of Conduct

Additional context

No response

[caarlos0]

I think it should work if you add -c to the flags section in the builds config, can you try that?

[kalverra]

@caarlos0 Looks like the same issue

builds:
  - id: "smoke-tests"
    binary: smoke.test
    dir: ./suite/smoke
    flags: 
      - -c

release failed after 0.74s error=build for smoke.test does not contain a main function

[kalverra]

Also, this is a more niche case, but we tend to use Ginkgo to help write and compile our tests. Ginkgo compiles tests using ginkgo build ./path/to/tests so I tried utilizing that as the gobinary value. got the same error.

builds:
  - id: "smoke-tests"
    binary: smoke.test
    dir: ./suite/smoke
    gobinary: "ginkgo"

release failed after 0.77s error=build for smoke.test does not contain a main function

[caarlos0]

release failed after 0.74s error=build for smoke.test does not contain a main function

ahh, I forgot about this

curious though: what's the use case of releasing test binaries?

[kalverra]

We're working on a testing framework that includes its own suite of default tests, ones that we'd like other projects to be able to quickly download and utilize without having to clone our repo.

[caarlos0]

Made a quick prototype here, what do you think about options like this?