RuntimeOptions should also clobber the formatters

[brasmusson]

When overriding the arguments from the command line/@CucumberOptions annotation with cucumber.options system property, all options that can hold multiple value are clobbered if provided in system property, except for the formatters option. That is the glue paths, the feature paths and the tag/line/name filters are clobbered if provided in the system property, but not the formatters.

That the formatters should also be formatters is indicated in the Specify a different formatter section of the ReadMe file of the example java-helloworld. The current behaviour is more accurately describes as "Specify an additional formatter".

[aslakhellesoy]

Thanks Björn, but we're actually rely on this feature in Cucumber Pro. Cucumber Pro will enable the CucumberPro formatter by adding a line in cucumber.properties. This allows the formatter to run regardless of what the user has set.

More info here: https://github.com/cucumber-ltd/cucumber-pro-jvm

[brasmusson]

I could be a bit confusing that the overriding behavior is different for the "--format", compared to glue, tags and features, see for instance this comment (and reply).

At least documentation like in cucumber-java-skeleton, should be updated to read "Specify an additional formatter"

If judging consistency is important, an alternative would be to add an "--add-format" option for Cucumber Pro to use (and make "--format" clobber formatters).

[aslakhellesoy]

Done! cucumber/cucumber-java-skeleton@9c8681b

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.