Step defs formatter should report all available step defs even if they haven't been matched

[tooky]

Summary

The stepdefs formatter should report all step definitions available in the library of step defs, including steps from included libraries like aruba. The current behaviour is to only print step defs in the current project, or matched from included step libraries

Consider a project set up like this:

features/support/aruba.rb

require 'aruba/cucumber'

features/step_definitions/steps.rb

Given(/^a step$/) do
end

Expected Behavior

Running cucumber --format stepdefs

0.0000000 /^I run "(.*)"$/                                                                                     # aruba-0.14.2/lib/aruba/cucumber/command.rb:6
  NOT MATCHED BY ANY STEPS
0.0000000 /^I'm using a clean gemset "([^"]*)"$/                                                               # aruba-0.14.2/lib/aruba/cucumber/rvm.rb:1
  NOT MATCHED BY ANY STEPS
0.0000000 /^the test(?:s)? should( not)?(?: all)? pass with( regex)?:$/                                        # aruba-0.14.2/lib/aruba/cucumber/testing_frameworks.rb:81
  NOT MATCHED BY ANY STEPS
0.0000000 /^the tests(?:s)? should( not)?(?: all)? pass(?: with (\d+) failures?)?$/                            # aruba-0.14.2/lib/aruba/cucumber/testing_frameworks.rb:65
  NOT MATCHED BY ANY STEPS
0.0000000 /^the spec(?:s)? should( not)?(?: all)? pass with( regex)?:$/                                        # aruba-0.14.2/lib/aruba/cucumber/testing_frameworks.rb:48
  NOT MATCHED BY ANY STEPS
0.0000000 /^the spec(?:s)? should( not)?(?: all)? pass(?: with (\d+) failures?)?$/                             # aruba-0.14.2/lib/aruba/cucumber/testing_frameworks.rb:32
  NOT MATCHED BY ANY STEPS
0.0000000 /^the feature(?:s)? should( not)?(?: all)? pass with( regex)?:$/                                     # aruba-0.14.2/lib/aruba/cucumber/testing_frameworks.rb:14
  NOT MATCHED BY ANY STEPS
0.0000000 /^the feature(?:s)? should( not)?(?: all)? pass$/                                                    # aruba-0.14.2/lib/aruba/cucumber/testing_frameworks.rb:2
  NOT MATCHED BY ANY STEPS
0.0000000 /^the (?:file|directory)(?: named)? "([^"]*)" should( not)? have permissions "([^"]*)"$/             # aruba-0.14.2/lib/aruba/cucumber/file.rb:195
  NOT MATCHED BY ANY STEPS
0.0000000 /^the mode of filesystem object "([^"]*)" should (not )?match "([^"]*)"$/                            # aruba-0.14.2/lib/aruba/cucumber/file.rb:183
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" should (not )?be equal to file "([^"]*)"/                      # aruba-0.14.2/lib/aruba/cucumber/file.rb:175
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" should (not )?match \/([^\/]*)\/$/                             # aruba-0.14.2/lib/aruba/cucumber/file.rb:167
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" should (not )?match %r<([^\/]*)>$/                             # aruba-0.14.2/lib/aruba/cucumber/file.rb:159
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" should (not )?contain exactly:$/                               # aruba-0.14.2/lib/aruba/cucumber/file.rb:151
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" should (not )?contain:$/                                       # aruba-0.14.2/lib/aruba/cucumber/file.rb:143
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" should (not )?contain "([^"]*)"$/                              # aruba-0.14.2/lib/aruba/cucumber/file.rb:135
  NOT MATCHED BY ANY STEPS
0.0000000 /^the following directories should (not )?exist:$/                                                   # aruba-0.14.2/lib/aruba/cucumber/file.rb:125
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) (\d+) byte file(?: named)? "([^"]*)" should (not )?exist$/                               # aruba-0.14.2/lib/aruba/cucumber/file.rb:117
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file matching %r<(.*?)> should (not )?exist$/                                            # aruba-0.14.2/lib/aruba/cucumber/file.rb:109
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) (file|directory)(?: named)? "([^"]*)" should (not )?exist(?: anymore)?$/                 # aruba-0.14.2/lib/aruba/cucumber/file.rb:91
  NOT MATCHED BY ANY STEPS
0.0000000 /^the following files should (not )?exist:$/                                                         # aruba-0.14.2/lib/aruba/cucumber/file.rb:81
  NOT MATCHED BY ANY STEPS
0.0000000 /^I cd to "([^"]*)"$/                                                                                # aruba-0.14.2/lib/aruba/cucumber/file.rb:77
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) (?:file|directory)(?: named)? "([^"]*)" does not exist$/                                 # aruba-0.14.2/lib/aruba/cucumber/file.rb:73
  NOT MATCHED BY ANY STEPS
0.0000000 /^I remove (?:a|the) (?:file|directory)(?: named)? "([^"]*)"( with full force)?$/                    # aruba-0.14.2/lib/aruba/cucumber/file.rb:69
  NOT MATCHED BY ANY STEPS
0.0000000 /^I append to "([^"]*)" with "([^"]*)"$/                                                             # aruba-0.14.2/lib/aruba/cucumber/file.rb:65
  NOT MATCHED BY ANY STEPS
0.0000000 /^I append to "([^"]*)" with:$/                                                                      # aruba-0.14.2/lib/aruba/cucumber/file.rb:61
  NOT MATCHED BY ANY STEPS
0.0000000 /^I overwrite(?: (?:a|the) file(?: named)?)? "([^"]*)" with:$/                                       # aruba-0.14.2/lib/aruba/cucumber/file.rb:57
  NOT MATCHED BY ANY STEPS
0.0000000 /^I write to "([^"]*)" with:$/                                                                       # aruba-0.14.2/lib/aruba/cucumber/file.rb:53
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:an|the) empty file(?: named)? "([^"]*)" with mode "([^"]*)"$/                                   # aruba-0.14.2/lib/aruba/cucumber/file.rb:48
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:an|the) empty file(?: named)? "([^"]*)"$/                                                       # aruba-0.14.2/lib/aruba/cucumber/file.rb:44
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) (\d+) byte file(?: named)? "([^"]*)"$/                                                   # aruba-0.14.2/lib/aruba/cucumber/file.rb:40
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" with mode "([^"]*)" and with:$/                                # aruba-0.14.2/lib/aruba/cucumber/file.rb:35
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" with "([^"]*)"$/                                               # aruba-0.14.2/lib/aruba/cucumber/file.rb:31
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:an|the) executable(?: named)? "([^"]*)" with:$/                                                 # aruba-0.14.2/lib/aruba/cucumber/file.rb:27
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) file(?: named)? "([^"]*)" with:$/                                                        # aruba-0.14.2/lib/aruba/cucumber/file.rb:23
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the) directory(?: named)? "([^"]*)" with mode "([^"]*)"$/                                     # aruba-0.14.2/lib/aruba/cucumber/file.rb:18
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:a|the|(?:an empty)) directory(?: named)? "([^"]*)"$/                                            # aruba-0.14.2/lib/aruba/cucumber/file.rb:14
  NOT MATCHED BY ANY STEPS
0.0000000 /^I move (?:a|the) (file|directory)(?: (?:named|from))? "([^"]*)" to "([^"]*)"$/                     # aruba-0.14.2/lib/aruba/cucumber/file.rb:10
  NOT MATCHED BY ANY STEPS
0.0000000 /^I copy (?:a|the) (file|directory)(?: (?:named|from))? "([^"]*)" to "([^"]*)"$/                     # aruba-0.14.2/lib/aruba/cucumber/file.rb:6
  NOT MATCHED BY ANY STEPS
0.0000000 /^I use (?:a|the) fixture(?: named)? "([^"]*)"$/                                                     # aruba-0.14.2/lib/aruba/cucumber/file.rb:1
  NOT MATCHED BY ANY STEPS
0.0000000 /^I prepend the values? to the environment variables?:/                                              # aruba-0.14.2/lib/aruba/cucumber/environment.rb:35
  NOT MATCHED BY ANY STEPS
0.0000000 /^I append the values? to the environment variables?:/                                               # aruba-0.14.2/lib/aruba/cucumber/environment.rb:26
  NOT MATCHED BY ANY STEPS
0.0000000 /^I set the environment variables? to:/                                                              # aruba-0.14.2/lib/aruba/cucumber/environment.rb:17
  NOT MATCHED BY ANY STEPS
0.0000000 /^I prepend "(.*)" to the environment variable "(.*)"/                                               # aruba-0.14.2/lib/aruba/cucumber/environment.rb:13
  NOT MATCHED BY ANY STEPS
0.0000000 /^I append "(.*)" to the environment variable "(.*)"/                                                # aruba-0.14.2/lib/aruba/cucumber/environment.rb:9
  NOT MATCHED BY ANY STEPS
0.0000000 /^I set the environment variable "(.*)" to "(.*)"/                                                   # aruba-0.14.2/lib/aruba/cucumber/environment.rb:5
  NOT MATCHED BY ANY STEPS
0.0000000 /^a mocked home directory$/                                                                          # aruba-0.14.2/lib/aruba/cucumber/environment.rb:1
  NOT MATCHED BY ANY STEPS
0.0000000 /^I look for executables in "(.*)" within the current directory$/                                    # aruba-0.14.2/lib/aruba/cucumber/command.rb:420
  NOT MATCHED BY ANY STEPS
0.0000000 /^I send the signal "([^"]*)" to the command (?:"([^"]*)"|(?:started last))$/                        # aruba-0.14.2/lib/aruba/cucumber/command.rb:409
  NOT MATCHED BY ANY STEPS
0.0000000 /^I wait (\d+) seconds? for (?:a|the) command to start up$/                                          # aruba-0.14.2/lib/aruba/cucumber/command.rb:405
  NOT MATCHED BY ANY STEPS
0.0000000 /^the (?:default )?aruba stop signal is "([^"]*)"$/                                                  # aruba-0.14.2/lib/aruba/cucumber/command.rb:401
  NOT MATCHED BY ANY STEPS
0.0000000 /^the (?:default )?aruba exit timeout is (\d+) seconds?$/                                            # aruba-0.14.2/lib/aruba/cucumber/command.rb:397
  NOT MATCHED BY ANY STEPS
0.0000000 /^the (?:default )?aruba io wait timeout is (\d+) seconds?$/                                         # aruba-0.14.2/lib/aruba/cucumber/command.rb:393
  NOT MATCHED BY ANY STEPS
0.0000000 /The default aruba timeout is (\d+) seconds/                                                         # aruba-0.14.2/lib/aruba/cucumber/command.rb:385
  NOT MATCHED BY ANY STEPS
0.0000000 /the default aruba timeout is (\d+) seconds/                                                         # aruba-0.14.2/lib/aruba/cucumber/command.rb:377
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:the )?(output|stdout|stderr) should( not)? contain all of these lines:$/                        # aruba-0.14.2/lib/aruba/cucumber/command.rb:356
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:the )?(output|stderr|stdout) should not contain anything$/                                      # aruba-0.14.2/lib/aruba/cucumber/command.rb:341
  NOT MATCHED BY ANY STEPS
0.0000000 /^it should( not)? (pass|fail) (?:with regexp?|matching):$/                                          # aruba-0.14.2/lib/aruba/cucumber/command.rb:327
  NOT MATCHED BY ANY STEPS
0.0000000 /^it should( not)? (pass|fail) with exactly:$/                                                       # aruba-0.14.2/lib/aruba/cucumber/command.rb:313
  NOT MATCHED BY ANY STEPS
0.0000000 /^it should( not)? (pass|fail) with:$/                                                               # aruba-0.14.2/lib/aruba/cucumber/command.rb:299
  NOT MATCHED BY ANY STEPS
0.0000000 /^it should( not)? (pass|fail) with "(.*?)"$/                                                        # aruba-0.14.2/lib/aruba/cucumber/command.rb:285
  NOT MATCHED BY ANY STEPS
0.0000000 /^the exit status should( not)? be (\d+)$/                                                           # aruba-0.14.2/lib/aruba/cucumber/command.rb:277
  NOT MATCHED BY ANY STEPS
0.0000000 /^the output should( not)? match:$/                                                                  # aruba-0.14.2/lib/aruba/cucumber/command.rb:269
  NOT MATCHED BY ANY STEPS
0.0000000 /^the output should( not)? match %r<([^>]*)>$/                                                       # aruba-0.14.2/lib/aruba/cucumber/command.rb:261
  NOT MATCHED BY ANY STEPS
0.0000000 /^the output should( not)? match \/([^\/]*)\/$/                                                      # aruba-0.14.2/lib/aruba/cucumber/command.rb:253
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:the )?(output|stderr|stdout)(?: from "([^"]*)")? should( not)? contain( exactly)?:$/            # aruba-0.14.2/lib/aruba/cucumber/command.rb:205
  NOT MATCHED BY ANY STEPS
0.0000000 /^(?:the )?(output|stderr|stdout)(?: from "([^"]*)")? should( not)? contain( exactly)? "([^"]*)"$/   # aruba-0.14.2/lib/aruba/cucumber/command.rb:159
  NOT MATCHED BY ANY STEPS
0.0000000 /^the output should be (\d+) bytes long$/                                                            # aruba-0.14.2/lib/aruba/cucumber/command.rb:155
  NOT MATCHED BY ANY STEPS
0.0000000 /^I wait for (?:output|stdout) to contain "([^"]*)"$/                                                # aruba-0.14.2/lib/aruba/cucumber/command.rb:140
  NOT MATCHED BY ANY STEPS
0.0000000 /^I wait for (?:output|stdout) to contain:$/                                                         # aruba-0.14.2/lib/aruba/cucumber/command.rb:125
  NOT MATCHED BY ANY STEPS
0.0000000 /^I stop the command(?: started last)? if (output|stdout|stderr) contains:$/                         # aruba-0.14.2/lib/aruba/cucumber/command.rb:96
  NOT MATCHED BY ANY STEPS
0.0000000 /^I (terminate|stop) the command (?:"([^"]*)"|(?:started last))$/                                    # aruba-0.14.2/lib/aruba/cucumber/command.rb:73
  NOT MATCHED BY ANY STEPS
0.0000000 /^I pipe in (?:a|the) file(?: named)? "([^"]*)"$/                                                    # aruba-0.14.2/lib/aruba/cucumber/command.rb:67
  NOT MATCHED BY ANY STEPS
0.0000000 /^I close the stdin stream$/                                                                         # aruba-0.14.2/lib/aruba/cucumber/command.rb:63
  NOT MATCHED BY ANY STEPS
0.0000000 /^I type "([^"]*)"$/                                                                                 # aruba-0.14.2/lib/aruba/cucumber/command.rb:59
  NOT MATCHED BY ANY STEPS
0.0000000 /^I run `([^`]*)` in background$/                                                                    # aruba-0.14.2/lib/aruba/cucumber/command.rb:55
  NOT MATCHED BY ANY STEPS
0.0000000 /^I run `([^`]*)` interactively$/                                                                    # aruba-0.14.2/lib/aruba/cucumber/command.rb:49
  NOT MATCHED BY ANY STEPS
0.0000000 /^I run "([^"]*)" interactively$/                                                                    # aruba-0.14.2/lib/aruba/cucumber/command.rb:43
  NOT MATCHED BY ANY STEPS
0.0000000 /^I run the following (?:commands|script)(?: (?:with|in) `([^`]+)`)?:$/                              # aruba-0.14.2/lib/aruba/cucumber/command.rb:32
  NOT MATCHED BY ANY STEPS
0.0000000 /^I successfully run `(.*?)`(?: for up to (\d+) seconds)?$/                                          # aruba-0.14.2/lib/aruba/cucumber/command.rb:27
  NOT MATCHED BY ANY STEPS
0.0000000 /^I successfully run "(.*)"$/                                                                        # aruba-0.14.2/lib/aruba/cucumber/command.rb:18
  NOT MATCHED BY ANY STEPS
0.0000000 /^I run `([^`]*)`$/                                                                                  # aruba-0.14.2/lib/aruba/cucumber/command.rb:13
  NOT MATCHED BY ANY STEPS
0.0000000 /^a step$/                                                                                           # features/step_definitions/steps.rb:1
  NOT MATCHED BY ANY STEPS

0 scenarios
0 steps
0m0.000s

Current Behavior

Running cucumber --format stepdefs

0.0000000 /^a step$/   # features/step_definitions/steps.rb:1
  NOT MATCHED BY ANY STEPS

0 scenarios
0 steps
0m0.000s

[tooky]

I've create a repo that show's the error over here: https://github.com/tooky/cucumber-stepdefs-formatter-regression

[brasmusson]

If the arub steps are not listed it is because they were loaded (and the step_definition_registered event fired) before the after_configuration hooks are called and the formatters created (here).

Problem:
The formatters cannot be created before the support code is loaded.
A possible remedy:
Let the event bus delay the event received before the after_configuartion and the creation of formatters, and only after that pass them on.

[brasmusson]

Fixed by cucumber/cucumber-ruby-core#136.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.