Skip to content

--grep is case insensitive in the mode "dry-run" whereas case sensitive in the mode "run" #4222

@mirao

Description

@mirao

What are you trying to achieve?

I would expect that "run" and "dry-run" modes have the same behavior related to case-sensitivity of tags.
Personally I prefer case-insensitive tags so that I don't want to think if I need to pass the tag @problem or @Problem
https://codecept.io/advanced/#tags doesn't say anything about case sensitivity.

What do you get instead?

run is "case sensitive" when using --grep

$ codeceptjs run --grep @Problem
CodeceptJS v3.5.14 #StandWithUkraine
Using test root "/home/mirao/workspace/tmp"


  OK  | 0 passed   // 0ms

dry-run is "case insensitive" when using --grep

$ codeceptjs dry-run --grep @Problem
Tests from /home/mirao/workspace/tmp:

My @problem -- /home/mirao/workspace/tmp/My_test.ts -- 1 tests
  ☐ test something

  Total: 1 suites | 1 tests  

--- DRY MODE: No tests were executed ---

Provide test source code if related

Feature('My').tag("@problem");

Scenario('test something',  ({ I }) => {
    I.amOnPage('https://www.google.com');
});

Details

  • CodeceptJS version: 3.5.14
  • NodeJS Version: v18.19.1
  • Operating System: Ubuntu 22.04
  • Configuration file:
import { setHeadlessWhen, setCommonPlugins } from '@codeceptjs/configure';
// turn on headless mode when running with HEADLESS=true environment variable
// export HEADLESS=true && npx codeceptjs run
setHeadlessWhen(process.env.HEADLESS);

// enable all common plugins https://github.com/codeceptjs/configure#setcommonplugins
setCommonPlugins();

export const config: CodeceptJS.MainConfig = {
  tests: './*_test.ts',
  output: './output',
  helpers: {
    Playwright: {
      browser: 'chromium',
      url: 'http://localhost',
      show: true
    }
  },
  include: {
    I: './steps_file'
  },
  name: 'tmp'
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions