Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Improve BWC Tests and coverage #710

Open
3 tasks
dbwiddis opened this issue May 7, 2024 · 0 comments
Open
3 tasks

[CI] Improve BWC Tests and coverage #710

dbwiddis opened this issue May 7, 2024 · 0 comments
Labels
backlog Good to have functionality not critical for next release CI CI related issues

Comments

@dbwiddis
Copy link
Member

dbwiddis commented May 7, 2024

Is your feature request related to a problem?

Our BWC tests are limited and essentially were the minimum required for the feature they were added with. We need to increase coverage and capability of the tests.

What solution would you like?

  • Currently the old version is fixed to 2.12 (for the single feature we test). We need to test a range of previous versions.
  • Currently rolling upgrades are disabled on major version changes. We need to test "latest 2.x" vs. 3.x rolling upgrade.
  • Currently tests run without security plugin. This makes it impossible to use that plugin API to register a User to accurately test BWC on indices related to the User field (I'm looking at you, Add user mapping to Workflow State index #705). Tests should run with and without security.

What alternatives have you considered?

Manually performing one-time BWC checks when introducing a new feature and hoping you covered all the situations (which you probably didn't.)

Do you have any additional context?

It may be useful to work on #555 at the same time as this issue.

See this commit for a failed attempt to fix some of the above issues existing tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backlog Good to have functionality not critical for next release CI CI related issues
Projects
None yet
Development

No branches or pull requests

1 participant