[New Feature]: Add tests that run only on demand #40406
Labels
Area/TestFramework
IceBox
Reason/Other
None of the other reasons.
Team/DevTools
Ballerina Developer Tooling ( CLI, Test FW, Package Management, OpenAPI, APIDocs )
Type/NewFeature
Description
Make it possible to annotate tests as "optional" so that they run only with a special flag to the bal test command.
Describe your problem(s)
While it is possible to disable a set of tests using
--disable-groups
, for projects that have tests that are not supposed to run by default (such as property-based tests that randomly generate a large number of random tests) this means their default test command becomesbal test --disable-groups <...>
and their special case (running all tests)bal test
. I think it is better if it is possible to makebal test
the default option even for such cases.Describe your solution(s)
Have an annotation (similar to
enabled
) that mark these tests run only on demand (sayoptional
) and have a special flag (similar to--groups
, say run--run-optional
) that will run all of these tests as well. (Or make the--groups
causesoptional
to be ignored)Related area
-> Test Framework
Related issue(s) (optional)
No response
Suggested label(s) (optional)
No response
Suggested assignee(s) (optional)
No response
The text was updated successfully, but these errors were encountered: