-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Extend configuration files to support individual test configurations #487
Comments
|
If no Testcase parameters are present in the ttcn-3 definition |
|
Bug or Feature? Conflicting map-keys produce an error. Example: # ./package.yml
parameters_file: ./example.parameters
parameters:
"Foo": 5
# ./example.parameters
parameters:
"Foo": 23
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We need a way to configure test runs individually, because:
numberOfUEs
)testConn(useIPv6 := true)
andtestConn(useIPv4 := false)
Problem is, the parameters file is not integrated in ntt and package.yml provides only rudimentary configuration. Therefore we should:
ntt show --json
).YAML Scheme
This scheme will be used for parameters files and for extending package.yml, as well.
Test Configuration
The basic building block is a test configuration object. A test configuration should include:
Suggested scheme:
Parameters File
The parameters file contains a single test configuration as root object. This root object is extended by a set of alternate test configurations (== presets) and a list of test specific configurations.
Suggested scheme:
Behaviour
Overriding
Example:
When preset "p" is active, test tc1 will be executed with this configuration:
Execution
Every entry in
execute
behaves like a individual test execution.Example: Assume a test suite with three tests (Foo, Bar and Baz) and following parameters file:
Result: 4 runs in total: Foo will be run twice (once with default parameters and once with parameter 2), Bar and Baz once.
Result: 1 run in total: Only Baz is executed with global parameters, even though it is not explicitly listed.
Result: 1 run in total: Only Bar is executed with test specific parameters.
Result: 2 runs in total: Foo will be run twice (once with default testcase parameters and once with parameter 2)
Open Questions
"Mod1.DataDir": "${SCT_SOURCE_DIR}/share"
)?except:presets
,only:presets
andtest
(ietest: "test.Feature*"
)?except:presets
andonly:presets
?test
orexcept
spec?test
orexcept
spec?test
spec?The text was updated successfully, but these errors were encountered: