Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

forward also case- and step results #304

Closed
simonmeggle opened this issue Feb 2, 2018 · 1 comment
Closed

forward also case- and step results #304

simonmeggle opened this issue Feb 2, 2018 · 1 comment

Comments

@simonmeggle
Copy link

simonmeggle commented Feb 2, 2018

Send the results optionally also on a case/step basis.
Change proposals:

class TestCase
old usage:

var testCase = new TestCase(20,30[, path]);

new usage:

var testCase = new TestCase(["custom-caseId", 20,30, "optional-image-path"]);
TestCase.addImagePaths(path);
  • the first parameter can overwrite the case id derived from the case folder name
  • parameter 2 and 3 specify the warning/critical threshold
  • parameter path will be deprecated => use TestCase.addImagePaths(imagePaths) instead to overwrite the default image search path

method endOfStep
old usage:

TestCase.endOfStep("foo", 10);

new usage:

TestCase.endOfStep("foo", 10,[ 20, true]);
  • add a critical threshold parameter (keep compatibility to warning-only definitions!)
  • add a forward flag which sends the step result to forwarder. For monitoring forwarders the following object names are used:
    ** hostname: (taken from forwarder definition)
    ** service_description: ${testsuite.id}_${testcase.id}_${teststep.id}

method saveResult()
old usage:

testCase.saveResult();

new usage:

TestCase.saveResult(true)
  • add a forward flag which sends the case result to forwarder. The case execution will stop afterwards. For monitoring forwarders the following object names are used:
    ** hostname: (taken from forwarder definition)
    ** service_description: ${testsuite.id}_${testcase.id} (as defined by case folder name or TestCase object initialization, see above)

⚠️ General note: Rhino script currently DON'T support named parameter like ES2015 Script does. Something like testCase.endOfStep({stepName: "Calculation", optForward: true}); is not possible 😢

@toschneck
Copy link
Contributor

toschneck commented Feb 19, 2018

Change internal forwarder implementation:

@ghost ghost added IN PROGRESS and removed READY labels Feb 27, 2018
joroboro pushed a commit that referenced this issue Mar 2, 2018
…itrary test data entity and not only test suite. Forward flag added to TestCase.endOfStep and TestCase.saveResult.
toschneck pushed a commit that referenced this issue Mar 8, 2018
…lts' into feature/304_forward_case_and_step_results
joroboro pushed a commit that referenced this issue Mar 23, 2018
…ailing integration test. If during the execution of the integration tests in maven an error occurred, the SakuliExceptionHandler is not set and throws an NullPointerException. This is the reason why the test report at the end is not shown, but only the NullPointerException is visible.
simonmeggle pushed a commit that referenced this issue Mar 27, 2018
toschneck pushed a commit that referenced this issue Apr 12, 2018
toschneck pushed a commit that referenced this issue Apr 21, 2018
… `SakuliCheckedException` and `SakuliRuntimeException`
toschneck pushed a commit that referenced this issue Apr 21, 2018
* add async exception handling possibility
* use async teardown for tescase testcasestep
* general refactoring of exception handling
* replace deprecated mockito matcher
toschneck pushed a commit that referenced this issue Apr 21, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants