Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ResultUpdator will only update one entry in meta-info.json under test-results folder when do parallel suite execution #361

Closed
1 of 5 tasks
WendyZ123 opened this issue Jan 29, 2021 · 0 comments
Projects
Milestone

Comments

@WendyZ123
Copy link

WendyZ123 commented Jan 29, 2021

QAF Version

3.0.0

Steps To Reproduce

 1.Add `JsonReporter` as result updator

result.updator=com.qmetry.qaf.automation.report.JsonReporter
disable.qaf.testng.reporter=true
qaf.json.reporter=true

2.set suitethreadpoolsize to 3 in pom file

Pom plugin settings:
<?xml version="1.0" encoding="UTF-8"?> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-surefire-plugin</artifactId> <version>${mvnSurefirePlugin}</version> <configuration> <suiteXmlFiles> <suiteXmlFile>config/master.xml</suiteXmlFile> </suiteXmlFiles> <properties> <property> <name>suitethreadpoolsize</name> <value>3</value> </property> </properties> <reportsDirectory>${test.results.dir}</reportsDirectory> <systemPropertyVariables>...</systemPropertyVariables> </configuration> </plugin>

3.in master suite, config 3 suite files: test1.xml, test2.xml, teste.xml

master.xml
<suite name="master-suite" verbose="0"> <suite-files> <suite-file path="test1.xml"/> <suite-file path="test2.xml"/> <suite-file path="test3.xml"/> </suite-files> </suite>

test1.xml
<suite name="Test1 Suite" verbose="0" parallel="methods" thread-count="2"> <test name="test1" enabled="true"> <groups> <run> <include name="test1"/> </run> </groups> <classes> <class name="com.qmetry.qaf.automation.step.client.text.BDDTestFactory2"></class> </classes> </test> </suite>
test2.xml and test3.xml are similar as test1.xml

4.execution: run command "mvn test"

Expected behavior

There should be three entries displayed in meta-info.json for each test suite
(My assumption based on new report folder structure)
{
"reports": [
{
"name": "Test1 Suite",
"dir": "test-results/20210129113859AM/json/test1Suite",
"startTime": 1611887956726
},
{
"name": "Test2 Suite",
"dir": "test-results/20210129113859AM/json/test2Suite",
"startTime": 1611887956726
},
{
"name": "Test3 Suite",
"dir": "test-results/20210129113859AM/json/test3Suite",
"startTime": 1611887956726
}
]
}

Actual behavior

Only display one entry in meta-info.json (under test-results folder)
{
"reports": [
{
"name": "Test3 Suite",
"dir": "test-results/20210129113859AM/json/test3Suite",
"startTime": 1611887956726
}
]
}

Is the issue reproducible on runner?

Yes

  • QAS
  • Maven
  • Gradle
  • Ant
  • Eclipse

Test case sample

test case: open up a chrome browser and load github page: https://github.com/

@cjayswal cjayswal added this to the 3.0.1 milestone Jan 29, 2021
@cjayswal cjayswal added this to Backlog in QAF May 24, 2021
QAF automation moved this from Backlog to Ready May 25, 2021
@cjayswal cjayswal moved this from Ready to Released in QAF Oct 25, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
QAF
  
Released
Development

No branches or pull requests

2 participants