Test And Test Steps counts are same in the Extent report 3.0.1

[naveenru]

I have used extent 3.0.1 version

Issue :Test and Test steps count are same always . Test and test Step count are 2 always . Please help .
Expected result : Test = 1 , Test steps = 2

Test Suite : TS1

Test Cases : tc1 ,tc2

Implementation :

public class ExtentTestNGReportBuilder {

private static ExtentReports extent;
private static ThreadLocal parentTest = new ThreadLocal();
private static ThreadLocal test = new ThreadLocal();

@BeforeSuite
public void beforeSuite() {
	extent = ExtentManager.createInstance("extent.html");
	ExtentHtmlReporter htmlReporter = new ExtentHtmlReporter("extent.html");
	extent.attachReporter(htmlReporter);
}

@BeforeClass
public synchronized void beforeClass() {
    ExtentTest parent = extent.createTest(getClass().getName());
    parentTest.set(parent);
}

@BeforeMethod
public synchronized void beforeMethod(Method method) {
    ExtentTest child = parentTest.get().createNode(method.getName());
    test.set(child);
}

@AfterMethod
public synchronized void afterMethod(ITestResult result) {
    if (result.getStatus() == ITestResult.FAILURE)
        test.get().fail(result.getThrowable());
    else if (result.getStatus() == ITestResult.SKIP)
        test.get().skip(result.getThrowable());
    else
        test.get().pass("Test passed");

    extent.flush();
}

}

public class ExtentManager {

private static ExtentReports extent;

public static ExtentReports getInstance() {
	if (extent == null)
		createInstance("test-output/extent.html");
	
    return extent;
}

public static ExtentReports createInstance(String fileName) {
    ExtentHtmlReporter htmlReporter = new ExtentHtmlReporter(fileName);
    htmlReporter.config().setTestViewChartLocation(ChartLocation.BOTTOM);
    htmlReporter.config().setChartVisibilityOnOpen(true);
    htmlReporter.config().setTheme(Theme.STANDARD);
    htmlReporter.config().setDocumentTitle(fileName);
    htmlReporter.config().setEncoding("utf-8");
    htmlReporter.config().setReportName(fileName);
    
    extent = new ExtentReports();
    extent.attachReporter(htmlReporter);
    
    return extent;
}

}

[anshooarora]

I see 2 tests. How many logs does each toggle have?

[naveenru]

Actually I am running 3 classes

Class 1 - has 6 tests
Class 2 - has 24 tests
Class 3 - has 5 Tests

Result after running : Tests run: 35, Failures: 6, Errors: 0, Skipped: 23

Questions :

1. I need to know why it shows test ans test steps count same .
2. Is there a way where i can disable the Test steps view in dashboard .

[RodNepoLNRisk]

Hi,

I'm Rod. I agree to the post, the counts for the Passed or Failed Tests are the same with the Steps.

[anshooarora]

Can you check if the issue persists with version 3.0.3?

Also, if it does, can you share a small sample that I can use to repro? Thanks.

[RodNepoLNRisk]

Yes. I'm using 3.0.3 version.

com.aventstack
extentreports
3.0.3

I have a GenerateExtentReport class then createTest for parentTest then assign the Test Suite as Category
GenerateExtentReports3.parentTest = GenerateExtentReports3.extent.createTest(strTestCaseNumName, strTestDesc);
GenerateExtentReports3.parentTest.assignCategory(strTestSuite);

then I call the method for the Test Steps:
//Step #1
public void verifyADRNavPaneLocation () {
//====================================================================================================================
//1) Verify the Navigation Pane for the Account Detail Report is displayed to the left of the report and allows the user to any section of the report.
strStepDesc = " Verify the Navigation Pane for the Account Detail Report is displayed to the left of the report and allows the user to any section of the report.";
strScreenshot = strTestCaseNumName + " - " + strStepNo;
strStepName = strStepNo + " - " + strStepDesc;

	if (AccountDetailReportNavigationPaneBus.isNavPaneOnUpperLeft() &&
		AccountDetailReportNavigationPaneBus.verifyNavigateContributionDates()) {
		//PASSED
		strDetails = strStepNo + "-" + Common.PASSED + " - Verified that the Navigation Pane for the Account Detail Report is displayed to the left of the report and allows the user to any section of the report.";
		System.out.println (strDetails);			
		strTestRemarks = strTestRemarks + strDetails + "\n";
		
		//GenerateExtentReports2.testPass(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		
		if (MainRunTest.strExtReportProperties.equals(MainRunTest.strExtReportCommon)) {
			GenerateExtentReports2.testPass(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		} else {
			try {
				GenerateExtentReports3.getResult(TestVars.resSUCCESS, driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, 
						strTestDesc, strDetails);
			} catch (IOException e) {
				e.printStackTrace();
			} catch (Exception e) {
				e.printStackTrace();
			}
		}
	} else {
		//FAILED
		if (AccountDetailReportNavigationPaneBus.getErrorDescription().length() > 0) {
			strDetails = strStepNo + "-" + Common.FAILED + " - Verified that the Navigation Pane for the Account Detail Report is NOT displayed to the left of the report and DOES NOT allow the user to any section of the report." +
					AccountDetailReportNavigationPaneBus.getErrorDescription();
		}
		blnTestPassed = false;
		System.out.println (strDetails);			
		strTestRemarks = strTestRemarks + strDetails + "\n";
		
		//GenerateExtentReports2.testFail(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		
		if (MainRunTest.strExtReportProperties.equals(MainRunTest.strExtReportCommon)) {
			GenerateExtentReports2.testFail(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		} else {
			try {
				GenerateExtentReports3.getResult(TestVars.resFAILURE, driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, 
						strTestDesc, strDetails);
			} catch (IOException e) {
				e.printStackTrace();
			} catch (Exception e) {
				e.printStackTrace();
			}
		}	
	}		
}

//Step #2
public void verifyADRNavPaneSectionDetails () {		
	//====================================================================================================================		
	//2) Verify the Navigation Pane headings and navigation areas will include the following along with their counts if applicable:
	//	•  Account Contribution Heading
	//	   This will allow the user to go back to the most recent reported contribution date 
	//	   (i.e. top of report);
	//		•  Account Credit Information  
	//		•  Account Activity 
	//		•  Payment Information  
	//		•  Past Due Information  
	//		•  Charge-off Information  
	//		•  Account Tax IDs/SSNs <insert count of TI segments related to the AB segment>
	//		•  Account Addresses <insert count of AD segments related to the AB segment>
	//		•  Account Phones <insert count of PN segments related to the AB segment>
	//		•  Account Business Classification Information <insert count of BI segments related to the AB segment>
	//		•  Collateral Information <insert count of CL segment data within this section related to the AB segment>
	//		•  UCC Information <insert count of CL segment data within this section related to the AB segment>
	//		•  Account Modification History <insert count of AH segments related to the AB segment>
	//		•  Account Member Specific Reported Fields <insert count of AD segments related to the AB segment>
	//		•  Guarantor/Owner Summary
	//	            o  Individuals Related to the Business Entity <insert count of IS segments related to the AB segment>
	//	            o  Other Businesses Related to the Business Entity <insert count of BS segments related to the AB segment>
	//	•  History of All Account Contributions <insert count of account contributions reported>
	//	    •  Account Contribution Heading
	//	   This will allow the user to go back to the contribution date field for the account detail; no count provided
	strStepDesc = "the Navigation Pane headings and navigation areas will include the following along with their counts if applicable \n" +
				  "	•  Account Contribution Heading \n" +
				  "	  This will allow the user to go back to the most recent reported contribution date (i.e. top of report); \n" +
				  "	  	•  Account Credit Information \n" +  
				  "		•  Account Activity \n" +
				  "		•  Payment Information \n" +  
				  "		•  Past Due Information \n" +  
				  "		•  Charge-off Information \n" +  
				  "		•  Account Tax IDs/SSNs <insert count of TI segments related to the AB segment> \n" +
				  "		•  Account Addresses <insert count of AD segments related to the AB segment> \n" +
				  "		•  Account Phones <insert count of PN segments related to the AB segment> \n" +
				  "		•  Account Business Classification Information <insert count of BI segments related to the AB segment> \n" +
				  "		•  Collateral Information <insert count of CL segment data within this section related to the AB segment> \n" +
				  "		•  UCC Information <insert count of CL segment data within this section related to the AB segment> \n" +
				  "		•  Account Modification History <insert count of AH segments related to the AB segment> \n" +
				  "		•  Account Member Specific Reported Fields <insert count of AD segments related to the AB segment> \n" +
				  "		•  Guarantor/Owner Summary \n" +
				  "        o  Individuals Related to the Business Entity <insert count of IS segments related to the AB segment> \n" +
				  "        o  Other Businesses Related to the Business Entity <insert count of BS segments related to the AB segment> \n" +
				  "	•  History of All Account Contributions <insert count of account contributions reported> \n" +
				  "	   •  Account Contribution Heading \n" +
				  "	   This will allow the user to go back to the contribution date field for the account detail; no count provided \n";
	strScreenshot =  strTestCaseNumName + " - " + strStepNo;
	strStepName = strStepNo + " - Verify " + strStepDesc;

	if (!AccountDetailReportNavigationPaneBus.verifyNavigationPaneSections() ) {
		//PASSED
		strDetails = strStepNo + "-" + Common.PASSED + " - Verified that the " + strStepDesc;
		System.out.println (strDetails);			
		strTestRemarks = strTestRemarks + strDetails + "\n";
		
		//GenerateExtentReports2.testPass(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		
		if (MainRunTest.strExtReportProperties.equals(MainRunTest.strExtReportCommon)) {
			GenerateExtentReports2.testPass(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		} else {
			try {
				GenerateExtentReports3.getResult(TestVars.resSUCCESS, driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, 
						strTestDesc, strDetails);
			} catch (IOException e) {
				e.printStackTrace();
			} catch (Exception e) {
				e.printStackTrace();
			}
		}			
	} else {
		//FAILED
		if (AccountDetailReportNavigationPaneBus.getErrorDescription().length() > 0) {
			strDetails = strStepNo + "-" + Common.FAILED + " - Verified that the Navigation Pane headings encountered some errors. \n" +
					AccountDetailReportNavigationPaneBus.getErrorDescription();
		}
		blnTestPassed = false;
		System.out.println (strDetails);			
		strTestRemarks = strTestRemarks + strDetails + "\n";
		
		//GenerateExtentReports2.testFail(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		
		if (MainRunTest.strExtReportProperties.equals(MainRunTest.strExtReportCommon)) {
			GenerateExtentReports2.testFail(driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, strTestDesc, strDetails);
		} else {
			try {
				GenerateExtentReports3.getResult(TestVars.resFAILURE, driver, strTestSuite, strTestCaseNumName, strStepName, strScreenshot, 
						strTestDesc, strDetails);
			} catch (IOException e) {
				e.printStackTrace();
			} catch (Exception e) {
				e.printStackTrace();
			}
		}	
	}		
}

I have a method getResults where I pass if the Test Step is a Pass or Fail.
public static void getResult(String result, WebDriver pdriver, String pstrTestSuite, String pstrTestCaseNumName
, String pstrStepName, String pstrScreenshot, String pstrTestDesc, String pstrDetails) throws IOException, Exception {

	switch (result) {
        case TestVars.resSUCCESS:
        	childTest = parentTest.createNode(pstrStepName);
        	childTest.log(Status.PASS, MarkupHelper.createLabel(pstrStepName, ExtentColor.GREEN));
        	childTest.addScreenCaptureFromPath(captureScreenShot(pdriver, pstrScreenshot));
        	childTest.log(Status.INFO, MarkupHelper.createLabel(pstrDetails, ExtentColor.GREY));
    		Assert.assertTrue(true);
    		break;
        case TestVars.resFAILURE:
        	childTest = parentTest.createNode(pstrStepName);
        	childTest.log(Status.FAIL, MarkupHelper.createLabel(pstrStepName, ExtentColor.RED));
        	childTest.addScreenCaptureFromPath(captureScreenShot(pdriver, pstrScreenshot));
        	childTest.log(Status.INFO, MarkupHelper.createLabel(pstrDetails, ExtentColor.GREY));	        		        	
    		Assert.assertFalse(false);
    		break;
        case TestVars.resSKIP:
        	strMsg = pstrTestCaseNumName + " - " + Common.SKIPPED;
        	parentTest = extent.createTest(pstrTestCaseNumName, pstrTestDesc);
        	parentTest.assignCategory(pstrTestSuite);
        	parentTest.log(Status.SKIP, MarkupHelper.createLabel(strMsg, ExtentColor.ORANGE));
    		Assert.assertTrue(true);
    		break;
        default:
        	strMsg = pstrTestCaseNumName + " - " + Common.SKIPPED;
        	parentTest = extent.createTest(pstrTestCaseNumName, pstrTestDesc);
        	parentTest.assignCategory(pstrTestSuite);
        	parentTest.log(Status.SKIP, MarkupHelper.createLabel(strMsg, ExtentColor.ORANGE));
    		Assert.assertTrue(true);
    		break;
    }        
}

[anshooarora]

Please attach a project. Its going to be difficult and time-consuming for me to fill in all the missing details and recreate the project from scratch.

With that being said, the 2 counts you have shown may not necessarily match. That is because:

1. You may have marked the parent-test with the category but it has several child tests. The child tests will show up in the final counts.
2. You may not have assigned all tests to categories which can also result in different counts from category and overall test count.

[RodNepoLNRisk]

Hi,
The project is too big. Do you have a sample code where it shows how to use ParentTest and ChildTest nodes? ParentTest being the Tests and ChildTest being the steps and how the Categories are assigned. I followed it as how I understood it but maybe there's a missed step. Thanks.

[RodNepoLNRisk]

I really think that there's something wrong with the counts, please create a small project and create steps and tests and see if the counts are the same. maybe the Dashboard test count points to the Step counts as well. Thanks for the help.

[RodNepoLNRisk]

I also noticed that in Extent Reports v.2.41.2 the Category Summary totals are not displayed, but the Test and Step counts are correct.

[anshooarora]

@RodNepoLNRisk if you assign the category to the child tests are well, this issue will go away. The report will not automatically mark the childNodes with the same category as the parent test which is why you are seeing this issue. As I had mentioned in the 1st bullet above:

You may have marked the parent-test with the category but it has several child tests. The child tests will show up in the final counts.

For the above, version 2 has several differences in comparison to 3 which is why you see this behavior..

[RodNepoLNRisk]

I'll try your suggestion for version 3, but for version 2, how can I see the Summary Totals for the Category section?

[RodNepoLNRisk]

I did what you asked and assigned the Category to the child tests and the totals are no longer correct and the Categories view displayed the Steps together with the Tests instead of having it as a drilldown.
Please take a look at the Tests Count from the Dashboard, regardless if I set the Categories to the Child Test it still displayed an incorrect value, it seems like it points to the Steps Total. I really appreciate the help on this. Thanks.

[RodNepoLNRisk]

This is the method that I call for Pass, Fail, Skip.
I now commented out the part where I assigned the Category to the Child Test.
I'll try to generate it again and see the difference.

public static void getResult(String result, WebDriver pdriver, String pstrTestSuite, String pstrTestCaseNumName
		, String pstrStepName,  String pstrScreenshot, String pstrTestDesc, String pstrDetails) throws IOException, Exception {
	
	switch (result) {
        case TestVars.resSUCCESS:
        	childTest = parentTest.createNode(pstrStepName);
        	//childTest.assignCategory(pstrTestSuite);
        	childTest.log(Status.PASS, MarkupHelper.createLabel(pstrStepName, ExtentColor.GREEN));
        	childTest.addScreenCaptureFromPath(captureScreenShot(pdriver, pstrScreenshot));
        	childTest.log(Status.INFO, MarkupHelper.createLabel(pstrDetails, ExtentColor.GREY));
    		Assert.assertTrue(true);
    		break;
        case TestVars.resFAILURE:
        	childTest = parentTest.createNode(pstrStepName);
        	//childTest.assignCategory(pstrTestSuite);
        	childTest.log(Status.FAIL, MarkupHelper.createLabel(pstrStepName, ExtentColor.RED));
        	childTest.addScreenCaptureFromPath(captureScreenShot(pdriver, pstrScreenshot));
        	childTest.log(Status.INFO, MarkupHelper.createLabel(pstrDetails, ExtentColor.GREY));	        		        	
    		Assert.assertFalse(false);
    		break;
        case TestVars.resSKIP:
        	if (pstrStepName.length() > 0) {
        		//The Test Step Number for the Test Case have been skipped
	        	strMsg = pstrTestCaseNumName + " - " + pstrStepName + Common.SKIPPED;
	        	childTest = parentTest.createNode(pstrStepName);
	        	childTest.assignCategory(pstrTestSuite);
	        	childTest.log(Status.SKIP, MarkupHelper.createLabel(pstrStepName, ExtentColor.ORANGE));
	        	childTest.log(Status.INFO, MarkupHelper.createLabel(strMsg, ExtentColor.GREY));		        	
	    		Assert.assertTrue(true);
        	} else {
        		//The Test Case Number with Test Case Name have been skipped
	        	strMsg = pstrTestCaseNumName + " - " + Common.SKIPPED;
	        	parentTest = extent.createTest(pstrTestCaseNumName, pstrTestDesc);
	        	parentTest.assignCategory(pstrTestSuite);
	        	parentTest.log(Status.SKIP, MarkupHelper.createLabel(strMsg, ExtentColor.ORANGE));
	    		Assert.assertTrue(true);
        	}
    		break;
        default:
        	if (pstrStepName.length() > 0) {
        		//The Test Step Number for the Test Case have been skipped
	        	strMsg = pstrTestCaseNumName + " - " + pstrStepName + Common.SKIPPED;
	        	childTest = parentTest.createNode(pstrStepName);
	        	childTest.assignCategory(pstrTestSuite);
	        	childTest.log(Status.SKIP, MarkupHelper.createLabel(pstrStepName, ExtentColor.ORANGE));
	        	childTest.log(Status.INFO, MarkupHelper.createLabel(strMsg, ExtentColor.GREY));		        	
	    		Assert.assertTrue(true);
        	} else {
        		//The Test Case Number with Test Case Name have been skipped
	        	strMsg = pstrTestCaseNumName + " - " + Common.SKIPPED;
	        	parentTest = extent.createTest(pstrTestCaseNumName, pstrTestDesc);
	        	parentTest.assignCategory(pstrTestSuite);
	        	parentTest.log(Status.SKIP, MarkupHelper.createLabel(strMsg, ExtentColor.ORANGE));
	    		Assert.assertTrue(true);
        	}
    		break;
    }        
}

[anshooarora]

Thanks. This (the counts) doesn't make sense but I am also not able to repro in any of my tests. Will it be possible to share your report? You can email me at anshooarora at gmail dot com.

[RodNepoLNRisk]

https://github.com/RodNepoLNRisk/SBFEDataWarehousePhase2.git

https://github.com/RodNepoLNRisk/SBFEDataWarehousePhase2