Test Timeout not respected in parallel="methods" mode

[Tygerian]

TestNG Version

6.14.3

Expected behavior

Test thread is terminated if it takes longer than its timeout setting when running in parallel="methods" mode.

Actual behavior

Test is allowed to finish no matter how long it takes; the timeout setting only determines whether it will be marked as failed. This is similar to #811.

Is the issue reproducible on runner?

• Shell
• Maven
• Gradle
• Ant
• Eclipse
• IntelliJ
• NetBeans

Test case sample

import org.testng.Assert;
import org.testng.ITestResult;
import org.testng.TestListenerAdapter;
import org.testng.TestNG;
import org.testng.annotations.Test;
import org.testng.xml.XmlSuite;

public class TestNGTimeOutTest {

    @Test
    public void testTimeOutWhenParallelIsMethods() {
        TestNG tng = new TestNG();
        tng.setParallel(XmlSuite.ParallelMode.METHODS);
        tng.setTestClasses(new Class[]{TimeOutWithParallelSample.class});

        TestListenerAdapter tla = new TestListenerAdapter();
        tng.addListener(tla);

        tng.run();

        Assert.assertEquals(tla.getFailedTests().size(), 1);
        Assert.assertEquals(tla.getSkippedTests().size(), 0);
        Assert.assertEquals(tla.getPassedTests().size(), 0);
        ITestResult result = tla.getFailedTests().get(0);
        Assert.assertTrue(result.getEndMillis() - result.getStartMillis() < 2000);
    }
}

import org.testng.annotations.Test;

public class TimeOutWithParallelSample {

    @Test(timeOut = 1000)
    public void myTestMethod() throws InterruptedException {
        Thread.sleep(2000);
    }
}

[krmahadevan]

The latest released version of TestNG is 7.0.0-beta3. Please retry using this version and post back the results

[krmahadevan]

@Tygerian - Please ignore the previous comment. The issue exists and I have fixed it.