Integration test suite sometimes fails

[exalate-issue-sync]

Integration tests fail from time to time with a below described error. It’s annoying as it leads to situation a test suite result has to be manually verified in case of a failure before deciding a feature branch can be merged (into master branch) or not.

Let’s try to fix the odd behavior.

{noformat}[2022-03-16T17:34:23.970Z] ai.h2o.sparkling.ml.features.H2OPCATestSuite > A pipeline with a PCA model sourcing data from vector column transforms testing dataset without an exception FAILED
[2022-03-16T17:34:23.970Z] org.scalatest.exceptions.TestFailedException: 1 was not greater than or equal to 2
[2022-03-16T17:34:23.970Z] at org.scalatest.MatchersHelper$.newTestFailedException(MatchersHelper.scala:160)
[2022-03-16T17:34:23.970Z] at org.scalatest.Matchers$AnyShouldWrapper.shouldBe(Matchers.scala:6482)
[2022-03-16T17:34:23.970Z] at ai.h2o.sparkling.ml.features.H2OPCATestSuite$$anonfun$6.apply$mcV$sp(H2OPCATestSuite.scala:164)
[2022-03-16T17:34:23.970Z] at ai.h2o.sparkling.ml.features.H2OPCATestSuite$$anonfun$6.apply(H2OPCATestSuite.scala:142)
[2022-03-16T17:34:23.970Z] at ai.h2o.sparkling.ml.features.H2OPCATestSuite$$anonfun$6.apply(H2OPCATestSuite.scala:142)
[2022-03-16T17:34:23.970Z] at org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
[2022-03-16T17:34:23.970Z] at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
[2022-03-16T17:34:23.970Z] at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
[2022-03-16T17:34:23.970Z] at org.scalatest.Transformer.apply(Transformer.scala:22)
[2022-03-16T17:34:23.970Z] at org.scalatest.Transformer.apply(Transformer.scala:20)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:166)
[2022-03-16T17:34:23.970Z] at org.scalatest.Suite$class.withFixture(Suite.scala:1122)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuite.withFixture(FunSuite.scala:1555)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$class.invokeWithFixture$1(FunSuiteLike.scala:163)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:175)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:175)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$class.runTest(FunSuiteLike.scala:175)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuite.runTest(FunSuite.scala:1555)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:413)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:401)
[2022-03-16T17:34:23.970Z] at scala.collection.immutable.List.foreach(List.scala:392)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine.org$scalatest$SuperEngine$$runTestsInBranch(Engine.scala:396)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:483)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$class.runTests(FunSuiteLike.scala:208)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuite.runTests(FunSuite.scala:1555)
[2022-03-16T17:34:23.970Z] at org.scalatest.Suite$class.run(Suite.scala:1424)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuite.org$scalatest$FunSuiteLike$$super$run(FunSuite.scala:1555)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anonfun$run$1.apply(FunSuiteLike.scala:212)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$$anonfun$run$1.apply(FunSuiteLike.scala:212)
[2022-03-16T17:34:23.970Z] at org.scalatest.SuperEngine.runImpl(Engine.scala:545)
[2022-03-16T17:34:23.970Z] at org.scalatest.FunSuiteLike$class.run(FunSuiteLike.scala:212)
[2022-03-16T17:34:23.970Z] at ai.h2o.sparkling.ml.features.H2OPCATestSuite.org$scalatest$BeforeAndAfterAll$$super$run(H2OPCATestSuite.scala:32)
[2022-03-16T17:34:23.970Z] at org.scalatest.BeforeAndAfterAll$class.liftedTree1$1(BeforeAndAfterAll.scala:257)
[2022-03-16T17:34:23.970Z] at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:256)
[2022-03-16T17:34:23.970Z] at ai.h2o.sparkling.ml.features.H2OPCATestSuite.run(H2OPCATestSuite.scala:32){noformat}

[DinukaH2O]

JIRA Issue Migration Info

Jira Issue: SW-2694
Assignee: krasinski
Reporter: karel.nechvile
State: Resolved
Fix Version: 3.40.0.1-1
Attachments: N/A
Development PRs: Available

Linked PRs from JIRA

#2855

[hasithjp]

JIRA Issue Migration Info Cont'd

Jira Issue Created Date: 2022-03-21T05:52:25.388-0700