[ORCA] uttests in gporca failed

[fanfuxiaoran]

Apache Cloudberry version

No response

What happened

I tried run the uttests on my laptop, some tests failed

ctest -j8 --output-on-failure

The following tests FAILED:
	 41 - gporca_test_CAntiSemiJoinTest (Failed)
	 42 - gporca_test_CPredicateTest (Failed)
	 46 - gporca_test_CIndexScanTest (Failed)
	 47 - gporca_test_CBitmapScanTest (Failed)
	 48 - gporca_test_CIndexApplyTest (Failed)
	 49 - gporca_test_CDynamicIndexScanTest (Failed)
	 51 - gporca_test_CStatsTest (Failed)
	 56 - gporca_test_CProjectTest (Failed)
	 60 - gporca_test_CPartTbl4Test (Failed)
	 63 - gporca_test_CPartTblDPETest (Failed)
	 65 - gporca_test_CSetop1Test (Failed)
	 66 - gporca_test_CSetop2Test (Failed)
	 67 - gporca_test_CSetop3Test (Failed)
	 68 - gporca_test_CSetop4Test (Failed)
	 69 - gporca_test_CEquivClassTest (Failed)
	 71 - gporca_test_COuterJoin2Test (Failed)
	 72 - gporca_test_COuterJoin3Test (Failed)
	 73 - gporca_test_CFullJoinTest (Failed)
	 75 - gporca_test_CMotionHazardTest (Failed)
	 76 - gporca_test_CConstraintNegationTest (Failed)
	 79 - gporca_test_CRandomDataInsertionTest (Failed)
	 80 - gporca_test_CGistIndexTest (Failed)
	 86 - gporca_test_COpfamiliesTest (Failed)
	 87 - gporca_test_CSubquery2Test (Failed)
	 92 - gporca_test_COrderedAggTest (Failed)
	 94 - gporca_test_CExternalTableTest (Failed)
	105 - gporca_test_CICGTest (Failed)
	106 - gporca_test_CDMLTest (Failed)
	110 - gporca_test_CAggTest (Failed)
	111 - gporca_test_CSubqueryTest (Failed)
	115 - gporca_test_CBitmapTest (Failed)
	116 - gporca_test_CCTETest (Failed)
	143 - gporca_test_CCastTest (Failed)
	148 - gporca_test_CBindingTest (Failed)
	151 - gporca_test_CExpressionTest (Failed)
Errors while running CTest

What you think should happen instead

No response

How to reproduce

ctest -j8 --output-on-failure

Operating System

centos7

Anything else

No response

Are you willing to submit PR?

• Yes, I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct.

[jiaqizho]

I think that some of tests require the minidump, checkout CICGTest.cpp. I am not sure that we can direct use the ctest -j8 to run the ut.

[fanfuxiaoran]

I think that some of tests require the minidump, checkout CICGTest.cpp. I am not sure that we can direct use the ctest -j8 to run the ut.

Not all the minidump files are included in the test data path? I just followed the README.md to run them, maybe not correct.
I tried to run the test CExpressionTest, it could get the data file, but just failed.

2024-12-04 16:20:13:295094 CST,THD000,TRACE,"opening file ../data/dxl/expressiontests/WinFunc-OuterRef-Partition-Query.xml",
2024-12-04 16:20:13:315021 CST,THD000,TRACE,"opening file ../data/dxl/expressiontests/WinFunc-OuterRef-Partition-Query.xml",
2024-12-04 16:20:13:438114 CST,THD000,NOTICE,"Operator Fallback: InnerIndexNestLoopJoin may have wrong plan not supported",
2024-12-04 16:20:13:438443 CST,THD000,TRACE,"timer:EresUnittest_ReqdCols: 802ms",
2024-12-04 16:20:13:438455 CST,THD000,TRACE,"Unittest EresUnittest_ReqdCols...*** FAILED ***.",
2024-12-04 16:20:13:441304 CST,THD000,TRACE,"
Invalid SetOp Expression:
+--CLogicalUnion Output: ("column_0000" (0)), Input: [("column_0000" (0)), ("ColRef_0006" (6))]
   |--CLogicalGet "T1Alias" ("T1"), Columns: ["column_0000" (0), "column_0001" (1), "column_0002" (2)] Key sets: {[0]}
   +--CLogicalGet "T2Alias" ("T2"), Columns: ["column_0000" (3), "column_0001" (4), "column_0002" (5)] Key sets: {[0]}
",
2024-12-04 16:20:13:442636 CST,THD000,ERROR,"../libgpopt/src/operators/CLogicalSetOp.cpp:160: Failed assertion: pcrsChildOutput->ContainsAll(pcrsInput) && "Unexpected outer references in SetOp input"
Stack trace:
1    0x00007fe52a72fa10 gpos::CException::Raise + 256
2    0x00007fe52c9b096c gpopt::CLogicalSetOp::DeriveOutputColumns + 180
3    0x00007fe52c910167 gpopt::CDrvdPropRelational::DeriveOutputColumns + 109
4    0x00007fe52c90f452 gpopt::CDrvdPropRelational::Derive + 60
5    0x00007fe52c96e40c gpopt::CExpression::PdpDerive + 684
6    0x00000000004e7845 gpopt::CExpressionTest::EresUnittest_InvalidSetOp + 1267
7    0x00007fe52a746905 gpos::CUnittest::EresExecTest + 81
8    0x00007fe52a746b4e gpos::CUnittest::EresExecute + 118
9    0x00000000004e1d7e gpopt::CExpressionTest::EresUnittest + 398
10   0x00007fe52a746905 gpos::CUnittest::EresExecTest + 81
11   0x00007fe52a746b4e gpos::CUnittest::EresExecute + 118
12   0x00007fe52a746e80 gpos::CUnittest::Driver + 192
13   0x0000000000475e79 <symbol not found> + 4677241
14   0x00007fe52a7422e6 gpos::CTask::Execute + 180
15   0x00007fe52a744ad1 gpos::CWorker::Execute + 187
16   0x00007fe52a74086a gpos::CAutoTaskProxy::Execute + 202
17   0x00007fe52a727b12 gpos_exec + 773
",
2024-12-04 16:20:13:444791 CST,THD000,TRACE,"timer:CExpressionTest::EresUnittest_InvalidSetOp: 6ms",
2024-12-04 16:20:13:444801 CST,THD000,TRACE,"Unittest CExpressionTest::EresUnittest_InvalidSetOp...OK.",
2024-12-04 16:20:13:444886 CST,THD000,TRACE,"timer:CExpressionTest: 1038ms",
2024-12-04 16:20:13:444894 CST,THD000,TRACE,"Unittest CExpressionTest...*** FAILED ***.",
2024-12-04 16:20:13:445007 CST,THD000,TRACE,"timer:total test run time: 1039ms",
2024-12-04 16:20:13:445014 CST,THD000,TRACE,"Tests succeeded: 0",
2024-12-04 16:20:13:445021 CST,THD000,TRACE,"Tests failed:    1",

[jiaqizho]

I think that some of tests require the minidump, checkout CICGTest.cpp. I am not sure that we can direct use the ctest -j8 to run the ut.

Not all the minidump files are included in the test data path? I just followed the README.md to run them, maybe not correct. I tried to run the test CExpressionTest, it could get the data file, but just failed.

2024-12-04 16:20:13:295094 CST,THD000,TRACE,"opening file ../data/dxl/expressiontests/WinFunc-OuterRef-Partition-Query.xml",
2024-12-04 16:20:13:315021 CST,THD000,TRACE,"opening file ../data/dxl/expressiontests/WinFunc-OuterRef-Partition-Query.xml",
2024-12-04 16:20:13:438114 CST,THD000,NOTICE,"Operator Fallback: InnerIndexNestLoopJoin may have wrong plan not supported",
2024-12-04 16:20:13:438443 CST,THD000,TRACE,"timer:EresUnittest_ReqdCols: 802ms",
2024-12-04 16:20:13:438455 CST,THD000,TRACE,"Unittest EresUnittest_ReqdCols...*** FAILED ***.",
2024-12-04 16:20:13:441304 CST,THD000,TRACE,"
Invalid SetOp Expression:
+--CLogicalUnion Output: ("column_0000" (0)), Input: [("column_0000" (0)), ("ColRef_0006" (6))]
   |--CLogicalGet "T1Alias" ("T1"), Columns: ["column_0000" (0), "column_0001" (1), "column_0002" (2)] Key sets: {[0]}
   +--CLogicalGet "T2Alias" ("T2"), Columns: ["column_0000" (3), "column_0001" (4), "column_0002" (5)] Key sets: {[0]}
",
2024-12-04 16:20:13:442636 CST,THD000,ERROR,"../libgpopt/src/operators/CLogicalSetOp.cpp:160: Failed assertion: pcrsChildOutput->ContainsAll(pcrsInput) && "Unexpected outer references in SetOp input"
Stack trace:
1    0x00007fe52a72fa10 gpos::CException::Raise + 256
2    0x00007fe52c9b096c gpopt::CLogicalSetOp::DeriveOutputColumns + 180
3    0x00007fe52c910167 gpopt::CDrvdPropRelational::DeriveOutputColumns + 109
4    0x00007fe52c90f452 gpopt::CDrvdPropRelational::Derive + 60
5    0x00007fe52c96e40c gpopt::CExpression::PdpDerive + 684
6    0x00000000004e7845 gpopt::CExpressionTest::EresUnittest_InvalidSetOp + 1267
7    0x00007fe52a746905 gpos::CUnittest::EresExecTest + 81
8    0x00007fe52a746b4e gpos::CUnittest::EresExecute + 118
9    0x00000000004e1d7e gpopt::CExpressionTest::EresUnittest + 398
10   0x00007fe52a746905 gpos::CUnittest::EresExecTest + 81
11   0x00007fe52a746b4e gpos::CUnittest::EresExecute + 118
12   0x00007fe52a746e80 gpos::CUnittest::Driver + 192
13   0x0000000000475e79 <symbol not found> + 4677241
14   0x00007fe52a7422e6 gpos::CTask::Execute + 180
15   0x00007fe52a744ad1 gpos::CWorker::Execute + 187
16   0x00007fe52a74086a gpos::CAutoTaskProxy::Execute + 202
17   0x00007fe52a727b12 gpos_exec + 773
",
2024-12-04 16:20:13:444791 CST,THD000,TRACE,"timer:CExpressionTest::EresUnittest_InvalidSetOp: 6ms",
2024-12-04 16:20:13:444801 CST,THD000,TRACE,"Unittest CExpressionTest::EresUnittest_InvalidSetOp...OK.",
2024-12-04 16:20:13:444886 CST,THD000,TRACE,"timer:CExpressionTest: 1038ms",
2024-12-04 16:20:13:444894 CST,THD000,TRACE,"Unittest CExpressionTest...*** FAILED ***.",
2024-12-04 16:20:13:445007 CST,THD000,TRACE,"timer:total test run time: 1039ms",
2024-12-04 16:20:13:445014 CST,THD000,TRACE,"Tests succeeded: 0",
2024-12-04 16:20:13:445021 CST,THD000,TRACE,"Tests failed:    1",

I haven't analyzed this part of tests in detail, but the examples given here, seem like minidump not match or no updated? maybe we can double check the minidump in GP(just a suggestion)....