Skip to content

[HUDI-6454] Remove redundant indexing testcases#9077

Merged
nsivabalan merged 1 commit intoapache:masterfrom
xushiyan:HUDI-6454-fix-indexing-tests
Jun 28, 2023
Merged

[HUDI-6454] Remove redundant indexing testcases#9077
nsivabalan merged 1 commit intoapache:masterfrom
xushiyan:HUDI-6454-fix-indexing-tests

Conversation

@xushiyan
Copy link
Member

Change Logs

Remove redundant/repeated testcases to reduce CI runtime.

Impact

Indexing test coverage

Risk level

Low.

Documentation Update

NA

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

* @param config instance of {@link HoodieWriteConfig} to use
* @param writeFn write function to be used for testing
*/
private void testUpsertsUpdatePartitionPath(IndexType indexType, HoodieWriteConfig config,
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Covered in TestGlobalIndexEnableUpdatePartitions

Comment on lines 105 to +111
{IndexType.SIMPLE, true, true},
{IndexType.SIMPLE, true, false},
{IndexType.SIMPLE, false, true},
{IndexType.SIMPLE, false, false},
{IndexType.GLOBAL_SIMPLE, true, true},
{IndexType.GLOBAL_SIMPLE, true, false},
{IndexType.GLOBAL_SIMPLE, false, true},
{IndexType.GLOBAL_SIMPLE, false, false},
{IndexType.BUCKET, false, true},
{IndexType.BUCKET, true, false},
{IndexType.BUCKET, false, false},
{IndexType.RECORD_INDEX, true, true},
{IndexType.RECORD_INDEX, true, false}
{IndexType.RECORD_INDEX, true, true}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • popluateMetaFields (true/false) only applies to bucket index.
  • only test record index when MDT enabled


@ParameterizedTest
@MethodSource("indexTypeParams")
public void testSimpleTagLocationAndUpdateWithRollback(IndexType indexType, boolean populateMetaFields, boolean enableMetadataIndex) throws Exception {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

merged into testSimpleTagLocationAndUpdate


@ParameterizedTest
@EnumSource(value = IndexType.class, names = {"GLOBAL_BLOOM", "GLOBAL_SIMPLE"})
public void testSimpleGlobalIndexTagLocationWhenShouldUpdatePartitionPath(IndexType indexType) throws Exception {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Covered in TestGlobalIndexEnableUpdatePartitions


@ParameterizedTest
@ValueSource(booleans = {true})
public void testRecordIndexTagLocationAndUpdate(boolean populateMetaFields) throws Exception {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

covered in parameterized testSimpleTagLocationAndUpdate

}

@Test
public void testTagLocationWhenShouldUpdatePartitionPath() throws Exception {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Covered in TestGlobalIndexEnableUpdatePartitions

@xushiyan xushiyan added priority:critical Production degraded; pipelines stalled release-0.14.0 labels Jun 28, 2023
@xushiyan xushiyan requested a review from nsivabalan June 28, 2023 12:35
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@nsivabalan nsivabalan merged commit 60ac414 into apache:master Jun 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority:critical Production degraded; pipelines stalled release-0.14.0

Projects

Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

3 participants