ccl/changefeedccl: TestAlterChangefeedAddTargetsDuringBackfill failed

[cockroach-teamcity]

ccl/changefeedccl.TestAlterChangefeedAddTargetsDuringBackfill failed with artifacts on master @ e90d15c9807775a1a1d89f75cac4c9383c325709:

--- FAIL: TestAlterChangefeedAddTargetsDuringBackfill (397.50s)
=== RUN   TestAlterChangefeedAddTargetsDuringBackfill/pulsar
    helpers_test.go:867: making server as system tenant
    helpers_test.go:943: making pulsar feed factory
    helpers_test.go:682: waiting for checkpoint
    helpers_test.go:682: waiting for checkpoint
    alter_changefeed_test.go:1359: set max span request keys: 116
    alter_changefeed_test.go:1359: set max span request keys: 192
    alter_changefeed_test.go:1359: set max span request keys: 144
    alter_changefeed_test.go:1359: set max span request keys: 160
    alter_changefeed_test.go:1359: set max span request keys: 173
    alter_changefeed_test.go:1359: set max span request keys: 151
    alter_changefeed_test.go:1359: set max span request keys: 154
    helpers_test.go:682: waiting for checkpoint
    helpers_test.go:685: read checkpoint: &jobspb.ChangefeedProgress_Checkpoint{Spans:[]roachpb.Span{roachpb.Span{Key:/Table/106/1, EndKey:/Table/106/1/NULL}, roachpb.Span{Key:/Table/106/1/308/0, EndKey:/Table/106/1/936/0}}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}}
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    alter_changefeed_test.go:1359: set max span request keys: 142
    alter_changefeed_test.go:1359: set max span request keys: 191
    alter_changefeed_test.go:1359: set max span request keys: 118
    alter_changefeed_test.go:1359: set max span request keys: 188
    alter_changefeed_test.go:1359: set max span request keys: 102
    alter_changefeed_test.go:1359: set max span request keys: 168
    alter_changefeed_test.go:1359: set max span request keys: 154
    alter_changefeed_test.go:1359: set max span request keys: 187
    alter_changefeed_test.go:1359: set max span request keys: 198
    alter_changefeed_test.go:1359: set max span request keys: 180
    alter_changefeed_test.go:1359: set max span request keys: 179
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1, EndKey:/Table/107/1/142/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1/142/0, EndKey:/Table/107/1/333/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1/333/0, EndKey:/Table/107/1/451/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1/451/0, EndKey:/Table/107/1/639/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/106/1/NULL, EndKey:/Table/106/1/102/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1/639/0, EndKey:/Table/107/1/807/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/106/1/102/0, EndKey:/Table/106/1/256/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1/807/0, EndKey:/Table/107/1/994/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/107/1, EndKey:/Table/107/2}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    helpers_test.go:697: waiting for highwater
    alter_changefeed_test.go:1435: resolved span: &jobspb.ResolvedSpan{Span:roachpb.Span{Key:/Table/106/1/NULL, EndKey:/Table/106/1/308/0}, Timestamp:hlc.Timestamp{WallTime:1715039819860418311, Logical:0}, BoundaryType:0}
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:697: waiting for highwater
    helpers_test.go:704: could not read highwater
    --- FAIL: TestAlterChangefeedAddTargetsDuringBackfill/pulsar (397.49s)

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/cdc

This test on roachdash | Improve this report!

Jira issue: CRDB-38490

[rharding6373]

Duplicate of other pulsar test failures. Pulsar test changes have been rolled back.