ccl/multitenantccl/tenantcostclient: TestDataDriven failed

[cockroach-teamcity]

ccl/multitenantccl/tenantcostclient.TestDataDriven failed with artifacts on release-23.1.18-rc @ 84cf36a2a05dcfcf6dfccf4014aad8f703ff6cef:

        ----
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:13:
        wait-for-event [0 args]
        low-ru
        ----
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:17:
        wait-for-event [0 args]
        token-bucket-response
        ----
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:22:
        token-bucket [0 args]
        <no input to command>
        ----
        2000.00 RU filling @ 100.00 RU/s (limited to 6000.00 RU)
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:27:
        configure [0 args]
        error: true
        ----
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:33:
        advance [0 args]
        9s
        ----
        00:00:09.000
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:39:
        wait-for-event [0 args]
        token-bucket-response-error
        ----
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:44:
        advance [1 args]
        2s
        ----
        00:00:11.000
    datadriven.go:144: 
        /home/roach/.cache/bazel/_bazel_roach/c5a4e7d36696d9cd970af2045211a7df/sandbox/processwrapper-sandbox/3771/execroot/com_github_cockroachdb_cockroach/bazel-out/k8-fastbuild/bin/pkg/ccl/multitenantccl/tenantcostclient/tenantcostclient_test_/tenantcostclient_test.runfiles/com_github_cockroachdb_cockroach/pkg/ccl/multitenantccl/tenantcostclient/testdata/fallback-throttled:49:
         
        expected:
        3100.00 RU filling @ 1000.00 RU/s (limited to 15000.00 RU)
        
        found:
        3100.00 RU filling @ 100.00 RU/s (limited to 6000.00 RU)
    panic.go:522: -- test log scope end --
test logs left over in: /artifacts/tmp/_tmp/0cce69e026224ea71be99da3223b988f/logTestDataDriven_fallback-throttled2317849784
    --- FAIL: TestDataDriven/fallback-throttled (0.02s)

Parameters:

• TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

• ccl/multitenantccl/tenantcostclient: TestDataDriven failed #121103 ccl/multitenantccl/tenantcostclient: TestDataDriven failed [C-test-failure O-robot T-multitenant branch-release-23.2 release-blocker]

/cc @cockroachdb/multi-tenant

This test on roachdash | Improve this report!

Jira issue: CRDB-37806

[yuzefovich]

seems like a rare flake (only seen this twice)