CI Failure (Unknown unexpected error response from ABS) in ShadowIndexingCompactedTopicTest.test_upload

[vbotbuildovich]

https://buildkite.com/redpanda/redpanda/builds/43173

Module: rptest.tests.shadow_indexing_compacted_topic_test
Class: ShadowIndexingCompactedTopicTest
Method: test_upload
Arguments: {
    "cloud_storage_type": 2
}

test_id:    ShadowIndexingCompactedTopicTest.test_upload
status:     FAIL
run time:   179.919 seconds

<BadLogLines nodes=docker-rp-14(1) example="ERROR 2023-12-20 22:34:10,395 [shard 1:au  ] abs - abs_client.cc:492 - Received [Bad Request] Unknown unexpected error response from ABS:">
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 142, in wrapped
    redpanda.raise_on_bad_logs(
  File "/root/tests/rptest/services/redpanda.py", line 1321, in raise_on_bad_logs
    raise BadLogLines(bad_lines)
rptest.services.utils.BadLogLines: <BadLogLines nodes=docker-rp-14(1) example="ERROR 2023-12-20 22:34:10,395 [shard 1:au  ] abs - abs_client.cc:492 - Received [Bad Request] Unknown unexpected error response from ABS:">

JIRA Link: CORE-1685

[dotnwat]

I don't see anything out of the ordinary between successful put requests and the one that failed. Further, it seems like we throw away important information in the error reporting that would be helpful in debugging.

We should log more detailed trace information to debug this when it occurs. This could be the headers for the response. Or at least log information about why we are seemingly not getting the string error code parsed out of the xml or json response.

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45570

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46956

[piyushredpanda]

Not seen in at least two months, closing