Tempo: Streaming search does not pass X-Scope-OrgID header

[thomaspurchas]

What happened?

Trying to perform trace searches using Grafana with a Tempo datasource, with both multi-tenancy and streaming searches turned on. Result is a query error say no org id.

What did you expect to happen?

Streaming searches to work.

Did this work before?

Streaming searches worked before turning on Multi tenancy in Tempo. Disabling streaming searches or Multi tenancy fixes search errors.

How do we reproduce it?

1. Install Grafana 10.3 and latest Tempo
2. Turn on traceQLStreaming feature toggle
3. Turn on Multitenancy in Tempo
4. Connect Grafana to Temp, and add x-scope-orgid header in Tempo datasource
5. Try to perform a trace Search (not a traceID lookup)
6. Notice that no org id error is returned.

Is the bug inside a dashboard panel?

No response

Environment (with versions)?

Grafana: 10.3
OS: Mac OS
Browser: Chrome and Safari

Grafana platform?

Kubernetes

Datasource(s)?

Tempo

[williamfeng323]

I also encounter this issue. The custom header does not work at all. Grafana version 9.5.2

[joey-grafana]

Hello, this should be fixed 10.4. If you run into any issues in 10.4 please let us know.

[thomaspurchas]

For those wondering, this appears the PR that fixes this issue #81693