You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am writing a Kafka to Loki component and I am using Loki client from promtail. I am not using proxy for authentication yet but I think that it will not solve my problem.
Problem is that the data in Kafka is multi-tenant, therefore I need to send data to Loki with X-Scope-OrgID header. Determining OrgID is not trivial, therefore I think it would not be great to solve it in the proxy. It would be possible to send it in the data field but then it would have to be parsed in the proxy to determine OrgID but I think it is just simpler to set the header directly in the client.
The client is creating batches based on the labels, therefore I propose extracting the header from the labels.
I will send PR with example code.
The text was updated successfully, but these errors were encountered:
I can see that all logs (entries and labels) are sent in one bulk. How does promtail solves this? When proxy gets this request I suppose everything has to be from one organization.
I will try to split send to multiple sends with different headers.
This issue has been automatically marked as stale because it has not had any activity in the past 30 days. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.
stalebot
added
the
stale
A stale issue or PR that will automatically be closed.
label
Oct 22, 2019
I am writing a Kafka to Loki component and I am using Loki client from promtail. I am not using proxy for authentication yet but I think that it will not solve my problem.
Problem is that the data in Kafka is multi-tenant, therefore I need to send data to Loki with
X-Scope-OrgID
header. Determining OrgID is not trivial, therefore I think it would not be great to solve it in the proxy. It would be possible to send it in the data field but then it would have to be parsed in the proxy to determine OrgID but I think it is just simpler to set the header directly in the client.The client is creating batches based on the labels, therefore I propose extracting the header from the labels.
I will send PR with example code.
The text was updated successfully, but these errors were encountered: