Live tailing sends duplicate logs

[slim-bean]

Describe the bug
When connected over the websocket you can/will receive duplicate logs (same labels, same message)

Expected behavior
Ideally we would not send duplicate logs

[stale]

This issue has been automatically marked as stale because it has not had any activity in the past 30 days. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

[aocenas]

@cyriltovena Based on our yesterday discussion I understand that this is not really fixable short term and client should either deduplicate itself or use the delay_for.

[slim-bean]

Closing this issue, it's always going to be difficult to remove all duplicates when using replication, the delay_for paramater can help but if you want your logs super fast you may get dupes.

[josh-ross-ai]

Closing this issue, it's always going to be difficult to remove all duplicates when using replication, the delay_for paramater can help but if you want your logs super fast you may get dupes.

When you say "using replication", do you mean within the promtail config? Or loki? Also, I am seeing what I think is a similar issue, however, the duplicate logs are coming from promtail agents running on different nodes. Was that the problem you were having @slim-bean ?