Consider to integrate fluentd file scanner into the Satellite

[wu-sheng]

We have Fluentd integration merged, see #6260. But when we need Satellite MMAP or don't want Kafka as a transport layer, Satellite should be able to read logs(file) directly.
We could consider something similar with Fluentd in OTEL collector, and integrate it into the Satellite at the API level. FYI @hailin0

[dmsolr]

Do you mean to let Satallite own the ability to read log files directly?

[wu-sheng]

Do you mean to let Satallite own the ability to read log files directly?

Yes, I am.

[wu-sheng]

Then, we could remove the fluent agent and Kafka from the deployment.

[wu-sheng]

All logs could be transported in native gRPC log format, which is better.

[dmsolr]

Got it

[kagaya85]

Are we going to use some third-party lib like https://github.com/observIQ/stanza as an intergated log agent?

[wu-sheng]

Are we going to use some third-party lib like https://github.com/observIQ/stanza as an intergated log agent?

Please don't mix different topics.