-
Notifications
You must be signed in to change notification settings - Fork 184
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add extraExporters to logs #3711
Conversation
6813dd7
to
b57d55a
Compare
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
4d4be7e
to
fd5ab33
Compare
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
fd5ab33
to
d2c0518
Compare
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
Signed-off-by: Dominik Rosiek <drosiek@sumologic.com>
I updated PR description with the documentation from the following PR: SumoLogic/sumologic-documentation#4128 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The feature itself looks good to me. I left some comments about tests.
In particular, wouldn't it be better to use Go tests for templates, instead of golden files? It'd be way less text wasted on properties we don't care about.
LGTM! one question do we expect this change to have an impact on our zaidan configuration, more than our customers using it? I haven't seen many customer tickets around custom routing. |
Hard to say, I remember some topics around spliting traffic into multiple locations, but I believe it is not so common |
4e296ae
to
ecc4d89
Compare
Sending Data to Multiple Targets
It is possible to send logs to multiple locations. This section describes the following cases:
Send Logs Simultaneously to Sumo Logic and Other Locations
In order to send data to Sumo Logic and other locations,
sumologic.logs.otelcol.extraExporters
should be used.With the following configuration data will be send to both Sumo Logic and AWS S3:
Send All Logs to Sumo Logic and Part of it to Other Locations
In case you want to send only part of logs to other location, you should use
sumologic.logs.otelcol.routing.table
in addition tosumologic.logs.otelcol.extraExporters
.In the following example, all logs are going to be send to Sumo Logic, and in addition only logs from
production
namespace are going to be send to AWS S3.sumologic.logs.otelcol.routing.table
is a list of maps, which consist of two keysexporter
andstatement
.Logs are send to
exporter
whenstatement
is met.exporter
should be defined insumologic.logs.otelcol.extraExporters
or default
sumologic
may be used.statement
has to be written inOpen Telemetry Transformation Language
:::note
Remember to use attributes after translation to Sumo Logic Schema, for example
namespace
instead ofk8s.namespace.name
:::
:::note
If log matches multiple statements, it will be send to all corresponding exporters.
For example, the following routing table will send logs from
production
namespace tosumologic/production
andawss3/production
::::
Send Logs Selectively to Multiple Locations
This scenario differs from the previous ones by not sending all logs to Sumo Logic. If you want to send some data to Sumo Logic and some (the same or other) data to other locations, you need to disable default exporters. Set
sumologic.logs.otelcol.useDefaultExporters
tofalse
and then setsumologic.logs.otelcol.routing.fallbackExporters
to a list of exporters which are going to be used for the logs which do not match any of the routing table statements.In the following example, logs from
production
namespace are going to be send to production Sumo Logic exporter and all remaining logs will be send to default Sumo Logic exporter: