Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update OTC to v0.38.1-sumo #1893

Merged
merged 6 commits into from
Nov 26, 2021
Merged

Update OTC to v0.38.1-sumo #1893

merged 6 commits into from
Nov 26, 2021

Conversation

mat-rumian
Copy link
Contributor

@mat-rumian mat-rumian commented Nov 19, 2021

Description
  • Update OpenTelemetry Collector version to v0.38.1-sumo

    • Move insecure parameter to separate configuration variable
    • Fix OTLP/HTTP metadata tagging
    • Update Cascading Filter processor to a new version which adds new features such filtering
      by number of errors and switches to a new, easier to use config format
    • Change the default number of traces for Cascading Filter to 200000

Testing performed
  • Redeploy fluentd and fluentd-events pods
  • Confirm events, logs, and metrics are coming in

@mat-rumian mat-rumian requested a review from a team as a code owner November 19, 2021 15:29
@pmm-sumo
Copy link
Contributor

Run some tests and overall it looks good

spans_per_second: -1
probabilistic_filtering_ratio: 0.2
spans_per_second: 1660
num_traces: 200000
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That changes the default, doesn't it? Is that ok for the users? Are we planning to document this in the CHANGELOG.md/release notes?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this is a concern since we never explained how to use prefilled values in values.yaml for cascading_filter. The initial idea was to provide instructions on how to just enable the processor in the pipeline, but this was never done and eventually we provide a template with instructions instead. So practically this might be considered a new thing.

I am pretty sure we want to mention OTC update in the changelog though

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree on including it in the Changelog.

I understand the explanation but this still in some way is a breaking change 😓 for our users. It was possible to have this configured in the old yaml "schema" and now it would change with this PR being merged, right?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it won't change much but of course we can mention this as well. So essentially something like:

  • Update OpenTelemetry Collector version to v0.38.1-sumo
    • Move insecure parameter to separate configuration variable
    • Fix OTLP/HTTP metadata tagging
    • Update Cascading Filter to new version which adds filtering by number of errors and uses new config format
    • Change the default number of traces for Cascading Filter to 200000

@mat-rumian what do you think?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you could add an entry about this change in the changelog that would be great 👍

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated the changelog and put some links there

deploy/helm/sumologic/values.yaml Show resolved Hide resolved
tests/tracing/static/simple.output.yaml Show resolved Hide resolved
@github-actions github-actions bot added the documentation documentation label Nov 24, 2021
@pmm-sumo pmm-sumo changed the title [WIP] Bump OTC and switch to Ballast Memory extension Bump OTC and switch to Ballast Memory extension Nov 24, 2021
Copy link
Contributor

@pmalek-sumo pmalek-sumo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@pmalek-sumo
Copy link
Contributor

pmalek-sumo commented Nov 26, 2021

@pmm-sumo Please update the description and we can merge it afterwards.

@pmm-sumo pmm-sumo changed the title Bump OTC and switch to Ballast Memory extension Update OTC to v0.38.1-sumo Nov 26, 2021
@pmalek-sumo pmalek-sumo merged commit a22b2c4 into main Nov 26, 2021
@pmalek-sumo pmalek-sumo deleted the bump-otc-cfp-bm branch November 26, 2021 10:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants