feat(datastreams): change DSM encoding to use base64 and decoding to …

[tabgok]

…handle multiple encoding types (#8611)

Makes DSM pathway encoding/decoding more resilient, also adds a DSMPathwayCodec class that handles encoding / decoding DSM context. This makes future changes easier, since all integrations will now use this class instead of the actual encoding / decoding methods.

Encode using base64 only

Try to decode the following:

• base64,
• deprecated encoding of bytes
• base64 encoding sent using deprecated key

Co-authored-by: Munir Abdinur munir.abdinur@datadoghq.com
(cherry picked from commit 3dd4c9d)

Checklist

• Change(s) are motivated and described in the PR description
• Testing strategy is described if automated tests are not included in the PR
• Risks are described (performance impact, potential for breakage, maintainability)
• Change is maintainable (easy to change, telemetry, documentation)
• Library release note guidelines are followed or label changelog/no-changelog is set
• Documentation is included (in-code, generated user docs, public corp docs)
• Backport labels are set (if applicable)
• If this PR changes the public interface, I've notified @DataDog/apm-tees.
• If change touches code that signs or publishes builds or packages, or handles credentials of any kind, I've requested a review from @DataDog/security-design-and-guidance.

Reviewer Checklist

• Title is accurate
• All changes are related to the pull request's stated goal
• Description motivates each change
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Change is maintainable (easy to change, telemetry, documentation)
• Release note makes sense to a user of the library
• Author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[datadog-dd-trace-py-rkomorn]

Datadog Report

Branch report: backport-8611-to-2.7
Commit report: fd07efc
Test service: dd-trace-py

❌ 8 Failed (1 Known Flaky), 99718 Passed, 72404 Skipped, 7h 14m 48.91s Total duration (3h 58m 54.48s time saved)

❌ Failed Tests (8)

This report shows up to 5 failed tests.

• test_kinesis_data_streams_enabled_put_record - test.py - ❄️ Known flaky - Details

  Expand for error

   Subprocess Test "python -m unittest tests.contrib.botocore.test.BotocoreTest.test_kinesis_data_streams_enabled_put_record" Failed
  

• test_kinesis_data_streams_enabled_put_record - test.py - Details

  Expand for error

   Subprocess Test "python -m unittest tests.contrib.botocore.test.BotocoreTest.test_kinesis_data_streams_enabled_put_record" Failed
  

• test_kinesis_data_streams_enabled_put_record - test.py - Details

  Expand for error

   Subprocess Test "python -m unittest tests.contrib.botocore.test.BotocoreTest.test_kinesis_data_streams_enabled_put_record" Failed
  

• test_kinesis_data_streams_enabled_put_record - test.py - Details

  Expand for error

   Subprocess Test "python -m unittest tests.contrib.botocore.test.BotocoreTest.test_kinesis_data_streams_enabled_put_record" Failed
  

• test_kinesis_data_streams_enabled_put_records - test.py

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-03-26 20:06:12

Comparing candidate commit fd07efc in PR branch backport-8611-to-2.7 with baseline commit 1776fd0 in branch 2.7.

Found 4 performance improvements and 1 performance regressions! Performance is the same for 196 metrics, 9 unstable metrics.

scenario:httppropagationextract-empty_headers

• 🟩 max_rss_usage [-781.574KB; -610.246KB] or [-3.577%; -2.793%]

scenario:httppropagationextract-medium_header_no_matches

• 🟩 max_rss_usage [-742.031KB; -491.275KB] or [-3.390%; -2.244%]

scenario:httppropagationextract-wsgi_large_header_no_matches

• 🟩 max_rss_usage [-782.350KB; -543.116KB] or [-3.578%; -2.484%]

scenario:httppropagationextract-wsgi_medium_header_no_matches

• 🟩 max_rss_usage [-795.305KB; -630.513KB] or [-3.636%; -2.882%]

scenario:samplingrules-low_match

• 🟥 execution_time [+9.738µs; +17.690µs] or [+2.138%; +3.884%]