feat(llmobs): emitting reasoning tokens metric for openai integration #15478

XG-xin · 2025-12-01T22:37:14Z

Description

Emit reasoning tokens metric, and remove it from metadata.
MLOB-4264

Testing

Risks

Additional Notes

github-actions · 2025-12-01T22:38:03Z

CODEOWNERS have been resolved as:

releasenotes/notes/openai-reasoning-token-c9300fb856562b7b.yaml         @DataDog/apm-python
tests/contrib/openai/cassettes/v1/response_reasoning_tokens.yaml        @DataDog/ml-observability
ddtrace/llmobs/_constants.py                                            @DataDog/ml-observability
ddtrace/llmobs/_integrations/openai.py                                  @DataDog/ml-observability
ddtrace/llmobs/_integrations/utils.py                                   @DataDog/ml-observability
tests/contrib/openai/test_openai_llmobs.py                              @DataDog/ml-observability
tests/contrib/openai_agents/test_openai_agents_llmobs.py                @DataDog/ml-observability

github-actions · 2025-12-01T23:09:51Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 250 ± 7 ms.

The average import time from base is: 253 ± 4 ms.

The import time difference between this PR and base is: -3.1 ± 0.3 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.734 ms (1.10%)

ddtrace.bootstrap.sitecustomize 1.370 ms (0.55%)

ddtrace.bootstrap.preload 1.370 ms (0.55%)

ddtrace.internal.remoteconfig.client 0.641 ms (0.26%)

ddtrace 1.364 ms (0.55%)

ddtrace._logger 0.685 ms (0.27%)

ddtrace.internal.telemetry 0.685 ms (0.27%)

ddtrace.internal.telemetry.writer 0.685 ms (0.27%)

ddtrace.internal.utils.version 0.685 ms (0.27%)

ddtrace.version 0.685 ms (0.27%)

ddtrace.internal._unpatched 0.028 ms (0.01%)

json 0.028 ms (0.01%)

json.decoder 0.028 ms (0.01%)

re 0.028 ms (0.01%)

enum 0.028 ms (0.01%)

types 0.028 ms (0.01%)

pr-commenter · 2025-12-01T23:22:51Z

Performance SLOs

Comparing candidate xinyuan/add-resoning-tokens (9051755) with baseline main (34ab1fa)

📈 Performance Regressions (3 suites)

📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.327µs (SLO: <10.000µs 📉 -96.7%) vs baseline: 📉 -18.9%

Memory: ✅ 38.358MB (SLO: <41.500MB -7.6%) vs baseline: +0.3%

✅ add_inplace_aspect

Time: ✅ 0.330µs (SLO: <10.000µs 📉 -96.7%) vs baseline: 📉 -18.8%

Memory: ✅ 38.299MB (SLO: <41.500MB -7.7%) vs baseline: +0.2%

✅ add_inplace_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: ~same

Memory: ✅ 38.280MB (SLO: <41.500MB -7.8%) vs baseline: -0.1%

✅ add_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -2.2%

Memory: ✅ 38.142MB (SLO: <41.500MB -8.1%) vs baseline: -0.3%

✅ bytearray_aspect

Time: ✅ 1.292µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -5.0%

Memory: ✅ 38.240MB (SLO: <41.500MB -7.9%) vs baseline: -0.3%

✅ bytearray_extend_aspect

Time: ✅ 1.475µs (SLO: <10.000µs 📉 -85.3%) vs baseline: -3.1%

Memory: ✅ 38.260MB (SLO: <41.500MB -7.8%) vs baseline: -1.0%

✅ bytearray_extend_noaspect

Time: ✅ 0.616µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +1.5%

Memory: ✅ 38.319MB (SLO: <41.500MB -7.7%) vs baseline: ~same

✅ bytearray_noaspect

Time: ✅ 0.481µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -1.0%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: -0.3%

✅ bytes_aspect

Time: ✅ 1.273µs (SLO: <10.000µs 📉 -87.3%) vs baseline: -1.5%

Memory: ✅ 38.240MB (SLO: <41.500MB -7.9%) vs baseline: ~same

✅ bytes_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.1%

Memory: ✅ 38.299MB (SLO: <41.500MB -7.7%) vs baseline: -0.5%

✅ bytesio_aspect

Time: ✅ 1.278µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -3.2%

Memory: ✅ 38.260MB (SLO: <41.500MB -7.8%) vs baseline: -0.1%

✅ bytesio_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.8%

Memory: ✅ 38.378MB (SLO: <41.500MB -7.5%) vs baseline: +0.2%

✅ capitalize_aspect

Time: ✅ 0.742µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.6%

Memory: ✅ 38.378MB (SLO: <41.500MB -7.5%) vs baseline: -0.1%

✅ capitalize_noaspect

Time: ✅ 0.437µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.4%

Memory: ✅ 38.240MB (SLO: <41.500MB -7.9%) vs baseline: -0.4%

✅ casefold_aspect

Time: ✅ 0.739µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.6%

Memory: ✅ 38.299MB (SLO: <41.500MB -7.7%) vs baseline: ~same

✅ casefold_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.1%

Memory: ✅ 38.398MB (SLO: <41.500MB -7.5%) vs baseline: ~same

✅ decode_aspect

Time: ✅ 0.721µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.5%

Memory: ✅ 38.221MB (SLO: <41.500MB -7.9%) vs baseline: -0.2%

✅ decode_noaspect

Time: ✅ 0.420µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.7%

Memory: ✅ 38.201MB (SLO: <41.500MB -7.9%) vs baseline: -0.5%

✅ encode_aspect

Time: ✅ 0.709µs (SLO: <10.000µs 📉 -92.9%) vs baseline: ~same

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: +0.1%

✅ encode_noaspect

Time: ✅ 0.399µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.4%

Memory: ✅ 38.378MB (SLO: <41.500MB -7.5%) vs baseline: +0.1%

✅ format_aspect

Time: ✅ 3.422µs (SLO: <10.000µs 📉 -65.8%) vs baseline: -0.3%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: -0.3%

✅ format_map_aspect

Time: ✅ 4.183µs (SLO: <10.000µs 📉 -58.2%) vs baseline: 📈 +16.0%

Memory: ✅ 38.122MB (SLO: <41.500MB -8.1%) vs baseline: -0.5%

✅ format_map_noaspect

Time: ✅ 0.772µs (SLO: <10.000µs 📉 -92.3%) vs baseline: +0.5%

Memory: ✅ 38.378MB (SLO: <41.500MB -7.5%) vs baseline: +0.1%

✅ format_noaspect

Time: ✅ 0.594µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.5%

Memory: ✅ 38.378MB (SLO: <41.500MB -7.5%) vs baseline: ~same

✅ index_aspect

Time: ✅ 0.342µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -4.0%

Memory: ✅ 38.496MB (SLO: <41.500MB -7.2%) vs baseline: +0.2%

✅ index_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.8%

Memory: ✅ 38.358MB (SLO: <41.500MB -7.6%) vs baseline: -0.1%

✅ join_aspect

Time: ✅ 1.254µs (SLO: <10.000µs 📉 -87.5%) vs baseline: -6.0%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: -0.3%

✅ join_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.2%

Memory: ✅ 38.260MB (SLO: <41.500MB -7.8%) vs baseline: ~same

✅ ljust_aspect

Time: ✅ 2.519µs (SLO: <20.000µs 📉 -87.4%) vs baseline: -1.5%

Memory: ✅ 38.221MB (SLO: <41.500MB -7.9%) vs baseline: -0.4%

✅ ljust_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.4%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: ~same

✅ lower_aspect

Time: ✅ 2.194µs (SLO: <10.000µs 📉 -78.1%) vs baseline: -3.3%

Memory: ✅ 38.280MB (SLO: <41.500MB -7.8%) vs baseline: -0.2%

✅ lower_noaspect

Time: ✅ 0.368µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.8%

Memory: ✅ 38.240MB (SLO: <41.500MB -7.9%) vs baseline: -0.3%

✅ lstrip_aspect

Time: ✅ 2.224µs (SLO: <20.000µs 📉 -88.9%) vs baseline: -1.2%

Memory: ✅ 38.280MB (SLO: <41.500MB -7.8%) vs baseline: -0.1%

✅ lstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.2%

Memory: ✅ 38.260MB (SLO: <41.500MB -7.8%) vs baseline: ~same

✅ modulo_aspect

Time: ✅ 0.929µs (SLO: <10.000µs 📉 -90.7%) vs baseline: -6.6%

Memory: ✅ 38.299MB (SLO: <41.500MB -7.7%) vs baseline: ~same

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.458µs (SLO: <10.000µs 📉 -85.4%) vs baseline: -6.1%

Memory: ✅ 38.201MB (SLO: <41.500MB -7.9%) vs baseline: -0.6%

✅ modulo_aspect_for_bytes

Time: ✅ 0.906µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -6.6%

Memory: ✅ 38.260MB (SLO: <41.500MB -7.8%) vs baseline: -1.1%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.136µs (SLO: <10.000µs 📉 -88.6%) vs baseline: -6.1%

Memory: ✅ 38.221MB (SLO: <41.500MB -7.9%) vs baseline: -0.4%

✅ modulo_noaspect

Time: ✅ 0.628µs (SLO: <10.000µs 📉 -93.7%) vs baseline: +0.6%

Memory: ✅ 38.260MB (SLO: <41.500MB -7.8%) vs baseline: -0.2%

✅ replace_aspect

Time: ✅ 5.062µs (SLO: <10.000µs 📉 -49.4%) vs baseline: +2.0%

Memory: ✅ 38.240MB (SLO: <41.500MB -7.9%) vs baseline: -0.8%

✅ replace_noaspect

Time: ✅ 0.466µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +1.0%

Memory: ✅ 38.417MB (SLO: <41.500MB -7.4%) vs baseline: ~same

✅ repr_aspect

Time: ✅ 0.904µs (SLO: <10.000µs 📉 -91.0%) vs baseline: +0.1%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: -0.3%

✅ repr_noaspect

Time: ✅ 0.415µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -1.2%

Memory: ✅ 38.280MB (SLO: <41.500MB -7.8%) vs baseline: -0.1%

✅ rstrip_aspect

Time: ✅ 1.878µs (SLO: <20.000µs 📉 -90.6%) vs baseline: -2.9%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: -0.1%

✅ rstrip_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -1.3%

Memory: ✅ 38.299MB (SLO: <41.500MB -7.7%) vs baseline: -0.2%

✅ slice_aspect

Time: ✅ 0.483µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -1.4%

Memory: ✅ 38.280MB (SLO: <41.500MB -7.8%) vs baseline: ~same

✅ slice_noaspect

Time: ✅ 0.442µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.2%

Memory: ✅ 38.201MB (SLO: <41.500MB -7.9%) vs baseline: ~same

✅ stringio_aspect

Time: ✅ 1.507µs (SLO: <10.000µs 📉 -84.9%) vs baseline: -1.7%

Memory: ✅ 38.476MB (SLO: <41.500MB -7.3%) vs baseline: +0.3%

✅ stringio_noaspect

Time: ✅ 0.717µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.2%

Memory: ✅ 38.358MB (SLO: <41.500MB -7.6%) vs baseline: ~same

✅ strip_aspect

Time: ✅ 2.208µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.5%

Memory: ✅ 38.221MB (SLO: <41.500MB -7.9%) vs baseline: -0.2%

✅ strip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.7%

Memory: ✅ 38.201MB (SLO: <41.500MB -7.9%) vs baseline: -0.4%

✅ swapcase_aspect

Time: ✅ 2.401µs (SLO: <10.000µs 📉 -76.0%) vs baseline: -1.7%

Memory: ✅ 38.201MB (SLO: <41.500MB -7.9%) vs baseline: -0.3%

✅ swapcase_noaspect

Time: ✅ 0.536µs (SLO: <10.000µs 📉 -94.6%) vs baseline: ~same

Memory: ✅ 38.378MB (SLO: <41.500MB -7.5%) vs baseline: +0.1%

✅ title_aspect

Time: ✅ 2.344µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.6%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: -0.2%

✅ title_noaspect

Time: ✅ 0.501µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.6%

Memory: ✅ 38.299MB (SLO: <41.500MB -7.7%) vs baseline: ~same

✅ translate_aspect

Time: ✅ 3.249µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -1.7%

Memory: ✅ 38.240MB (SLO: <41.500MB -7.9%) vs baseline: ~same

✅ translate_noaspect

Time: ✅ 1.041µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.5%

Memory: ✅ 38.339MB (SLO: <41.500MB -7.6%) vs baseline: +0.2%

✅ upper_aspect

Time: ✅ 2.315µs (SLO: <10.000µs 📉 -76.9%) vs baseline: +3.3%

Memory: ✅ 38.280MB (SLO: <41.500MB -7.8%) vs baseline: -0.1%

✅ upper_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.6%

Memory: ✅ 38.319MB (SLO: <41.500MB -7.7%) vs baseline: -0.1%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.194µs (SLO: <10.000µs 📉 -48.1%) vs baseline: 📈 +26.2%

Memory: ✅ 38.201MB (SLO: <41.000MB -6.8%) vs baseline: -0.4%

✅ ospathbasename_noaspect

Time: ✅ 1.087µs (SLO: <10.000µs 📉 -89.1%) vs baseline: -0.3%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +0.4%

✅ ospathjoin_aspect

Time: ✅ 6.110µs (SLO: <10.000µs 📉 -38.9%) vs baseline: -0.5%

Memory: ✅ 38.358MB (SLO: <41.000MB -6.4%) vs baseline: -0.3%

✅ ospathjoin_noaspect

Time: ✅ 2.290µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +0.5%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.4%

✅ ospathnormcase_aspect

Time: ✅ 3.467µs (SLO: <10.000µs 📉 -65.3%) vs baseline: +0.4%

Memory: ✅ 38.201MB (SLO: <41.000MB -6.8%) vs baseline: -0.6%

✅ ospathnormcase_noaspect

Time: ✅ 0.572µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.9%

Memory: ✅ 38.673MB (SLO: <41.000MB -5.7%) vs baseline: +0.7%

✅ ospathsplit_aspect

Time: ✅ 4.810µs (SLO: <10.000µs 📉 -51.9%) vs baseline: +0.9%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.6%

✅ ospathsplit_noaspect

Time: ✅ 1.592µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.1%

Memory: ✅ 38.457MB (SLO: <41.000MB -6.2%) vs baseline: -0.1%

✅ ospathsplitdrive_aspect

Time: ✅ 3.693µs (SLO: <10.000µs 📉 -63.1%) vs baseline: +1.3%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.5%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.696µs (SLO: <10.000µs 📉 -93.0%) vs baseline: -0.6%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +0.3%

✅ ospathsplitext_aspect

Time: ✅ 4.566µs (SLO: <10.000µs 📉 -54.3%) vs baseline: +1.2%

Memory: ✅ 38.398MB (SLO: <41.000MB -6.3%) vs baseline: ~same

✅ ospathsplitext_noaspect

Time: ✅ 1.383µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.4%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +0.6%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.393µs (SLO: <20.000µs 📉 -83.0%) vs baseline: 📈 +14.6%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

✅ 1-count-metrics-100-times

Time: ✅ 203.068µs (SLO: <220.000µs -7.7%) vs baseline: +0.6%

Memory: ✅ 34.662MB (SLO: <35.500MB -2.4%) vs baseline: +4.6%

✅ 1-distribution-metric-1-times

Time: ✅ 3.228µs (SLO: <20.000µs 📉 -83.9%) vs baseline: -3.7%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ 1-distribution-metrics-100-times

Time: ✅ 216.347µs (SLO: <230.000µs -5.9%) vs baseline: -1.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ 1-gauge-metric-1-times

Time: ✅ 2.183µs (SLO: <20.000µs 📉 -89.1%) vs baseline: -1.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%

✅ 1-gauge-metrics-100-times

Time: ✅ 138.705µs (SLO: <150.000µs -7.5%) vs baseline: +0.2%

Memory: ✅ 34.682MB (SLO: <35.500MB -2.3%) vs baseline: +4.5%

✅ 1-rate-metric-1-times

Time: ✅ 3.068µs (SLO: <20.000µs 📉 -84.7%) vs baseline: -2.0%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.4%

✅ 1-rate-metrics-100-times

Time: ✅ 215.365µs (SLO: <250.000µs 📉 -13.9%) vs baseline: -0.4%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ 100-count-metrics-100-times

Time: ✅ 20.136ms (SLO: <22.000ms -8.5%) vs baseline: -1.2%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.230ms (SLO: <2.300ms -3.1%) vs baseline: -4.1%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.422ms (SLO: <1.550ms -8.3%) vs baseline: -0.5%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%

✅ 100-rate-metrics-100-times

Time: ✅ 2.206ms (SLO: <2.550ms 📉 -13.5%) vs baseline: -0.3%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

✅ flush-1-metric

Time: ✅ 4.499µs (SLO: <20.000µs 📉 -77.5%) vs baseline: -2.9%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 173.555µs (SLO: <250.000µs 📉 -30.6%) vs baseline: -0.7%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.6%

✅ flush-1000-metrics

Time: ✅ 2.177ms (SLO: <2.500ms 📉 -12.9%) vs baseline: ~same

Memory: ✅ 35.861MB (SLO: <36.500MB 🟡 -1.7%) vs baseline: +4.5%

🟡 Near SLO Breach (15 suites)

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.664ms (SLO: <22.300ms 📉 -11.8%) vs baseline: +0.4%

Memory: ✅ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +5.0%

✅ exception-replay-enabled

Time: ✅ 1.362ms (SLO: <1.450ms -6.1%) vs baseline: -0.1%

Memory: ✅ 66.239MB (SLO: <67.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ iast

Time: ✅ 19.624ms (SLO: <22.250ms 📉 -11.8%) vs baseline: -0.2%

Memory: ✅ 68.144MB (SLO: <70.000MB -2.7%) vs baseline: +4.8%

✅ profiler

Time: ✅ 15.452ms (SLO: <16.550ms -6.6%) vs baseline: +0.3%

Memory: ✅ 56.354MB (SLO: <57.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 19.552ms (SLO: <21.750ms 📉 -10.1%) vs baseline: +0.1%

Memory: ✅ 68.184MB (SLO: <70.500MB -3.3%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 19.839ms (SLO: <28.200ms 📉 -29.6%) vs baseline: +0.2%

Memory: ✅ 68.117MB (SLO: <71.000MB -4.1%) vs baseline: +4.8%

✅ tracer

Time: ✅ 19.630ms (SLO: <21.750ms -9.7%) vs baseline: +0.1%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 21.704ms (SLO: <23.500ms -7.6%) vs baseline: +1.7%

Memory: ✅ 69.226MB (SLO: <71.000MB -2.5%) vs baseline: +4.8%

✅ tracer-dont-create-db-spans

Time: ✅ 19.581ms (SLO: <21.500ms -8.9%) vs baseline: -0.6%

Memory: ✅ 68.203MB (SLO: <70.000MB -2.6%) vs baseline: +4.9%

✅ tracer-minimal

Time: ✅ 16.772ms (SLO: <17.500ms -4.2%) vs baseline: ~same

Memory: ✅ 67.810MB (SLO: <70.000MB -3.1%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 19.407ms (SLO: <21.750ms 📉 -10.8%) vs baseline: -0.4%

Memory: ✅ 68.164MB (SLO: <72.500MB -6.0%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 17.685ms (SLO: <19.650ms 📉 -10.0%) vs baseline: +0.4%

Memory: ✅ 68.085MB (SLO: <70.000MB -2.7%) vs baseline: +5.3%

✅ tracer-no-databases

Time: ✅ 19.071ms (SLO: <20.100ms -5.1%) vs baseline: -1.1%

Memory: ✅ 67.805MB (SLO: <70.000MB -3.1%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 19.414ms (SLO: <21.500ms -9.7%) vs baseline: +0.6%

Memory: ✅ 68.223MB (SLO: <70.000MB -2.5%) vs baseline: +5.5%

✅ tracer-no-templates

Time: ✅ 19.525ms (SLO: <22.000ms 📉 -11.3%) vs baseline: +0.5%

Memory: ✅ 68.164MB (SLO: <70.500MB -3.3%) vs baseline: +5.3%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.324ms (SLO: <19.850ms 📉 -17.8%) vs baseline: +0.1%

Memory: ✅ 69.855MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 16.312ms (SLO: <19.400ms 📉 -15.9%) vs baseline: +0.1%

Memory: ✅ 69.816MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +5.0%

✅ tracer-enabled

Time: ✅ 16.361ms (SLO: <19.450ms 📉 -15.9%) vs baseline: ~same

Memory: ✅ 69.824MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +5.0%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.066ms (SLO: <2.300ms 📉 -10.2%) vs baseline: +0.2%

Memory: ✅ 55.778MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +5.5%

✅ errortracking-enabled-user

Time: ✅ 2.074ms (SLO: <2.250ms -7.8%) vs baseline: ~same

Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +5.7%

✅ tracer-enabled

Time: ✅ 2.062ms (SLO: <2.300ms 📉 -10.4%) vs baseline: -0.2%

Memory: ✅ 55.758MB (SLO: <56.500MB 🟡 -1.3%) vs baseline: +5.7%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.375ms (SLO: <4.750ms 📉 -28.9%) vs baseline: -0.2%

Memory: ✅ 55.509MB (SLO: <66.500MB 📉 -16.5%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 2.860ms (SLO: <6.750ms 📉 -57.6%) vs baseline: +0.1%

Memory: ✅ 55.688MB (SLO: <66.500MB 📉 -16.3%) vs baseline: +4.6%

✅ appsec-telemetry

Time: ✅ 3.382ms (SLO: <4.750ms 📉 -28.8%) vs baseline: +0.1%

Memory: ✅ 55.489MB (SLO: <66.500MB 📉 -16.6%) vs baseline: +4.9%

✅ debugger

Time: ✅ 1.869ms (SLO: <2.000ms -6.5%) vs baseline: +0.2%

Memory: ✅ 47.878MB (SLO: <49.500MB -3.3%) vs baseline: +4.7%

✅ iast-get

Time: ✅ 1.855ms (SLO: <2.000ms -7.3%) vs baseline: +0.1%

Memory: ✅ 44.536MB (SLO: <49.000MB -9.1%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.908ms (SLO: <2.100ms -9.1%) vs baseline: +0.1%

Memory: ✅ 48.842MB (SLO: <50.000MB -2.3%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 3.353ms (SLO: <3.650ms -8.1%) vs baseline: -0.5%

Memory: ✅ 55.470MB (SLO: <56.000MB 🟡 -0.9%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.370ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 55.566MB (SLO: <56.500MB 🟡 -1.7%) vs baseline: +4.8%

✅ tracer-native

Time: ✅ 3.368ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 55.587MB (SLO: <60.000MB -7.4%) vs baseline: +5.1%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.057ms (SLO: <4.200ms 📉 -51.0%) vs baseline: ~same

Memory: ✅ 55.797MB (SLO: <66.000MB 📉 -15.5%) vs baseline: +5.5%

✅ iast-enabled

Time: ✅ 2.075ms (SLO: <2.800ms 📉 -25.9%) vs baseline: +0.6%

Memory: ✅ 55.738MB (SLO: <62.500MB 📉 -10.8%) vs baseline: +5.5%

✅ tracer-enabled

Time: ✅ 2.057ms (SLO: <2.250ms -8.6%) vs baseline: -0.2%

Memory: ✅ 55.738MB (SLO: <56.500MB 🟡 -1.3%)

🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.159µs (SLO: <100.000µs 📉 -18.8%) vs baseline: +0.2%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%

✅ b3_headers

Time: ✅ 14.204µs (SLO: <20.000µs 📉 -29.0%) vs baseline: -0.1%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ b3_single_headers

Time: ✅ 13.097µs (SLO: <20.000µs 📉 -34.5%) vs baseline: -1.8%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.648µs (SLO: <80.000µs 📉 -20.4%) vs baseline: -0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 65.927µs (SLO: <80.000µs 📉 -17.6%) vs baseline: ~same

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.6%

✅ empty_headers

Time: ✅ 1.639µs (SLO: <10.000µs 📉 -83.6%) vs baseline: +1.4%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ full_t_id_datadog_headers

Time: ✅ 22.486µs (SLO: <30.000µs 📉 -25.0%) vs baseline: -0.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.4%

✅ invalid_priority_header

Time: ✅ 6.586µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +1.1%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%

✅ invalid_span_id_header

Time: ✅ 6.552µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.4%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ invalid_tags_header

Time: ✅ 6.570µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.2%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0%

✅ invalid_trace_id_header

Time: ✅ 6.553µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ large_header_no_matches

Time: ✅ 27.614µs (SLO: <30.000µs -8.0%) vs baseline: -0.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ large_valid_headers_all

Time: ✅ 28.696µs (SLO: <40.000µs 📉 -28.3%) vs baseline: -0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ medium_header_no_matches

Time: ✅ 9.870µs (SLO: <20.000µs 📉 -50.7%) vs baseline: -0.1%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ medium_valid_headers_all

Time: ✅ 11.309µs (SLO: <20.000µs 📉 -43.5%) vs baseline: +0.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.8%

✅ none_propagation_style

Time: ✅ 1.737µs (SLO: <10.000µs 📉 -82.6%) vs baseline: +0.3%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.5%

✅ tracecontext_headers

Time: ✅ 34.880µs (SLO: <40.000µs 📉 -12.8%) vs baseline: +0.2%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.572µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.7%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.092µs (SLO: <10.000µs 📉 -39.1%) vs baseline: -0.2%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.5%

✅ wsgi_empty_headers

Time: ✅ 1.623µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.7%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ wsgi_invalid_priority_header

Time: ✅ 6.573µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.2%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.3%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ wsgi_invalid_tags_header

Time: ✅ 6.568µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.7%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.665µs (SLO: <10.000µs 📉 -33.3%) vs baseline: +1.6%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%

✅ wsgi_large_header_no_matches

Time: ✅ 28.722µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.1%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.849µs (SLO: <40.000µs 📉 -25.4%) vs baseline: +0.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.189µs (SLO: <20.000µs 📉 -49.1%) vs baseline: +0.4%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.724µs (SLO: <20.000µs 📉 -41.4%) vs baseline: +0.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.1%

✅ wsgi_valid_headers_all

Time: ✅ 6.600µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ wsgi_valid_headers_basic

Time: ✅ 6.118µs (SLO: <10.000µs 📉 -38.8%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 22.089µs (SLO: <30.000µs 📉 -26.4%) vs baseline: +4.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.8%

✅ with_all

Time: ✅ 27.710µs (SLO: <40.000µs 📉 -30.7%) vs baseline: -0.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ with_dd_origin

Time: ✅ 24.827µs (SLO: <30.000µs 📉 -17.2%) vs baseline: -0.2%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%

✅ with_priority_and_origin

Time: ✅ 23.933µs (SLO: <40.000µs 📉 -40.2%) vs baseline: -1.2%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ with_sampling_priority

Time: ✅ 20.846µs (SLO: <30.000µs 📉 -30.5%) vs baseline: -1.8%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ with_tags

Time: ✅ 26.001µs (SLO: <40.000µs 📉 -35.0%) vs baseline: -0.1%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ with_tags_invalid

Time: ✅ 27.329µs (SLO: <40.000µs 📉 -31.7%) vs baseline: -0.4%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%

✅ with_tags_max_size

Time: ✅ 26.376µs (SLO: <40.000µs 📉 -34.1%) vs baseline: -1.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.1%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.242ms (SLO: <47.150ms 📉 -14.7%) vs baseline: +2.1%

Memory: ✅ 39.410MB (SLO: <47.000MB 📉 -16.1%) vs baseline: +4.6%

✅ add-metrics

Time: ✅ 260.063ms (SLO: <344.800ms 📉 -24.6%) vs baseline: -0.8%

Memory: ✅ 43.679MB (SLO: <47.500MB -8.0%) vs baseline: +4.6%

✅ add-tags

Time: ✅ 314.703ms (SLO: <321.000ms 🟡 -2.0%) vs baseline: -0.6%

Memory: ✅ 43.905MB (SLO: <47.500MB -7.6%) vs baseline: +4.8%

✅ get-context

Time: ✅ 80.614ms (SLO: <92.350ms 📉 -12.7%) vs baseline: +1.4%

Memory: ✅ 39.948MB (SLO: <46.500MB 📉 -14.1%) vs baseline: +5.5%

✅ is-recording

Time: ✅ 37.841ms (SLO: <44.500ms 📉 -15.0%) vs baseline: +2.0%

Memory: ✅ 39.509MB (SLO: <47.500MB 📉 -16.8%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 58.975ms (SLO: <67.650ms 📉 -12.8%) vs baseline: +1.1%

Memory: ✅ 39.884MB (SLO: <47.000MB 📉 -15.1%) vs baseline: +4.7%

✅ set-status

Time: ✅ 44.238ms (SLO: <50.400ms 📉 -12.2%) vs baseline: +1.5%

Memory: ✅ 39.338MB (SLO: <47.000MB 📉 -16.3%) vs baseline: +4.5%

✅ start

Time: ✅ 38.089ms (SLO: <43.450ms 📉 -12.3%) vs baseline: +3.8%

Memory: ✅ 39.476MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 82.603ms (SLO: <88.000ms -6.1%) vs baseline: +1.2%

Memory: ✅ 37.277MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 84.140ms (SLO: <89.000ms -5.5%) vs baseline: +1.0%

Memory: ✅ 37.277MB (SLO: <46.500MB 📉 -19.8%) vs baseline: +4.6%

✅ update-name

Time: ✅ 38.669ms (SLO: <45.150ms 📉 -14.4%) vs baseline: +2.0%

Memory: ✅ 39.651MB (SLO: <47.000MB 📉 -15.6%) vs baseline: +5.0%

🟡 packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 345.070ms (SLO: <354.300ms -2.6%) vs baseline: -0.6%

Memory: ✅ 40.715MB (SLO: <41.500MB 🟡 -1.9%) vs baseline: +4.2%

✅ cache_on

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.2%

Memory: ✅ 39.318MB (SLO: <41.000MB -4.1%) vs baseline: +4.7%

🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.372µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.8%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.7%

✅ high_rate_limit

Time: ✅ 2.438µs (SLO: <10.000µs 📉 -75.6%) vs baseline: ~same

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%

✅ long_window

Time: ✅ 2.370µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.8%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.7%

✅ low_rate_limit

Time: ✅ 2.390µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +1.0%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.9%

✅ no_rate_limit

Time: ✅ 0.827µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -1.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +3.8%

✅ short_window

Time: ✅ 2.494µs (SLO: <10.000µs 📉 -75.1%) vs baseline: +0.3%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 308.963ms (SLO: <320.950ms -3.7%) vs baseline: -0.1%

Memory: ✅ 35.940MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.7%

✅ deep-profiled

Time: ✅ 327.378ms (SLO: <359.150ms -8.8%) vs baseline: -0.5%

Memory: ✅ 39.892MB (SLO: <40.500MB 🟡 -1.5%) vs baseline: +5.0%

✅ medium

Time: ✅ 6.999ms (SLO: <7.400ms -5.4%) vs baseline: ~same

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +5.1%

✅ shallow

Time: ✅ 0.947ms (SLO: <1.050ms -9.8%) vs baseline: +1.2%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 137.914µs (SLO: <290.000µs 📉 -52.4%) vs baseline: ~same

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ high_match

Time: ✅ 173.285µs (SLO: <480.000µs 📉 -63.9%) vs baseline: -1.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ low_match

Time: ✅ 98.973µs (SLO: <120.000µs 📉 -17.5%) vs baseline: -0.4%

Memory: ✅ 603.551MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.8%

✅ very_low_match

Time: ✅ 2.666ms (SLO: <8.500ms 📉 -68.6%) vs baseline: ~same

Memory: ✅ 71.022MB (SLO: <75.000MB -5.3%) vs baseline: +4.8%

🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.520µs (SLO: <20.000µs 📉 -47.4%) vs baseline: +0.2%

Memory: ✅ 35.665MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +5.3%

✅ all-enabled

Time: ✅ 41.302µs (SLO: <50.000µs 📉 -17.4%) vs baseline: +3.2%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +5.0%

✅ collectipvariant_exists

Time: ✅ 40.907µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.1%

Memory: ✅ 35.350MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.7%

✅ no-collectipvariant

Time: ✅ 40.237µs (SLO: <50.000µs 📉 -19.5%) vs baseline: +0.5%

Memory: ✅ 35.271MB (SLO: <36.000MB -2.0%) vs baseline: +4.5%

✅ no-useragentvariant

Time: ✅ 39.117µs (SLO: <50.000µs 📉 -21.8%) vs baseline: +0.3%

Memory: ✅ 35.212MB (SLO: <36.000MB -2.2%) vs baseline: +4.3%

✅ obfuscation-no-query

Time: ✅ 40.809µs (SLO: <50.000µs 📉 -18.4%) vs baseline: +0.3%

Memory: ✅ 35.252MB (SLO: <36.000MB -2.1%) vs baseline: +4.6%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.214µs (SLO: <90.000µs 📉 -15.3%) vs baseline: +0.6%

Memory: ✅ 35.606MB (SLO: <36.500MB -2.5%) vs baseline: +4.7%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.532µs (SLO: <90.000µs 📉 -15.0%) vs baseline: ~same

Memory: ✅ 35.665MB (SLO: <36.500MB -2.3%) vs baseline: +4.8%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.493µs (SLO: <170.000µs -9.1%) vs baseline: -0.1%

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.735µs (SLO: <160.000µs -7.0%) vs baseline: +0.2%

Memory: ✅ 35.606MB (SLO: <36.500MB -2.5%) vs baseline: +5.0%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.336µs (SLO: <170.000µs -8.6%) vs baseline: +0.2%

Memory: ✅ 35.645MB (SLO: <36.500MB -2.3%) vs baseline: +4.6%

✅ useragentvariant_exists_1

Time: ✅ 39.715µs (SLO: <50.000µs 📉 -20.6%) vs baseline: +0.2%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.8%

✅ useragentvariant_exists_2

Time: ✅ 40.920µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.3%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +4.7%

✅ useragentvariant_exists_3

Time: ✅ 40.212µs (SLO: <50.000µs 📉 -19.6%) vs baseline: +0.4%

Memory: ✅ 35.370MB (SLO: <36.000MB 🟡 -1.8%) vs baseline: +5.2%

✅ useragentvariant_not_exists_1

Time: ✅ 39.820µs (SLO: <50.000µs 📉 -20.4%) vs baseline: +0.6%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.577µs (SLO: <50.000µs 📉 -20.8%) vs baseline: -0.3%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.8%

🟡 span - 26/26

✅ add-event

Time: ✅ 18.183ms (SLO: <22.500ms 📉 -19.2%) vs baseline: -0.3%

Memory: ✅ 36.889MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 88.433ms (SLO: <93.500ms -5.4%) vs baseline: -0.2%

Memory: ✅ 41.052MB (SLO: <53.000MB 📉 -22.5%) vs baseline: +4.7%

✅ add-tags

Time: ✅ 142.243ms (SLO: <155.000ms -8.2%) vs baseline: +0.1%

Memory: ✅ 41.080MB (SLO: <53.000MB 📉 -22.5%) vs baseline: +4.9%

✅ get-context

Time: ✅ 17.010ms (SLO: <20.500ms 📉 -17.0%) vs baseline: ~same

Memory: ✅ 36.735MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 17.189ms (SLO: <20.500ms 📉 -16.1%) vs baseline: -0.5%

Memory: ✅ 36.735MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 36.654ms (SLO: <40.000ms -8.4%) vs baseline: +0.2%

Memory: ✅ 37.230MB (SLO: <53.000MB 📉 -29.8%) vs baseline: +4.6%

✅ set-status

Time: ✅ 18.638ms (SLO: <22.000ms 📉 -15.3%) vs baseline: ~same

Memory: ✅ 36.660MB (SLO: <53.000MB 📉 -30.8%) vs baseline: +4.7%

✅ start

Time: ✅ 17.312ms (SLO: <20.500ms 📉 -15.6%) vs baseline: +2.2%

Memory: ✅ 36.742MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +5.1%

✅ start-finish

Time: ✅ 51.027ms (SLO: <52.500ms -2.8%) vs baseline: +0.6%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 52.417ms (SLO: <54.500ms -3.8%) vs baseline: +0.7%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ start-finish-traceid128

Time: ✅ 54.200ms (SLO: <57.000ms -4.9%) vs baseline: +0.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ start-traceid128

Time: ✅ 17.311ms (SLO: <22.500ms 📉 -23.1%) vs baseline: +0.8%

Memory: ✅ 36.682MB (SLO: <53.000MB 📉 -30.8%) vs baseline: +4.6%

✅ update-name

Time: ✅ 17.297ms (SLO: <22.000ms 📉 -21.4%) vs baseline: +0.3%

Memory: ✅ 36.799MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.9%

🟡 tracer - 6/6

✅ large

Time: ✅ 29.268ms (SLO: <32.950ms 📉 -11.2%) vs baseline: +0.6%

Memory: ✅ 35.901MB (SLO: <36.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ medium

Time: ✅ 2.889ms (SLO: <3.200ms -9.7%) vs baseline: +0.3%

Memory: ✅ 34.721MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ small

Time: ✅ 331.252µs (SLO: <370.000µs 📉 -10.5%) vs baseline: +1.6%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +5.0%

📉 Performance Improvements (1 suite)

📉 iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.191µs (SLO: <60.000µs 📉 -18.0%) vs baseline: +1.1%

Memory: ✅ 38.181MB (SLO: <42.000MB -9.1%) vs baseline: ~same

✅ propagation_enabled

Time: ✅ 137.776µs (SLO: <190.000µs 📉 -27.5%) vs baseline: 📉 -21.4%

Memory: ✅ 38.122MB (SLO: <42.000MB -9.2%) vs baseline: -0.3%

✅ propagation_enabled_100

Time: ✅ 1.585ms (SLO: <2.300ms 📉 -31.1%) vs baseline: 📉 -17.8%

Memory: ✅ 38.260MB (SLO: <42.000MB -8.9%) vs baseline: +0.3%

✅ propagation_enabled_1000

Time: ✅ 29.011ms (SLO: <34.550ms 📉 -16.0%) vs baseline: 📉 -11.6%

Memory: ✅ 38.496MB (SLO: <42.000MB -8.3%) vs baseline: +0.6%

⚠️ Unstable Tests (2 suites)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.249µs (SLO: <20.000µs 📉 -33.8%) vs baseline: +0.2%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.9%

✅ context_with_data_no_listeners

Time: ✅ 3.287µs (SLO: <10.000µs 📉 -67.1%) vs baseline: -0.2%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.8%

✅ get_item_exists

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.7%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.6%

✅ get_item_missing

Time: ✅ 0.632µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -1.5%

Memory: ✅ 34.701MB (SLO: <35.500MB -2.2%) vs baseline: +4.7%

✅ set_item

Time: ✅ 24.403µs (SLO: <30.000µs 📉 -18.7%) vs baseline: +1.4%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

⚠️

packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.964µs (SLO: <170.000µs -8.3%) vs baseline: +0.3%

Memory: ✅ 39.671MB (SLO: <41.000MB -3.2%) vs baseline: +4.8%

✅ import_many_cached

Time: ✅ 120.343µs (SLO: <130.000µs -7.4%) vs baseline: -0.4%

Memory: ✅ 39.682MB (SLO: <41.000MB -3.2%) vs baseline: +4.5%

✅ import_many_stdlib

Time: ✅ 0.755ms (SLO: <1.750ms 📉 -56.9%) vs baseline: -0.1%

Memory: ✅ 39.630MB (SLO: <41.000MB -3.3%) vs baseline: +4.5%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.172ms (SLO: <1.100ms 📉 -84.4%) vs baseline: -0.1%

Memory: ✅ 39.688MB (SLO: <41.000MB -3.2%) vs baseline: +5.1%

✅ import_many_unknown

Time: ✅ 839.979µs (SLO: <890.000µs -5.6%) vs baseline: +0.4%

Memory: ✅ 39.834MB (SLO: <41.000MB -2.8%) vs baseline: +4.9%

✅ import_many_unknown_cached

Time: ✅ 791.663µs (SLO: <870.000µs -9.0%) vs baseline: -0.9%

Memory: ✅ 39.751MB (SLO: <41.000MB -3.0%) vs baseline: +4.6%

✅ import_one

Time: ✅ 19.829µs (SLO: <30.000µs 📉 -33.9%) vs baseline: -0.2%

Memory: ✅ 39.489MB (SLO: <41.000MB -3.7%) vs baseline: +4.6%

✅ import_one_cache

Time: ✅ 6.287µs (SLO: <10.000µs 📉 -37.1%) vs baseline: -0.4%

Memory: ✅ 39.761MB (SLO: <41.000MB -3.0%) vs baseline: +4.6%

✅ import_one_stdlib

Time: ✅ 18.620µs (SLO: <20.000µs -6.9%) vs baseline: -0.6%

Memory: ✅ 39.779MB (SLO: <41.000MB -3.0%) vs baseline: +4.4%

✅ import_one_stdlib_cache

Time: ✅ 6.284µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.5%

Memory: ✅ 39.774MB (SLO: <41.000MB -3.0%) vs baseline: +5.2%

✅ import_one_unknown

Time: ✅ 45.413µs (SLO: <50.000µs -9.2%) vs baseline: -0.1%

Memory: ✅ 39.635MB (SLO: <41.000MB -3.3%) vs baseline: +4.8%

✅ import_one_unknown_cache

Time: ✅ 6.296µs (SLO: <10.000µs 📉 -37.0%) vs baseline: +0.7%

Memory: ✅ 39.781MB (SLO: <41.000MB -3.0%) vs baseline: +5.4%

✅ All Tests Passing (3 suites)

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.892µs (SLO: <40.000µs 📉 -15.3%) vs baseline: +5.9%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.6%

✅ re_expand_noaspect

Time: ✅ 28.773µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.8%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +0.8%

✅ re_findall_aspect

Time: ✅ 2.892µs (SLO: <10.000µs 📉 -71.1%) vs baseline: -0.2%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +0.4%

✅ re_findall_noaspect

Time: ✅ 1.421µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.4%

Memory: ✅ 38.319MB (SLO: <41.000MB -6.5%) vs baseline: +0.3%

✅ re_finditer_aspect

Time: ✅ 4.472µs (SLO: <10.000µs 📉 -55.3%) vs baseline: +0.1%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.8%

✅ re_finditer_noaspect

Time: ✅ 1.401µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +0.2%

Memory: ✅ 38.476MB (SLO: <41.000MB -6.2%) vs baseline: ~same

✅ re_fullmatch_aspect

Time: ✅ 2.671µs (SLO: <10.000µs 📉 -73.3%) vs baseline: ~same

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +0.5%

✅ re_fullmatch_noaspect

Time: ✅ 1.295µs (SLO: <10.000µs 📉 -87.1%) vs baseline: ~same

Memory: ✅ 38.437MB (SLO: <41.000MB -6.3%) vs baseline: +0.2%

✅ re_group_aspect

Time: ✅ 2.950µs (SLO: <10.000µs 📉 -70.5%) vs baseline: -0.6%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.6%

✅ re_group_noaspect

Time: ✅ 1.654µs (SLO: <10.000µs 📉 -83.5%) vs baseline: ~same

Memory: ✅ 38.398MB (SLO: <41.000MB -6.3%) vs baseline: ~same

✅ re_groups_aspect

Time: ✅ 3.119µs (SLO: <10.000µs 📉 -68.8%) vs baseline: -0.4%

Memory: ✅ 38.437MB (SLO: <41.000MB -6.3%) vs baseline: +0.3%

✅ re_groups_noaspect

Time: ✅ 1.701µs (SLO: <10.000µs 📉 -83.0%) vs baseline: +0.7%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +0.4%

✅ re_match_aspect

Time: ✅ 2.728µs (SLO: <10.000µs 📉 -72.7%) vs baseline: -0.4%

Memory: ✅ 38.437MB (SLO: <41.000MB -6.3%) vs baseline: +0.5%

✅ re_match_noaspect

Time: ✅ 1.308µs (SLO: <10.000µs 📉 -86.9%) vs baseline: ~same

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +0.4%

✅ re_search_aspect

Time: ✅ 2.537µs (SLO: <10.000µs 📉 -74.6%) vs baseline: -0.4%

Memory: ✅ 38.516MB (SLO: <41.000MB -6.1%) vs baseline: +0.4%

✅ re_search_noaspect

Time: ✅ 1.202µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.2%

Memory: ✅ 38.319MB (SLO: <41.000MB -6.5%) vs baseline: -0.3%

✅ re_sub_aspect

Time: ✅ 3.402µs (SLO: <10.000µs 📉 -66.0%) vs baseline: -0.9%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.6%

✅ re_sub_noaspect

Time: ✅ 1.533µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +1.0%

Memory: ✅ 38.476MB (SLO: <41.000MB -6.2%) vs baseline: +0.1%

✅ re_subn_aspect

Time: ✅ 3.656µs (SLO: <10.000µs 📉 -63.4%) vs baseline: ~same

Memory: ✅ 38.535MB (SLO: <41.000MB -6.0%) vs baseline: +0.3%

✅ re_subn_noaspect

Time: ✅ 1.615µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.2%

Memory: ✅ 38.417MB (SLO: <41.000MB -6.3%) vs baseline: +0.3%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.401µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -3.5%

Memory: ✅ 38.398MB (SLO: <41.000MB -6.3%) vs baseline: +0.2%

✅ rsplit_noaspect

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 38.516MB (SLO: <41.000MB -6.1%) vs baseline: +0.3%

✅ split_aspect

Time: ✅ 1.378µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -1.6%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +0.8%

✅ split_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.8%

Memory: ✅ 38.437MB (SLO: <41.000MB -6.3%) vs baseline: ~same

✅ splitlines_aspect

Time: ✅ 1.345µs (SLO: <10.000µs 📉 -86.6%) vs baseline: -5.3%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +0.6%

✅ splitlines_noaspect

Time: ✅ 0.587µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.5%

Memory: ✅ 38.457MB (SLO: <41.000MB -6.2%) vs baseline: +0.4%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.569ms (SLO: <42.000ms -3.4%) vs baseline: +0.3%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +5.3%

✅ add-link

Time: ✅ 36.353ms (SLO: <38.550ms -5.7%) vs baseline: +0.7%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 218.575ms (SLO: <232.000ms -5.8%) vs baseline: -0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 211.519ms (SLO: <221.600ms -4.5%) vs baseline: +0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.4%

✅ get-context

Time: ✅ 29.163ms (SLO: <31.300ms -6.8%) vs baseline: ~same

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 29.194ms (SLO: <31.000ms -5.8%) vs baseline: +0.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 63.013ms (SLO: <65.850ms -4.3%) vs baseline: +0.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ set-status

Time: ✅ 32.078ms (SLO: <34.150ms -6.1%) vs baseline: -0.3%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.7%

✅ start

Time: ✅ 29.282ms (SLO: <30.150ms -2.9%) vs baseline: +1.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 33.882ms (SLO: <35.350ms -4.2%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%

✅ start-finish-telemetry

Time: ✅ 33.868ms (SLO: <35.450ms -4.5%) vs baseline: -0.8%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%

✅ update-name

Time: ✅ 30.896ms (SLO: <33.400ms -7.5%) vs baseline: -0.5%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +5.3%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline
sethttpmeta-obfuscation-disabled

…tokens merging main branch

ddtrace/llmobs/_integrations/utils.py

ddtrace/llmobs/_integrations/openai.py

adding reasoning tokens metric

98af42c

XG-xin changed the title ~~llmobs: adding reasoning tokens metric~~ feat(llmobs): adding reasoning tokens metric Dec 2, 2025

fix oai agent test

4951688

XG-xin changed the title ~~feat(llmobs): adding reasoning tokens metric~~ feat(llmobs): adding reasoning tokens metric for openai integration Dec 2, 2025

XG-xin changed the title ~~feat(llmobs): adding reasoning tokens metric for openai integration~~ feat(llmobs): emitting reasoning tokens metric for openai integration Dec 2, 2025

XG-xin marked this pull request as ready for review December 2, 2025 16:01

XG-xin requested a review from a team as a code owner December 2, 2025 16:01

XG-xin added 2 commits December 2, 2025 14:27

rename the metric

70c8f43

Merge remote-tracking branch 'origin/main' into xinyuan/add-resoning-…

00629e7

…tokens merging main branch

Yun-Kim reviewed Dec 2, 2025

View reviewed changes

ddtrace/llmobs/_integrations/utils.py Outdated Show resolved Hide resolved

add reasoning tokens for openai agent

adca0f3

XG-xin commented Dec 5, 2025

View reviewed changes

ddtrace/llmobs/_integrations/openai.py Show resolved Hide resolved

Yun-Kim approved these changes Dec 9, 2025

View reviewed changes

add release note

63e4dd5

XG-xin requested a review from a team as a code owner December 9, 2025 18:19

XG-xin requested review from KowalskiThomas and avara1986 December 9, 2025 18:19

update release note

9051755

XG-xin merged commit ddb3870 into main Dec 9, 2025
478 checks passed

XG-xin deleted the xinyuan/add-resoning-tokens branch December 9, 2025 19:17

feat(llmobs): emitting reasoning tokens metric for openai integration #15478

feat(llmobs): emitting reasoning tokens metric for openai integration #15478

Uh oh!

Conversation

XG-xin commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ add_aspect

✅ add_inplace_aspect

✅ add_inplace_noaspect

✅ add_noaspect

✅ bytearray_aspect

✅ bytearray_extend_aspect

✅ bytearray_extend_noaspect

✅ bytearray_noaspect

✅ bytes_aspect

✅ bytes_noaspect

✅ bytesio_aspect

✅ bytesio_noaspect

✅ capitalize_aspect

✅ capitalize_noaspect

✅ casefold_aspect

✅ casefold_noaspect

✅ decode_aspect

✅ decode_noaspect

✅ encode_aspect

✅ encode_noaspect

✅ format_aspect

✅ format_map_aspect

✅ format_map_noaspect

✅ format_noaspect

✅ index_aspect

✅ index_noaspect

✅ join_aspect

✅ join_noaspect

✅ ljust_aspect

✅ ljust_noaspect

✅ lower_aspect

✅ lower_noaspect

✅ lstrip_aspect

✅ lstrip_noaspect

✅ modulo_aspect

✅ modulo_aspect_for_bytearray_bytearray

✅ modulo_aspect_for_bytes

✅ modulo_aspect_for_bytes_bytearray

✅ modulo_noaspect

✅ replace_aspect

✅ replace_noaspect

✅ repr_aspect

✅ repr_noaspect

✅ rstrip_aspect

✅ rstrip_noaspect

✅ slice_aspect

✅ slice_noaspect

✅ stringio_aspect

✅ stringio_noaspect

✅ strip_aspect

✅ strip_noaspect

✅ swapcase_aspect

✅ swapcase_noaspect

✅ title_aspect

✅ title_noaspect

✅ translate_aspect

✅ translate_noaspect

XG-xin commented Dec 1, 2025 •

edited

Loading

github-actions bot commented Dec 1, 2025 •

edited

Loading

github-actions bot commented Dec 1, 2025 •

edited

Loading

pr-commenter bot commented Dec 1, 2025 •

edited

Loading