feat(llmobs): add json metric type support for evaluations by aniszoubiramar · Pull Request #16344 · DataDog/dd-trace-py

aniszoubiramar · 2026-02-04T15:44:20Z

Description

Adds support for a new json metric type in LLMObs evaluation metrics. This allows users to submit dict values as evaluation metrics.

Changes:

LLMObs.submit_evaluation(): Now accepts metric_type="json" with dict values
Experiment evaluators: Auto-detect dict return values as json metric type
Telemetry: Updated to track json metric type
TypedDict: Added json_value field to LLMObsExperimentEvalMetricEvent

Testing

Added unit test for json metric type validation
Updated existing tests for new error messages
Tested E2E with staging: evals metrics and experiments

Risks

None - additive change, backward compatible

Additional Notes

MLOB-5400

## Description Adds support for a new `json` metric type in LLMObs evaluation metrics. This allows users to submit dictionary values as evaluation metrics. Changes: - `LLMObs.submit_evaluation()`: Now accepts `metric_type="json"` with dict values - Experiment evaluators: Auto-detect dict return values as `json` metric type - Telemetry: Updated to track `json` metric type - TypedDict: Added `json_value` field to `LLMObsExperimentEvalMetricEvent` ## Testing - Added unit test for json metric type validation - Updated existing tests for new error messages - Tested E2E with staging experiments ## Risks None - additive change, backward compatible ## Additional Notes MLOB-5400

pr-commenter · 2026-02-04T16:22:49Z

Performance SLOs

Comparing candidate anis.amar/MLOB-5400/support-json-output-in-the-sdk (1c9764b) with baseline main (ae08405)

📈 Performance Regressions (3 suites)

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 503.778µs (SLO: <700.000µs 📉 -28.0%) vs baseline: 📈 +19.7%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.7%

✅ ospathbasename_noaspect

Time: ✅ 430.470µs (SLO: <700.000µs 📉 -38.5%) vs baseline: +2.4%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.3%

✅ ospathjoin_aspect

Time: ✅ 629.581µs (SLO: <700.000µs 📉 -10.1%) vs baseline: +2.2%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +6.1%

✅ ospathjoin_noaspect

Time: ✅ 635.805µs (SLO: <700.000µs -9.2%) vs baseline: +3.0%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.4%

✅ ospathnormcase_aspect

Time: ✅ 350.954µs (SLO: <700.000µs 📉 -49.9%) vs baseline: +1.4%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.8%

✅ ospathnormcase_noaspect

Time: ✅ 363.976µs (SLO: <700.000µs 📉 -48.0%) vs baseline: +3.9%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.4%

✅ ospathsplit_aspect

Time: ✅ 497.713µs (SLO: <700.000µs 📉 -28.9%) vs baseline: +3.7%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.6%

✅ ospathsplit_noaspect

Time: ✅ 503.853µs (SLO: <700.000µs 📉 -28.0%) vs baseline: +3.4%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.6%

✅ ospathsplitdrive_aspect

Time: ✅ 379.258µs (SLO: <700.000µs 📉 -45.8%) vs baseline: +1.7%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.1%

✅ ospathsplitdrive_noaspect

Time: ✅ 73.178µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +0.2%

Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +5.8%

✅ ospathsplitext_aspect

Time: ✅ 461.901µs (SLO: <700.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.5%

✅ ospathsplitext_noaspect

Time: ✅ 471.216µs (SLO: <700.000µs 📉 -32.7%) vs baseline: +2.0%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.4%

📈 iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 162.195µs (SLO: <250.000µs 📉 -35.1%) vs baseline: 📈 +11.1%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.9%

✅ rsplit_noaspect

Time: ✅ 157.883µs (SLO: <250.000µs 📉 -36.8%) vs baseline: +3.4%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.6%

✅ split_aspect

Time: ✅ 147.189µs (SLO: <250.000µs 📉 -41.1%) vs baseline: +1.7%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +6.0%

✅ split_noaspect

Time: ✅ 155.348µs (SLO: <250.000µs 📉 -37.9%) vs baseline: +2.4%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.6%

✅ splitlines_aspect

Time: ✅ 144.195µs (SLO: <250.000µs 📉 -42.3%) vs baseline: -0.7%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +5.8%

✅ splitlines_noaspect

Time: ✅ 149.378µs (SLO: <250.000µs 📉 -40.2%) vs baseline: -2.2%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +5.3%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.419µs (SLO: <20.000µs 📉 -82.9%) vs baseline: 📈 +13.1%

Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +4.7%

✅ 1-count-metrics-100-times

Time: ✅ 210.021µs (SLO: <220.000µs -4.5%) vs baseline: +4.9%

Memory: ✅ 35.468MB (SLO: <38.000MB -6.7%) vs baseline: +4.6%

✅ 1-distribution-metric-1-times

Time: ✅ 3.291µs (SLO: <20.000µs 📉 -83.5%) vs baseline: -3.7%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +5.0%

✅ 1-distribution-metrics-100-times

Time: ✅ 216.844µs (SLO: <230.000µs -5.7%) vs baseline: +0.9%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +5.0%

✅ 1-gauge-metric-1-times

Time: ✅ 2.175µs (SLO: <20.000µs 📉 -89.1%) vs baseline: -0.7%

Memory: ✅ 35.507MB (SLO: <38.000MB -6.6%) vs baseline: +5.0%

✅ 1-gauge-metrics-100-times

Time: ✅ 136.264µs (SLO: <150.000µs -9.2%) vs baseline: -0.2%

Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +5.1%

✅ 1-rate-metric-1-times

Time: ✅ 3.089µs (SLO: <20.000µs 📉 -84.6%) vs baseline: -3.4%

Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +5.5%

✅ 1-rate-metrics-100-times

Time: ✅ 222.497µs (SLO: <250.000µs 📉 -11.0%) vs baseline: +3.8%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.5%

✅ 100-count-metrics-100-times

Time: ✅ 20.535ms (SLO: <22.000ms -6.7%) vs baseline: +1.3%

Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +4.9%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.229ms (SLO: <2.550ms 📉 -12.6%) vs baseline: -0.9%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.1%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.404ms (SLO: <1.550ms -9.4%) vs baseline: -0.7%

Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +4.9%

✅ 100-rate-metrics-100-times

Time: ✅ 2.239ms (SLO: <2.550ms 📉 -12.2%) vs baseline: +2.2%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +5.0%

✅ flush-1-metric

Time: ✅ 4.486µs (SLO: <20.000µs 📉 -77.6%) vs baseline: -3.5%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 174.080µs (SLO: <250.000µs 📉 -30.4%) vs baseline: +0.3%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +4.5%

✅ flush-1000-metrics

Time: ✅ 2.195ms (SLO: <2.500ms 📉 -12.2%) vs baseline: +0.1%

Memory: ✅ 36.333MB (SLO: <38.750MB -6.2%) vs baseline: +4.5%

🟡 Near SLO Breach (1 suite)

🟡 tracer - 6/6

✅ large

Time: ✅ 31.560ms (SLO: <32.950ms -4.2%) vs baseline: -0.4%

Memory: ✅ 36.825MB (SLO: <39.250MB -6.2%) vs baseline: +5.9%

✅ medium

Time: ✅ 3.145ms (SLO: <3.200ms 🟡 -1.7%) vs baseline: +0.6%

Memory: ✅ 35.212MB (SLO: <38.750MB -9.1%) vs baseline: +4.7%

✅ small

Time: ✅ 365.285µs (SLO: <370.000µs 🟡 -1.3%) vs baseline: +4.0%

Memory: ✅ 35.173MB (SLO: <38.750MB -9.2%) vs baseline: +4.4%

⚠️ Unstable Tests (2 suites)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.263µs (SLO: <20.000µs 📉 -33.7%) vs baseline: -0.1%

Memory: ✅ 35.114MB (SLO: <38.000MB -7.6%) vs baseline: +4.3%

✅ context_with_data_no_listeners

Time: ✅ 3.306µs (SLO: <10.000µs 📉 -66.9%) vs baseline: -0.5%

Memory: ✅ 35.212MB (SLO: <38.000MB -7.3%) vs baseline: +4.8%

✅ get_item_exists

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.5%

Memory: ✅ 35.134MB (SLO: <38.000MB -7.5%) vs baseline: +4.6%

✅ get_item_missing

Time: ✅ 0.634µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.2%

Memory: ✅ 35.114MB (SLO: <38.000MB -7.6%) vs baseline: +4.6%

✅ set_item

Time: ✅ 24.000µs (SLO: <30.000µs 📉 -20.0%) vs baseline: -2.1%

Memory: ✅ 35.114MB (SLO: <38.000MB -7.6%) vs baseline: +4.3%

⚠️

packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.205µs (SLO: <170.000µs -8.7%) vs baseline: -0.9%

Memory: ✅ 39.865MB (SLO: <46.000MB 📉 -13.3%) vs baseline: +4.9%

✅ import_many_cached

Time: ✅ 121.175µs (SLO: <130.000µs -6.8%) vs baseline: +0.4%

Memory: ✅ 39.796MB (SLO: <46.000MB 📉 -13.5%) vs baseline: +5.2%

✅ import_many_stdlib

Time: ✅ 0.763ms (SLO: <1.750ms 📉 -56.4%) vs baseline: -0.3%

Memory: ✅ 39.802MB (SLO: <46.000MB 📉 -13.5%) vs baseline: +5.6%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.174ms (SLO: <1.100ms 📉 -84.2%) vs baseline: -0.5%

Memory: ✅ 39.572MB (SLO: <46.000MB 📉 -14.0%) vs baseline: +4.2%

✅ import_many_unknown

Time: ✅ 830.538µs (SLO: <890.000µs -6.7%) vs baseline: -1.4%

Memory: ✅ 39.975MB (SLO: <46.000MB 📉 -13.1%) vs baseline: +5.1%

✅ import_many_unknown_cached

Time: ✅ 796.299µs (SLO: <870.000µs -8.5%) vs baseline: +1.0%

Memory: ✅ 39.900MB (SLO: <46.000MB 📉 -13.3%) vs baseline: +4.7%

✅ import_one

Time: ✅ 19.852µs (SLO: <30.000µs 📉 -33.8%) vs baseline: ~same

Memory: ✅ 39.847MB (SLO: <46.000MB 📉 -13.4%) vs baseline: +5.2%

✅ import_one_cache

Time: ✅ 6.278µs (SLO: <10.000µs 📉 -37.2%) vs baseline: -0.2%

Memory: ✅ 39.848MB (SLO: <46.000MB 📉 -13.4%) vs baseline: +5.8%

✅ import_one_stdlib

Time: ✅ 18.698µs (SLO: <20.000µs -6.5%) vs baseline: -0.2%

Memory: ✅ 39.801MB (SLO: <46.000MB 📉 -13.5%) vs baseline: +5.4%

✅ import_one_stdlib_cache

Time: ✅ 6.287µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.3%

Memory: ✅ 39.954MB (SLO: <46.000MB 📉 -13.1%) vs baseline: +5.6%

✅ import_one_unknown

Time: ✅ 45.621µs (SLO: <50.000µs -8.8%) vs baseline: +0.4%

Memory: ✅ 39.777MB (SLO: <46.000MB 📉 -13.5%) vs baseline: +5.1%

✅ import_one_unknown_cache

Time: ✅ 6.262µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -1.2%

Memory: ✅ 39.950MB (SLO: <43.000MB -7.1%) vs baseline: +5.3%

✅ All Tests Passing (18 suites)

✅ djangosimple - 30/30

✅ appsec

Time: ✅ 19.530ms (SLO: <22.300ms 📉 -12.4%) vs baseline: -0.6%

Memory: ✅ 68.792MB (SLO: <73.500MB -6.4%) vs baseline: +5.1%

✅ exception-replay-enabled

Time: ✅ 1.387ms (SLO: <1.450ms -4.4%) vs baseline: -0.4%

Memory: ✅ 66.928MB (SLO: <71.500MB -6.4%) vs baseline: +4.8%

✅ iast

Time: ✅ 19.672ms (SLO: <22.250ms 📉 -11.6%) vs baseline: +0.2%

Memory: ✅ 68.947MB (SLO: <75.000MB -8.1%) vs baseline: +5.2%

✅ profiler

Time: ✅ 15.312ms (SLO: <16.550ms -7.5%) vs baseline: -0.3%

Memory: ✅ 56.978MB (SLO: <61.000MB -6.6%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 19.546ms (SLO: <21.750ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 68.845MB (SLO: <73.500MB -6.3%) vs baseline: +5.0%

✅ span-code-origin

Time: ✅ 19.984ms (SLO: <28.200ms 📉 -29.1%) vs baseline: +1.2%

Memory: ✅ 68.787MB (SLO: <75.000MB -8.3%) vs baseline: +4.9%

✅ tracer

Time: ✅ 19.595ms (SLO: <21.750ms -9.9%) vs baseline: -0.2%

Memory: ✅ 68.813MB (SLO: <75.000MB -8.2%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 21.586ms (SLO: <23.500ms -8.1%) vs baseline: -0.3%

Memory: ✅ 70.169MB (SLO: <75.000MB -6.4%) vs baseline: +4.7%

✅ tracer-dont-create-db-spans

Time: ✅ 19.621ms (SLO: <21.500ms -8.7%) vs baseline: -0.2%

Memory: ✅ 68.864MB (SLO: <75.000MB -8.2%) vs baseline: +5.1%

✅ tracer-minimal

Time: ✅ 16.834ms (SLO: <17.500ms -3.8%) vs baseline: +0.3%

Memory: ✅ 68.804MB (SLO: <75.000MB -8.3%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 19.538ms (SLO: <21.750ms 📉 -10.2%) vs baseline: -0.2%

Memory: ✅ 68.812MB (SLO: <72.500MB -5.1%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 17.644ms (SLO: <19.650ms 📉 -10.2%) vs baseline: +0.3%

Memory: ✅ 68.793MB (SLO: <75.000MB -8.3%) vs baseline: +4.9%

✅ tracer-no-databases

Time: ✅ 19.216ms (SLO: <20.100ms -4.4%) vs baseline: +0.4%

Memory: ✅ 68.792MB (SLO: <75.000MB -8.3%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 19.309ms (SLO: <21.500ms 📉 -10.2%) vs baseline: -0.2%

Memory: ✅ 68.813MB (SLO: <75.000MB -8.2%) vs baseline: +5.1%

✅ tracer-no-templates

Time: ✅ 19.742ms (SLO: <22.000ms 📉 -10.3%) vs baseline: +1.9%

Memory: ✅ 68.791MB (SLO: <73.500MB -6.4%) vs baseline: +5.1%

✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.260ms (SLO: <19.850ms 📉 -18.1%) vs baseline: -0.3%

Memory: ✅ 70.855MB (SLO: <75.000MB -5.5%) vs baseline: +5.1%

✅ errortracking-enabled-user

Time: ✅ 16.302ms (SLO: <19.400ms 📉 -16.0%) vs baseline: -0.4%

Memory: ✅ 70.719MB (SLO: <75.000MB -5.7%) vs baseline: +5.2%

✅ tracer-enabled

Time: ✅ 16.321ms (SLO: <19.450ms 📉 -16.1%) vs baseline: -0.1%

Memory: ✅ 70.501MB (SLO: <75.000MB -6.0%) vs baseline: +5.3%

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.102ms (SLO: <2.300ms -8.6%) vs baseline: +0.3%

Memory: ✅ 56.151MB (SLO: <60.000MB -6.4%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 2.097ms (SLO: <2.250ms -6.8%) vs baseline: -0.2%

Memory: ✅ 56.269MB (SLO: <60.000MB -6.2%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.089ms (SLO: <2.300ms -9.2%) vs baseline: ~same

Memory: ✅ 56.171MB (SLO: <60.000MB -6.4%) vs baseline: +4.7%

✅ flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.420ms (SLO: <4.750ms 📉 -28.0%) vs baseline: +0.1%

Memory: ✅ 56.202MB (SLO: <66.500MB 📉 -15.5%) vs baseline: +5.1%

✅ appsec-post

Time: ✅ 2.887ms (SLO: <6.750ms 📉 -57.2%) vs baseline: +0.3%

Memory: ✅ 56.453MB (SLO: <66.500MB 📉 -15.1%) vs baseline: +5.5%

✅ appsec-telemetry

Time: ✅ 3.441ms (SLO: <4.750ms 📉 -27.6%) vs baseline: +1.3%

Memory: ✅ 56.188MB (SLO: <66.500MB 📉 -15.5%) vs baseline: +5.1%

✅ debugger

Time: ✅ 1.865ms (SLO: <2.000ms -6.7%) vs baseline: -0.2%

Memory: ✅ 48.350MB (SLO: <51.500MB -6.1%) vs baseline: +5.3%

✅ iast-get

Time: ✅ 1.864ms (SLO: <2.000ms -6.8%) vs baseline: ~same

Memory: ✅ 45.171MB (SLO: <49.000MB -7.8%) vs baseline: +5.1%

✅ profiler

Time: ✅ 1.902ms (SLO: <2.100ms -9.5%) vs baseline: ~same

Memory: ✅ 49.650MB (SLO: <52.500MB -5.4%) vs baseline: +5.4%

✅ resource-renaming

Time: ✅ 3.381ms (SLO: <3.650ms -7.4%) vs baseline: +0.2%

Memory: ✅ 56.082MB (SLO: <60.000MB -6.5%) vs baseline: +4.8%

✅ tracer

Time: ✅ 3.396ms (SLO: <3.650ms -7.0%) vs baseline: ~same

Memory: ✅ 56.286MB (SLO: <60.000MB -6.2%) vs baseline: +5.1%

✅ tracer-native

Time: ✅ 3.392ms (SLO: <3.650ms -7.1%) vs baseline: -0.2%

Memory: ✅ 56.157MB (SLO: <60.000MB -6.4%) vs baseline: +5.0%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.090ms (SLO: <4.200ms 📉 -50.2%) vs baseline: -0.1%

Memory: ✅ 56.230MB (SLO: <66.000MB 📉 -14.8%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.088ms (SLO: <2.800ms 📉 -25.4%) vs baseline: -0.3%

Memory: ✅ 56.230MB (SLO: <62.500MB 📉 -10.0%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.082ms (SLO: <2.250ms -7.5%) vs baseline: ~same

Memory: ✅ 56.309MB (SLO: <60.000MB -6.2%) vs baseline: +5.0%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.232µs (SLO: <100.000µs 📉 -19.8%) vs baseline: -0.3%

Memory: ✅ 35.743MB (SLO: <38.000MB -5.9%) vs baseline: +5.4%

✅ b3_headers

Time: ✅ 14.085µs (SLO: <20.000µs 📉 -29.6%) vs baseline: -0.2%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.9%

✅ b3_single_headers

Time: ✅ 13.164µs (SLO: <20.000µs 📉 -34.2%) vs baseline: -0.1%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.9%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.124µs (SLO: <80.000µs 📉 -19.8%) vs baseline: ~same

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.4%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.274µs (SLO: <80.000µs 📉 -13.4%) vs baseline: +5.0%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.4%

✅ empty_headers

Time: ✅ 1.630µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +2.4%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +6.0%

✅ full_t_id_datadog_headers

Time: ✅ 22.474µs (SLO: <30.000µs 📉 -25.1%) vs baseline: +1.1%

Memory: ✅ 35.763MB (SLO: <38.000MB -5.9%) vs baseline: +6.3%

✅ invalid_priority_header

Time: ✅ 6.529µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.2%

Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +6.1%

✅ invalid_span_id_header

Time: ✅ 6.518µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.7%

Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +6.3%

✅ invalid_tags_header

Time: ✅ 6.508µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.6%

Memory: ✅ 35.743MB (SLO: <38.000MB -5.9%) vs baseline: +6.3%

✅ invalid_trace_id_header

Time: ✅ 6.493µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -0.6%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +5.9%

✅ large_header_no_matches

Time: ✅ 27.694µs (SLO: <30.000µs -7.7%) vs baseline: +0.5%

Memory: ✅ 35.743MB (SLO: <38.000MB -5.9%) vs baseline: +6.6%

✅ large_valid_headers_all

Time: ✅ 28.733µs (SLO: <40.000µs 📉 -28.2%) vs baseline: +0.4%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.8%

✅ medium_header_no_matches

Time: ✅ 9.959µs (SLO: <20.000µs 📉 -50.2%) vs baseline: -0.2%

Memory: ✅ 35.743MB (SLO: <38.000MB -5.9%) vs baseline: +6.4%

✅ medium_valid_headers_all

Time: ✅ 11.520µs (SLO: <20.000µs 📉 -42.4%) vs baseline: +1.0%

Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +6.3%

✅ none_propagation_style

Time: ✅ 1.712µs (SLO: <10.000µs 📉 -82.9%) vs baseline: +1.3%

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +6.2%

✅ tracecontext_headers

Time: ✅ 34.629µs (SLO: <40.000µs 📉 -13.4%) vs baseline: +0.7%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +5.7%

✅ valid_headers_all

Time: ✅ 6.532µs (SLO: <10.000µs 📉 -34.7%) vs baseline: +0.4%

Memory: ✅ 35.783MB (SLO: <38.000MB -5.8%) vs baseline: +6.6%

✅ valid_headers_basic

Time: ✅ 6.131µs (SLO: <10.000µs 📉 -38.7%) vs baseline: +0.7%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +5.9%

✅ wsgi_empty_headers

Time: ✅ 1.610µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.7%

Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +6.1%

✅ wsgi_invalid_priority_header

Time: ✅ 6.590µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.4%

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +6.3%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.603µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.2%

Memory: ✅ 35.684MB (SLO: <38.000MB -6.1%) vs baseline: +6.3%

✅ wsgi_invalid_tags_header

Time: ✅ 6.570µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.2%

Memory: ✅ 35.665MB (SLO: <38.000MB -6.1%) vs baseline: +6.1%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.545µs (SLO: <10.000µs 📉 -34.6%) vs baseline: ~same

Memory: ✅ 35.743MB (SLO: <38.000MB -5.9%) vs baseline: +5.9%

✅ wsgi_large_header_no_matches

Time: ✅ 28.738µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.1%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.747µs (SLO: <40.000µs 📉 -25.6%) vs baseline: -0.5%

Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +5.2%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.122µs (SLO: <20.000µs 📉 -49.4%) vs baseline: +0.3%

Memory: ✅ 35.724MB (SLO: <38.000MB -6.0%) vs baseline: +6.0%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.652µs (SLO: <20.000µs 📉 -41.7%) vs baseline: +1.1%

Memory: ✅ 35.743MB (SLO: <38.000MB -5.9%) vs baseline: +6.1%

✅ wsgi_valid_headers_all

Time: ✅ 6.573µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.3%

Memory: ✅ 35.704MB (SLO: <38.000MB -6.0%) vs baseline: +6.3%

✅ wsgi_valid_headers_basic

Time: ✅ 6.115µs (SLO: <10.000µs 📉 -38.8%) vs baseline: +0.5%

Memory: ✅ 35.783MB (SLO: <38.000MB -5.8%) vs baseline: +6.1%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.869µs (SLO: <30.000µs 📉 -27.1%) vs baseline: +4.9%

Memory: ✅ 35.429MB (SLO: <38.000MB -6.8%) vs baseline: +5.3%

✅ with_all

Time: ✅ 27.838µs (SLO: <40.000µs 📉 -30.4%) vs baseline: +0.8%

Memory: ✅ 35.488MB (SLO: <38.000MB -6.6%) vs baseline: +5.5%

✅ with_dd_origin

Time: ✅ 24.583µs (SLO: <30.000µs 📉 -18.1%) vs baseline: +0.2%

Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +5.7%

✅ with_priority_and_origin

Time: ✅ 23.976µs (SLO: <40.000µs 📉 -40.1%) vs baseline: +0.3%

Memory: ✅ 35.429MB (SLO: <38.000MB -6.8%) vs baseline: +5.2%

✅ with_sampling_priority

Time: ✅ 20.827µs (SLO: <30.000µs 📉 -30.6%) vs baseline: -0.2%

Memory: ✅ 35.330MB (SLO: <38.000MB -7.0%) vs baseline: +5.1%

✅ with_tags

Time: ✅ 25.839µs (SLO: <40.000µs 📉 -35.4%) vs baseline: +0.3%

Memory: ✅ 35.547MB (SLO: <38.000MB -6.5%) vs baseline: +5.8%

✅ with_tags_invalid

Time: ✅ 27.427µs (SLO: <40.000µs 📉 -31.4%) vs baseline: +0.9%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +6.2%

✅ with_tags_max_size

Time: ✅ 26.224µs (SLO: <40.000µs 📉 -34.4%) vs baseline: -0.1%

Memory: ✅ 35.625MB (SLO: <38.000MB -6.2%) vs baseline: +5.9%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 3.721ms (SLO: <4.880ms 📉 -23.8%) vs baseline: +6.9%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.8%

✅ re_expand_noaspect

Time: ✅ 3.451ms (SLO: <4.620ms 📉 -25.3%) vs baseline: -0.5%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.8%

✅ re_findall_aspect

Time: ✅ 340.020µs (SLO: <450.000µs 📉 -24.4%) vs baseline: +1.0%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.7%

✅ re_findall_noaspect

Time: ✅ 322.947µs (SLO: <430.000µs 📉 -24.9%) vs baseline: -0.8%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.4%

✅ re_finditer_aspect

Time: ✅ 446.671µs (SLO: <590.000µs 📉 -24.3%) vs baseline: -1.9%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.6%

✅ re_finditer_noaspect

Time: ✅ 327.033µs (SLO: <440.000µs 📉 -25.7%) vs baseline: +1.5%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.7%

✅ re_fullmatch_aspect

Time: ✅ 274.811µs (SLO: <360.000µs 📉 -23.7%) vs baseline: -1.5%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.7%

✅ re_fullmatch_noaspect

Time: ✅ 301.541µs (SLO: <400.000µs 📉 -24.6%) vs baseline: -1.9%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.5%

✅ re_group_aspect

Time: ✅ 477.267µs (SLO: <630.000µs 📉 -24.2%) vs baseline: -1.2%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.5%

✅ re_group_noaspect

Time: ✅ 480.150µs (SLO: <640.000µs 📉 -25.0%) vs baseline: -2.0%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.4%

✅ re_groups_aspect

Time: ✅ 486.884µs (SLO: <650.000µs 📉 -25.1%) vs baseline: -1.3%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.6%

✅ re_groups_noaspect

Time: ✅ 490.079µs (SLO: <650.000µs 📉 -24.6%) vs baseline: -2.1%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.7%

✅ re_match_aspect

Time: ✅ 278.686µs (SLO: <370.000µs 📉 -24.7%) vs baseline: -1.9%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.5%

✅ re_match_noaspect

Time: ✅ 302.329µs (SLO: <410.000µs 📉 -26.3%) vs baseline: -2.8%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.8%

✅ re_search_aspect

Time: ✅ 265.363µs (SLO: <350.000µs 📉 -24.2%) vs baseline: +1.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +5.5%

✅ re_search_noaspect

Time: ✅ 284.449µs (SLO: <380.000µs 📉 -25.1%) vs baseline: -1.9%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.7%

✅ re_sub_aspect

Time: ✅ 351.732µs (SLO: <460.000µs 📉 -23.5%) vs baseline: -0.9%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.1%

✅ re_sub_noaspect

Time: ✅ 395.788µs (SLO: <520.000µs 📉 -23.9%) vs baseline: +1.1%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.8%

✅ re_subn_aspect

Time: ✅ 377.850µs (SLO: <490.000µs 📉 -22.9%) vs baseline: +0.7%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.2%

✅ re_subn_noaspect

Time: ✅ 410.433µs (SLO: <530.000µs 📉 -22.6%) vs baseline: +1.2%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.6%

✅ iastaspects - 116/116

✅ add_aspect

Time: ✅ 110.453µs (SLO: <130.000µs 📉 -15.0%) vs baseline: +8.9%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +4.7%

✅ add_inplace_aspect

Time: ✅ 107.018µs (SLO: <130.000µs 📉 -17.7%) vs baseline: +5.3%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.6%

✅ add_inplace_noaspect

Time: ✅ 28.290µs (SLO: <40.000µs 📉 -29.3%) vs baseline: +0.2%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ add_noaspect

Time: ✅ 49.028µs (SLO: <70.000µs 📉 -30.0%) vs baseline: -0.4%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9%

✅ bytearray_aspect

Time: ✅ 252.501µs (SLO: <400.000µs 📉 -36.9%) vs baseline: +1.0%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ bytearray_extend_aspect

Time: ✅ 645.496µs (SLO: <800.000µs 📉 -19.3%) vs baseline: ~same

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ bytearray_extend_noaspect

Time: ✅ 268.537µs (SLO: <400.000µs 📉 -32.9%) vs baseline: +1.2%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ bytearray_noaspect

Time: ✅ 139.840µs (SLO: <300.000µs 📉 -53.4%) vs baseline: +1.4%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.9%

✅ bytes_aspect

Time: ✅ 217.107µs (SLO: <300.000µs 📉 -27.6%) vs baseline: -2.1%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ bytes_noaspect

Time: ✅ 134.255µs (SLO: <200.000µs 📉 -32.9%) vs baseline: -0.6%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ bytesio_aspect

Time: ✅ 3.925ms (SLO: <5.000ms 📉 -21.5%) vs baseline: +2.2%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0%

✅ bytesio_noaspect

Time: ✅ 316.376µs (SLO: <420.000µs 📉 -24.7%) vs baseline: -0.8%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7%

✅ capitalize_aspect

Time: ✅ 88.693µs (SLO: <300.000µs 📉 -70.4%) vs baseline: ~same

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.1%

✅ capitalize_noaspect

Time: ✅ 253.659µs (SLO: <300.000µs 📉 -15.4%) vs baseline: +4.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

✅ casefold_aspect

Time: ✅ 91.729µs (SLO: <500.000µs 📉 -81.7%) vs baseline: +3.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

✅ casefold_noaspect

Time: ✅ 312.874µs (SLO: <500.000µs 📉 -37.4%) vs baseline: +2.8%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.7%

✅ decode_aspect

Time: ✅ 87.691µs (SLO: <100.000µs 📉 -12.3%) vs baseline: -0.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

✅ decode_noaspect

Time: ✅ 152.865µs (SLO: <210.000µs 📉 -27.2%) vs baseline: -0.8%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ encode_aspect

Time: ✅ 85.771µs (SLO: <200.000µs 📉 -57.1%) vs baseline: ~same

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ encode_noaspect

Time: ✅ 138.564µs (SLO: <200.000µs 📉 -30.7%) vs baseline: -2.5%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 14.689ms (SLO: <19.200ms 📉 -23.5%) vs baseline: ~same

Memory: ✅ 43.155MB (SLO: <46.000MB -6.2%) vs baseline: +4.7%

✅ format_map_aspect

Time: ✅ 16.493ms (SLO: <21.500ms 📉 -23.3%) vs baseline: +0.3%

Memory: ✅ 43.116MB (SLO: <46.000MB -6.3%) vs baseline: +4.9%

✅ format_map_noaspect

Time: ✅ 370.618µs (SLO: <500.000µs 📉 -25.9%) vs baseline: -0.5%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.6%

✅ format_noaspect

Time: ✅ 311.581µs (SLO: <500.000µs 📉 -37.7%) vs baseline: +2.1%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +4.8%

✅ index_aspect

Time: ✅ 125.522µs (SLO: <300.000µs 📉 -58.2%) vs baseline: +2.7%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.1%

✅ index_noaspect

Time: ✅ 40.230µs (SLO: <300.000µs 📉 -86.6%) vs baseline: ~same

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +5.1%

✅ join_aspect

Time: ✅ 215.529µs (SLO: <300.000µs 📉 -28.2%) vs baseline: +0.4%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.1%

✅ join_noaspect

Time: ✅ 141.111µs (SLO: <300.000µs 📉 -53.0%) vs baseline: -2.0%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ ljust_aspect

Time: ✅ 506.386µs (SLO: <700.000µs 📉 -27.7%) vs baseline: ~same

Memory: ✅ 43.057MB (SLO: <46.000MB -6.4%) vs baseline: +5.1%

✅ ljust_noaspect

Time: ✅ 264.868µs (SLO: <300.000µs 📉 -11.7%) vs baseline: +3.3%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.6%

✅ lower_aspect

Time: ✅ 298.827µs (SLO: <500.000µs 📉 -40.2%) vs baseline: +2.7%

Memory: ✅ 43.096MB (SLO: <46.000MB -6.3%) vs baseline: +5.4%

✅ lower_noaspect

Time: ✅ 237.245µs (SLO: <300.000µs 📉 -20.9%) vs baseline: +4.9%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

✅ lstrip_aspect

Time: ✅ 0.272ms (SLO: <3.000ms 📉 -90.9%) vs baseline: -0.6%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +5.0%

✅ lstrip_noaspect

Time: ✅ 0.178ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.2%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ modulo_aspect

Time: ✅ 14.297ms (SLO: <18.750ms 📉 -23.7%) vs baseline: -0.3%

Memory: ✅ 43.096MB (SLO: <46.000MB -6.3%) vs baseline: +5.0%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.881ms (SLO: <19.350ms 📉 -23.1%) vs baseline: ~same

Memory: ✅ 43.136MB (SLO: <46.000MB -6.2%) vs baseline: +5.1%

✅ modulo_aspect_for_bytes

Time: ✅ 14.483ms (SLO: <18.900ms 📉 -23.4%) vs baseline: +0.3%

Memory: ✅ 43.175MB (SLO: <46.000MB -6.1%) vs baseline: +5.1%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.697ms (SLO: <19.150ms 📉 -23.3%) vs baseline: ~same

Memory: ✅ 43.116MB (SLO: <46.000MB -6.3%) vs baseline: +5.0%

✅ modulo_noaspect

Time: ✅ 0.381ms (SLO: <3.000ms 📉 -87.3%) vs baseline: +6.9%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.5%

✅ replace_aspect

Time: ✅ 18.476ms (SLO: <24.000ms 📉 -23.0%) vs baseline: +0.6%

Memory: ✅ 43.116MB (SLO: <46.000MB -6.3%) vs baseline: +4.7%

✅ replace_noaspect

Time: ✅ 281.091µs (SLO: <300.000µs -6.3%) vs baseline: +0.1%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 309.747µs (SLO: <420.000µs 📉 -26.3%) vs baseline: -2.7%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ repr_noaspect

Time: ✅ 46.821µs (SLO: <90.000µs 📉 -48.0%) vs baseline: -0.1%

Memory: ✅ 42.959MB (SLO: <46.000MB -6.6%) vs baseline: +4.9%

✅ rstrip_aspect

Time: ✅ 392.600µs (SLO: <500.000µs 📉 -21.5%) vs baseline: +0.7%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ rstrip_noaspect

Time: ✅ 188.617µs (SLO: <300.000µs 📉 -37.1%) vs baseline: +2.8%

✅ slice_aspect

Time: ✅ 186.067µs (SLO: <300.000µs 📉 -38.0%) vs baseline: +1.9%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ slice_noaspect

Time: ✅ 54.510µs (SLO: <90.000µs 📉 -39.4%) vs baseline: ~same

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.9%

✅ stringio_aspect

Time: ✅ 3.949ms (SLO: <5.000ms 📉 -21.0%) vs baseline: +1.8%

Memory: ✅ 42.900MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ stringio_noaspect

Time: ✅ 346.355µs (SLO: <500.000µs 📉 -30.7%) vs baseline: -1.4%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.7%

✅ strip_aspect

Time: ✅ 267.985µs (SLO: <350.000µs 📉 -23.4%) vs baseline: -2.6%

Memory: ✅ 42.979MB (SLO: <46.000MB -6.6%) vs baseline: +5.1%

✅ strip_noaspect

Time: ✅ 177.110µs (SLO: <240.000µs 📉 -26.2%) vs baseline: -0.3%

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +5.0%

✅ swapcase_aspect

Time: ✅ 340.687µs (SLO: <500.000µs 📉 -31.9%) vs baseline: +4.1%

✅ swapcase_noaspect

Time: ✅ 273.083µs (SLO: <400.000µs 📉 -31.7%) vs baseline: +3.3%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +4.9%

✅ title_aspect

Time: ✅ 329.814µs (SLO: <500.000µs 📉 -34.0%) vs baseline: +4.0%

Memory: ✅ 42.998MB (SLO: <46.000MB -6.5%) vs baseline: +5.1%

✅ title_noaspect

Time: ✅ 265.298µs (SLO: <400.000µs 📉 -33.7%) vs baseline: +5.0%

Memory: ✅ 42.880MB (SLO: <46.000MB -6.8%) vs baseline: +4.8%

✅ translate_aspect

Time: ✅ 493.736µs (SLO: <700.000µs 📉 -29.5%) vs baseline: +1.9%

Memory: ✅ 43.037MB (SLO: <46.000MB -6.4%) vs baseline: +5.0%

✅ translate_noaspect

Time: ✅ 425.004µs (SLO: <500.000µs 📉 -15.0%) vs baseline: ~same

Memory: ✅ 42.939MB (SLO: <46.000MB -6.7%) vs baseline: +4.8%

✅ upper_aspect

Time: ✅ 301.997µs (SLO: <500.000µs 📉 -39.6%) vs baseline: +4.3%

Memory: ✅ 43.018MB (SLO: <46.000MB -6.5%) vs baseline: +5.0%

✅ upper_noaspect

Time: ✅ 236.301µs (SLO: <400.000µs 📉 -40.9%) vs baseline: +3.9%

Memory: ✅ 42.920MB (SLO: <46.000MB -6.7%) vs baseline: +4.7%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.246µs (SLO: <60.000µs 📉 -19.6%) vs baseline: ~same

Memory: ✅ 38.987MB (SLO: <42.000MB -7.2%) vs baseline: +4.7%

✅ propagation_enabled

Time: ✅ 135.085µs (SLO: <190.000µs 📉 -28.9%) vs baseline: +0.1%

Memory: ✅ 39.046MB (SLO: <42.000MB -7.0%) vs baseline: +4.9%

✅ propagation_enabled_100

Time: ✅ 1.544ms (SLO: <2.300ms 📉 -32.9%) vs baseline: -1.9%

Memory: ✅ 38.948MB (SLO: <42.000MB -7.3%) vs baseline: +4.6%

✅ propagation_enabled_1000

Time: ✅ 29.000ms (SLO: <34.550ms 📉 -16.1%) vs baseline: -0.9%

Memory: ✅ 39.007MB (SLO: <42.000MB -7.1%) vs baseline: +5.0%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.507ms (SLO: <42.000ms -3.6%) vs baseline: +0.8%

Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +4.9%

✅ add-link

Time: ✅ 36.330ms (SLO: <38.550ms -5.8%) vs baseline: +0.5%

Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +5.0%

✅ add-metrics

Time: ✅ 219.551ms (SLO: <232.000ms -5.4%) vs baseline: +0.3%

Memory: ✅ 38.083MB (SLO: <40.750MB -6.5%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 212.746ms (SLO: <221.600ms -4.0%) vs baseline: +0.6%

Memory: ✅ 38.142MB (SLO: <40.750MB -6.4%) vs baseline: +5.1%

✅ get-context

Time: ✅ 29.052ms (SLO: <31.300ms -7.2%) vs baseline: +0.6%

Memory: ✅ 38.181MB (SLO: <40.750MB -6.3%) vs baseline: +5.1%

✅ is-recording

Time: ✅ 29.184ms (SLO: <31.000ms -5.9%) vs baseline: +1.0%

Memory: ✅ 38.044MB (SLO: <40.750MB -6.6%) vs baseline: +4.6%

✅ record-exception

Time: ✅ 63.523ms (SLO: <65.850ms -3.5%) vs baseline: +0.6%

Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +5.0%

✅ set-status

Time: ✅ 31.763ms (SLO: <34.150ms -7.0%) vs baseline: -0.4%

Memory: ✅ 38.044MB (SLO: <40.750MB -6.6%) vs baseline: +4.7%

✅ start

Time: ✅ 29.254ms (SLO: <30.150ms -3.0%) vs baseline: +1.6%

Memory: ✅ 38.063MB (SLO: <40.750MB -6.6%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 34.077ms (SLO: <35.350ms -3.6%) vs baseline: +1.1%

Memory: ✅ 38.122MB (SLO: <40.750MB -6.4%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 34.122ms (SLO: <35.450ms -3.7%) vs baseline: +0.7%

Memory: ✅ 38.024MB (SLO: <40.750MB -6.7%) vs baseline: +4.7%

✅ update-name

Time: ✅ 31.085ms (SLO: <33.400ms -6.9%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <40.750MB -6.5%) vs baseline: +5.0%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 43.501ms (SLO: <47.150ms -7.7%) vs baseline: +0.3%

Memory: ✅ 40.399MB (SLO: <47.000MB 📉 -14.0%) vs baseline: +5.2%

✅ add-metrics

Time: ✅ 258.978ms (SLO: <344.800ms 📉 -24.9%) vs baseline: -0.7%

Memory: ✅ 44.768MB (SLO: <47.500MB -5.8%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 316.802ms (SLO: <330.000ms -4.0%) vs baseline: -0.6%

Memory: ✅ 44.796MB (SLO: <47.500MB -5.7%) vs baseline: +4.8%

✅ get-context

Time: ✅ 82.763ms (SLO: <92.350ms 📉 -10.4%) vs baseline: ~same

Memory: ✅ 40.805MB (SLO: <46.500MB 📉 -12.2%) vs baseline: +5.2%

✅ is-recording

Time: ✅ 39.426ms (SLO: <44.500ms 📉 -11.4%) vs baseline: +0.3%

Memory: ✅ 40.343MB (SLO: <47.500MB 📉 -15.1%) vs baseline: +5.3%

✅ record-exception

Time: ✅ 61.854ms (SLO: <67.650ms -8.6%) vs baseline: ~same

Memory: ✅ 40.837MB (SLO: <47.000MB 📉 -13.1%) vs baseline: +4.8%

✅ set-status

Time: ✅ 46.194ms (SLO: <50.400ms -8.3%) vs baseline: +0.8%

Memory: ✅ 40.345MB (SLO: <47.000MB 📉 -14.2%) vs baseline: +5.2%

✅ start

Time: ✅ 40.083ms (SLO: <43.450ms -7.7%) vs baseline: +4.1%

Memory: ✅ 40.312MB (SLO: <47.000MB 📉 -14.2%) vs baseline: +5.4%

✅ start-finish

Time: ✅ 86.659ms (SLO: <90.000ms -3.7%) vs baseline: +0.3%

Memory: ✅ 37.886MB (SLO: <46.500MB 📉 -18.5%) vs baseline: +5.4%

✅ start-finish-telemetry

Time: ✅ 87.919ms (SLO: <91.000ms -3.4%) vs baseline: ~same

Memory: ✅ 37.749MB (SLO: <46.500MB 📉 -18.8%) vs baseline: +5.1%

✅ update-name

Time: ✅ 40.531ms (SLO: <45.150ms 📉 -10.2%) vs baseline: +0.6%

Memory: ✅ 40.451MB (SLO: <47.000MB 📉 -13.9%) vs baseline: +5.3%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 343.802ms (SLO: <354.300ms -3.0%) vs baseline: -0.9%

Memory: ✅ 41.589MB (SLO: <46.000MB -9.6%) vs baseline: +4.5%

✅ cache_on

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.2%

Memory: ✅ 39.948MB (SLO: <46.000MB 📉 -13.2%) vs baseline: +4.9%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.371µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.7%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +5.0%

✅ high_rate_limit

Time: ✅ 2.414µs (SLO: <10.000µs 📉 -75.9%) vs baseline: -0.9%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +4.9%

✅ long_window

Time: ✅ 2.386µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +0.7%

Memory: ✅ 35.468MB (SLO: <38.000MB -6.7%) vs baseline: +4.6%

✅ low_rate_limit

Time: ✅ 2.369µs (SLO: <10.000µs 📉 -76.3%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +4.9%

✅ no_rate_limit

Time: ✅ 0.846µs (SLO: <10.000µs 📉 -91.5%) vs baseline: +1.0%

Memory: ✅ 35.468MB (SLO: <38.000MB -6.7%) vs baseline: +4.6%

✅ short_window

Time: ✅ 2.512µs (SLO: <10.000µs 📉 -74.9%) vs baseline: -0.2%

Memory: ✅ 35.566MB (SLO: <38.000MB -6.4%) vs baseline: +5.0%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 310.765ms (SLO: <320.950ms -3.2%) vs baseline: -0.2%

Memory: ✅ 36.412MB (SLO: <38.750MB -6.0%) vs baseline: +4.8%

✅ deep-profiled

Time: ✅ 326.454ms (SLO: <359.150ms -9.1%) vs baseline: -0.2%

Memory: ✅ 40.403MB (SLO: <46.000MB 📉 -12.2%) vs baseline: +5.0%

✅ medium

Time: ✅ 7.145ms (SLO: <7.400ms -3.5%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +5.4%

✅ shallow

Time: ✅ 0.985ms (SLO: <1.050ms -6.2%) vs baseline: +1.4%

Memory: ✅ 35.645MB (SLO: <38.000MB -6.2%) vs baseline: +5.2%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 146.129µs (SLO: <290.000µs 📉 -49.6%) vs baseline: -1.8%

Memory: ✅ 35.212MB (SLO: <38.000MB -7.3%) vs baseline: +4.9%

✅ high_match

Time: ✅ 191.911µs (SLO: <480.000µs 📉 -60.0%) vs baseline: -2.8%

Memory: ✅ 35.527MB (SLO: <38.000MB -6.5%) vs baseline: +6.0%

✅ low_match

Time: ✅ 99.568µs (SLO: <120.000µs 📉 -17.0%) vs baseline: ~same

Memory: ✅ 732.294MB (SLO: <780.000MB -6.1%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.867ms (SLO: <8.500ms 📉 -66.3%) vs baseline: -2.2%

Memory: ✅ 79.826MB (SLO: <85.000MB -6.1%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.585µs (SLO: <20.000µs 📉 -47.1%) vs baseline: ~same

Memory: ✅ 36.038MB (SLO: <38.750MB -7.0%) vs baseline: +4.5%

✅ all-enabled

Time: ✅ 40.872µs (SLO: <50.000µs 📉 -18.3%) vs baseline: +1.6%

Memory: ✅ 36.078MB (SLO: <38.750MB -6.9%) vs baseline: +4.7%

✅ collectipvariant_exists

Time: ✅ 40.861µs (SLO: <50.000µs 📉 -18.3%) vs baseline: -0.5%

Memory: ✅ 36.038MB (SLO: <38.750MB -7.0%) vs baseline: +4.4%

✅ no-collectipvariant

Time: ✅ 40.153µs (SLO: <50.000µs 📉 -19.7%) vs baseline: ~same

Memory: ✅ 36.038MB (SLO: <38.750MB -7.0%) vs baseline: +4.7%

✅ no-useragentvariant

Time: ✅ 38.826µs (SLO: <50.000µs 📉 -22.3%) vs baseline: -0.4%

Memory: ✅ 36.156MB (SLO: <38.750MB -6.7%) vs baseline: +5.4%

✅ obfuscation-no-query

Time: ✅ 40.670µs (SLO: <50.000µs 📉 -18.7%) vs baseline: +0.2%

Memory: ✅ 36.038MB (SLO: <38.750MB -7.0%) vs baseline: +5.2%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 76.150µs (SLO: <90.000µs 📉 -15.4%) vs baseline: +0.1%

Memory: ✅ 36.117MB (SLO: <38.750MB -6.8%) vs baseline: +4.9%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.394µs (SLO: <90.000µs 📉 -15.1%) vs baseline: -0.5%

Memory: ✅ 36.215MB (SLO: <38.750MB -6.5%) vs baseline: +5.4%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.437µs (SLO: <170.000µs -9.2%) vs baseline: -0.2%

Memory: ✅ 36.274MB (SLO: <38.750MB -6.4%) vs baseline: +5.0%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 149.028µs (SLO: <160.000µs -6.9%) vs baseline: +0.1%

Memory: ✅ 36.137MB (SLO: <38.750MB -6.7%) vs baseline: +4.2%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.946µs (SLO: <170.000µs -8.9%) vs baseline: -0.1%

Memory: ✅ 36.117MB (SLO: <38.750MB -6.8%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.464µs (SLO: <50.000µs 📉 -21.1%) vs baseline: ~same

Memory: ✅ 36.078MB (SLO: <38.750MB -6.9%) vs baseline: +4.9%

✅ useragentvariant_exists_2

Time: ✅ 40.659µs (SLO: <50.000µs 📉 -18.7%) vs baseline: ~same

Memory: ✅ 36.156MB (SLO: <38.750MB -6.7%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 40.219µs (SLO: <50.000µs 📉 -19.6%) vs baseline: +0.3%

Memory: ✅ 36.235MB (SLO: <38.750MB -6.5%) vs baseline: +5.3%

✅ useragentvariant_not_exists_1

Time: ✅ 39.620µs (SLO: <50.000µs 📉 -20.8%) vs baseline: ~same

Memory: ✅ 36.097MB (SLO: <38.750MB -6.8%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.546µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.3%

Memory: ✅ 35.999MB (SLO: <38.750MB -7.1%) vs baseline: +4.7%

✅ span - 26/26

✅ add-event

Time: ✅ 20.238ms (SLO: <22.500ms 📉 -10.1%) vs baseline: +0.5%

Memory: ✅ 37.645MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 89.430ms (SLO: <93.500ms -4.4%) vs baseline: -0.2%

Memory: ✅ 42.153MB (SLO: <53.000MB 📉 -20.5%) vs baseline: +5.3%

✅ add-tags

Time: ✅ 143.390ms (SLO: <155.000ms -7.5%) vs baseline: +0.4%

Memory: ✅ 41.977MB (SLO: <53.000MB 📉 -20.8%) vs baseline: +5.2%

✅ get-context

Time: ✅ 18.232ms (SLO: <20.500ms 📉 -11.1%) vs baseline: ~same

Memory: ✅ 37.572MB (SLO: <53.000MB 📉 -29.1%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 18.639ms (SLO: <20.500ms -9.1%) vs baseline: +0.6%

Memory: ✅ 37.631MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +5.2%

✅ record-exception

Time: ✅ 39.834ms (SLO: <41.000ms -2.8%) vs baseline: +0.5%

Memory: ✅ 38.098MB (SLO: <53.000MB 📉 -28.1%) vs baseline: +5.1%

✅ set-status

Time: ✅ 20.003ms (SLO: <22.000ms -9.1%) vs baseline: -0.1%

Memory: ✅ 37.611MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +5.2%

✅ start

Time: ✅ 18.836ms (SLO: <20.500ms -8.1%) vs baseline: +3.4%

Memory: ✅ 37.631MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +5.4%

✅ start-finish

Time: ✅ 54.246ms (SLO: <56.000ms -3.1%) vs baseline: ~same

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +6.1%

✅ start-finish-telemetry

Time: ✅ 55.613ms (SLO: <58.000ms -4.1%) vs baseline: +0.1%

Memory: ✅ 35.606MB (SLO: <38.000MB -6.3%) vs baseline: +6.1%

✅ start-finish-traceid128

Time: ✅ 57.417ms (SLO: <60.000ms -4.3%) vs baseline: -0.2%

Memory: ✅ 35.586MB (SLO: <38.000MB -6.4%) vs baseline: +5.7%

✅ start-traceid128

Time: ✅ 18.476ms (SLO: <22.500ms 📉 -17.9%) vs baseline: -0.3%

Memory: ✅ 37.637MB (SLO: <53.000MB 📉 -29.0%) vs baseline: +4.9%

✅ update-name

Time: ✅ 18.462ms (SLO: <22.000ms 📉 -16.1%) vs baseline: -1.6%

Memory: ✅ 37.532MB (SLO: <53.000MB 📉 -29.2%) vs baseline: +5.0%

ℹ️ Scenarios Missing SLO Configuration (26 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline
sethttpmeta-obfuscation-disabled
startup-baseline
startup-baseline_django
startup-baseline_flask
startup-ddtrace_run
startup-ddtrace_run_appsec
startup-ddtrace_run_profiling
startup-ddtrace_run_runtime_metrics
startup-ddtrace_run_send_span
startup-ddtrace_run_telemetry_disabled
startup-ddtrace_run_telemetry_enabled
startup-import_ddtrace
startup-import_ddtrace_auto
startup-import_ddtrace_auto_django
startup-import_ddtrace_auto_flask
startup-import_ddtrace_django
startup-import_ddtrace_flask

cit-pr-commenter-54b7da · 2026-02-05T10:39:30Z

Codeowners resolved as

ddtrace/llmobs/_experiment.py                                           @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability
ddtrace/llmobs/_telemetry.py                                            @DataDog/ml-observability
ddtrace/llmobs/_writer.py                                               @DataDog/ml-observability
releasenotes/notes/llmobs-json-metric-type-2e58cd6c746f9947.yaml        @DataDog/apm-python
tests/llmobs/test_llmobs_service.py                                     @DataDog/ml-observability

aniszoubiramar requested review from a team as code owners February 4, 2026 15:44

aniszoubiramar requested review from FouadWahabi, P403n1x87, duncanista and sabrenner February 4, 2026 15:44

FouadWahabi approved these changes Feb 4, 2026

View reviewed changes

aniszoubiramar removed request for P403n1x87, duncanista and sabrenner February 5, 2026 09:39

P403n1x87 approved these changes Feb 5, 2026

View reviewed changes

aniszoubiramar merged commit 9e014a2 into main Feb 5, 2026
975 checks passed

aniszoubiramar deleted the anis.amar/MLOB-5400/support-json-output-in-the-sdk branch February 5, 2026 10:34

Conversation

aniszoubiramar commented Feb 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Testing

Risks

Additional Notes

Uh oh!

pr-commenter bot commented Feb 4, 2026

Performance SLOs

✅ ospathbasename_aspect

✅ ospathbasename_noaspect

✅ ospathjoin_aspect

✅ ospathjoin_noaspect

✅ ospathnormcase_aspect

✅ ospathnormcase_noaspect

✅ ospathsplit_aspect

✅ ospathsplit_noaspect

✅ ospathsplitdrive_aspect

✅ ospathsplitdrive_noaspect

✅ ospathsplitext_aspect

✅ ospathsplitext_noaspect

✅ rsplit_aspect

✅ rsplit_noaspect

✅ split_aspect

✅ split_noaspect

✅ splitlines_aspect

✅ splitlines_noaspect

✅ 1-count-metric-1-times

✅ 1-count-metrics-100-times

✅ 1-distribution-metric-1-times

✅ 1-distribution-metrics-100-times

✅ 1-gauge-metric-1-times

✅ 1-gauge-metrics-100-times

✅ 1-rate-metric-1-times

✅ 1-rate-metrics-100-times

✅ 100-count-metrics-100-times

✅ 100-distribution-metrics-100-times

✅ 100-gauge-metrics-100-times

✅ 100-rate-metrics-100-times

✅ flush-1-metric

✅ flush-100-metrics

✅ flush-1000-metrics

✅ large

✅ medium

✅ small

⚠️ context_with_data_listeners

✅ context_with_data_no_listeners

✅ get_item_exists

✅ get_item_missing

✅ set_item

✅ import_many

✅ import_many_cached

✅ import_many_stdlib

⚠️ import_many_stdlib_cached

✅ import_many_unknown

✅ import_many_unknown_cached

✅ import_one

✅ import_one_cache

✅ import_one_stdlib

✅ import_one_stdlib_cache

✅ import_one_unknown

✅ import_one_unknown_cache

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ resource-renaming

✅ span-code-origin

✅ tracer

✅ tracer-and-profiler

✅ tracer-dont-create-db-spans

✅ tracer-minimal

✅ tracer-native

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ errortracking-enabled-all

✅ errortracking-enabled-user

aniszoubiramar commented Feb 4, 2026 •

edited

Loading