tests: update system tests [backport 4.0] #15770

KowalskiThomas · 2025-12-23T12:04:18Z

Description

Backports: #15767 to 4.0.

github-actions · 2025-12-23T12:04:53Z

CODEOWNERS have been resolved as:

.github/workflows/system-tests.yml                                      @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/python-guild @DataDog/apm-core-python

github-actions · 2025-12-23T12:32:19Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 251 ± 4 ms.

The average import time from base is: 251 ± 5 ms.

The import time difference between this PR and base is: -0.6 ± 0.2 ms.

The difference is not statistically significant (z = -2.92).

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 1.901 ms (0.76%)

ddtrace.bootstrap.sitecustomize 1.216 ms (0.49%)

ddtrace.bootstrap.preload 1.216 ms (0.49%)

ddtrace.internal.remoteconfig.client 0.600 ms (0.24%)

ddtrace 0.685 ms (0.27%)

ddtrace.internal._unpatched 0.029 ms (0.01%)

json 0.029 ms (0.01%)

json.decoder 0.029 ms (0.01%)

re 0.029 ms (0.01%)

enum 0.029 ms (0.01%)

types 0.029 ms (0.01%)

pr-commenter · 2025-12-23T13:02:18Z

Performance SLOs

Comparing candidate backport-15767-to-4.0 (9539cc3) with baseline 4.0 (bbb3aa0)

📈 Performance Regressions (1 suite)

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.179µs (SLO: <10.000µs 📉 -58.2%) vs baseline: -1.5%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +5.0%

✅ ospathbasename_noaspect

Time: ✅ 1.079µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.8%

Memory: ✅ 37.847MB (SLO: <41.000MB -7.7%) vs baseline: +4.9%

✅ ospathjoin_aspect

Time: ✅ 6.067µs (SLO: <10.000µs 📉 -39.3%) vs baseline: +1.7%

Memory: ✅ 37.926MB (SLO: <41.000MB -7.5%) vs baseline: +5.0%

✅ ospathjoin_noaspect

Time: ✅ 2.288µs (SLO: <10.000µs 📉 -77.1%) vs baseline: ~same

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +5.0%

✅ ospathnormcase_aspect

Time: ✅ 3.805µs (SLO: <10.000µs 📉 -61.9%) vs baseline: 📈 +10.5%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +4.8%

✅ ospathnormcase_noaspect

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +1.4%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +5.1%

✅ ospathsplit_aspect

Time: ✅ 4.816µs (SLO: <10.000µs 📉 -51.8%) vs baseline: +0.1%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +5.1%

✅ ospathsplit_noaspect

Time: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +0.4%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.9%

✅ ospathsplitdrive_aspect

Time: ✅ 3.638µs (SLO: <10.000µs 📉 -63.6%) vs baseline: +0.7%

Memory: ✅ 37.847MB (SLO: <41.000MB -7.7%) vs baseline: +4.9%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.702µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.3%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +5.0%

✅ ospathsplitext_aspect

Time: ✅ 4.511µs (SLO: <10.000µs 📉 -54.9%) vs baseline: -0.6%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +5.1%

✅ ospathsplitext_noaspect

Time: ✅ 1.376µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -0.4%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +5.0%

🟡 Near SLO Breach (2 suites)

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.595ms (SLO: <4.750ms -3.3%) vs baseline: ~same

Memory: ✅ 63.740MB (SLO: <66.500MB -4.2%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 6.629ms (SLO: <6.750ms 🟡 -1.8%) vs baseline: +0.2%

Memory: ✅ 63.767MB (SLO: <66.500MB -4.1%) vs baseline: +4.7%

✅ appsec-telemetry

Time: ✅ 4.600ms (SLO: <4.750ms -3.2%) vs baseline: +0.4%

Memory: ✅ 63.700MB (SLO: <66.500MB -4.2%) vs baseline: +4.6%

✅ debugger

Time: ✅ 1.855ms (SLO: <2.000ms -7.3%) vs baseline: -0.3%

Memory: ✅ 47.504MB (SLO: <49.500MB -4.0%) vs baseline: +4.7%

✅ iast-get

Time: ✅ 1.864ms (SLO: <2.000ms -6.8%) vs baseline: +0.3%

Memory: ✅ 44.529MB (SLO: <49.000MB -9.1%) vs baseline: +4.9%

✅ profiler

Time: ✅ 1.915ms (SLO: <2.100ms -8.8%) vs baseline: +0.2%

Memory: ✅ 48.390MB (SLO: <50.000MB -3.2%) vs baseline: +4.7%

✅ resource-renaming

Time: ✅ 3.367ms (SLO: <3.650ms -7.7%) vs baseline: -0.2%

Memory: ✅ 54.072MB (SLO: <56.000MB -3.4%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: +0.4%

Memory: ✅ 54.090MB (SLO: <56.500MB -4.3%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 3.352ms (SLO: <3.650ms -8.2%) vs baseline: ~same

Memory: ✅ 54.008MB (SLO: <60.000MB -10.0%) vs baseline: +5.0%

🟡 packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.825ms (SLO: <354.300ms -3.2%) vs baseline: -0.7%

Memory: ✅ 40.678MB (SLO: <41.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ cache_on

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.6%

Memory: ✅ 39.738MB (SLO: <41.000MB -3.1%) vs baseline: +5.0%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.241µs (SLO: <20.000µs 📉 -33.8%) vs baseline: ~same

Memory: ✅ 34.387MB (SLO: <35.500MB -3.1%) vs baseline: +4.5%

✅ context_with_data_no_listeners

Time: ✅ 3.283µs (SLO: <10.000µs 📉 -67.2%) vs baseline: ~same

Memory: ✅ 34.210MB (SLO: <35.500MB -3.6%) vs baseline: +4.1%

✅ get_item_exists

Time: ✅ 0.584µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.5%

Memory: ✅ 34.406MB (SLO: <35.500MB -3.1%) vs baseline: +4.7%

✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.4%

Memory: ✅ 34.406MB (SLO: <35.500MB -3.1%) vs baseline: +4.6%

✅ set_item

Time: ✅ 23.979µs (SLO: <30.000µs 📉 -20.1%) vs baseline: -1.3%

Memory: ✅ 34.072MB (SLO: <35.500MB -4.0%) vs baseline: +3.5%

✅ All Tests Passing (19 suites)

✅ djangosimple - 30/30

✅ appsec

Time: ✅ 19.244ms (SLO: <22.300ms 📉 -13.7%) vs baseline: -0.2%

Memory: ✅ 67.554MB (SLO: <70.500MB -4.2%) vs baseline: +4.8%

✅ exception-replay-enabled

Time: ✅ 1.344ms (SLO: <1.450ms -7.3%) vs baseline: +0.5%

Memory: ✅ 65.805MB (SLO: <67.500MB -2.5%) vs baseline: +5.0%

✅ iast

Time: ✅ 19.210ms (SLO: <22.250ms 📉 -13.7%) vs baseline: -0.4%

Memory: ✅ 67.535MB (SLO: <70.000MB -3.5%) vs baseline: +4.8%

✅ profiler

Time: ✅ 15.231ms (SLO: <16.550ms -8.0%) vs baseline: +0.3%

Memory: ✅ 55.699MB (SLO: <57.500MB -3.1%) vs baseline: +4.5%

✅ resource-renaming

Time: ✅ 19.339ms (SLO: <21.750ms 📉 -11.1%) vs baseline: +0.4%

Memory: ✅ 67.653MB (SLO: <70.500MB -4.0%) vs baseline: +5.0%

✅ span-code-origin

Time: ✅ 22.778ms (SLO: <28.200ms 📉 -19.2%) vs baseline: -0.4%

Memory: ✅ 68.853MB (SLO: <71.000MB -3.0%) vs baseline: +4.9%

✅ tracer

Time: ✅ 19.255ms (SLO: <21.750ms 📉 -11.5%) vs baseline: -0.5%

Memory: ✅ 67.531MB (SLO: <70.000MB -3.5%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 20.932ms (SLO: <23.500ms 📉 -10.9%) vs baseline: +0.3%

Memory: ✅ 68.950MB (SLO: <71.000MB -2.9%) vs baseline: +4.7%

✅ tracer-dont-create-db-spans

Time: ✅ 19.278ms (SLO: <21.500ms 📉 -10.3%) vs baseline: +0.1%

Memory: ✅ 67.515MB (SLO: <70.000MB -3.5%) vs baseline: +4.7%

✅ tracer-minimal

Time: ✅ 16.571ms (SLO: <17.500ms -5.3%) vs baseline: +0.2%

Memory: ✅ 67.653MB (SLO: <70.000MB -3.4%) vs baseline: +5.1%

✅ tracer-native

Time: ✅ 19.291ms (SLO: <21.750ms 📉 -11.3%) vs baseline: +0.3%

Memory: ✅ 67.594MB (SLO: <72.500MB -6.8%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 17.250ms (SLO: <19.650ms 📉 -12.2%) vs baseline: -0.6%

Memory: ✅ 67.535MB (SLO: <70.000MB -3.5%) vs baseline: +4.8%

✅ tracer-no-databases

Time: ✅ 18.762ms (SLO: <20.100ms -6.7%) vs baseline: ~same

Memory: ✅ 67.589MB (SLO: <70.000MB -3.4%) vs baseline: +4.8%

✅ tracer-no-middleware

Time: ✅ 19.006ms (SLO: <21.500ms 📉 -11.6%) vs baseline: +0.6%

Memory: ✅ 67.574MB (SLO: <70.000MB -3.5%) vs baseline: +4.9%

✅ tracer-no-templates

Time: ✅ 19.049ms (SLO: <22.000ms 📉 -13.4%) vs baseline: -0.2%

Memory: ✅ 67.594MB (SLO: <70.500MB -4.1%) vs baseline: +4.9%

✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.386ms (SLO: <19.850ms 📉 -17.5%) vs baseline: +0.4%

Memory: ✅ 67.514MB (SLO: <70.000MB -3.6%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 16.430ms (SLO: <19.400ms 📉 -15.3%) vs baseline: +0.6%

Memory: ✅ 67.611MB (SLO: <70.000MB -3.4%) vs baseline: +5.1%

✅ tracer-enabled

Time: ✅ 16.344ms (SLO: <19.450ms 📉 -16.0%) vs baseline: -0.1%

Memory: ✅ 67.278MB (SLO: <70.000MB -3.9%) vs baseline: +4.8%

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.078ms (SLO: <2.300ms -9.7%) vs baseline: +0.4%

Memory: ✅ 54.205MB (SLO: <56.500MB -4.1%) vs baseline: +4.7%

✅ errortracking-enabled-user

Time: ✅ 2.072ms (SLO: <2.250ms -7.9%) vs baseline: +0.4%

Memory: ✅ 54.420MB (SLO: <56.500MB -3.7%) vs baseline: +5.0%

✅ tracer-enabled

Time: ✅ 2.084ms (SLO: <2.300ms -9.4%) vs baseline: +0.8%

Memory: ✅ 53.831MB (SLO: <56.500MB -4.7%) vs baseline: +4.3%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.953ms (SLO: <4.200ms -5.9%) vs baseline: -0.2%

Memory: ✅ 64.134MB (SLO: <66.000MB -2.8%) vs baseline: +4.8%

✅ iast-enabled

Time: ✅ 2.450ms (SLO: <2.800ms 📉 -12.5%) vs baseline: +0.6%

Memory: ✅ 60.280MB (SLO: <62.500MB -3.6%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.056ms (SLO: <2.250ms -8.6%) vs baseline: ~same

Memory: ✅ 54.067MB (SLO: <56.500MB -4.3%) vs baseline: +4.4%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.045µs (SLO: <100.000µs 📉 -19.0%) vs baseline: +0.3%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.1%

✅ b3_headers

Time: ✅ 14.207µs (SLO: <20.000µs 📉 -29.0%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ b3_single_headers

Time: ✅ 13.337µs (SLO: <20.000µs 📉 -33.3%) vs baseline: ~same

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.8%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.144µs (SLO: <80.000µs 📉 -19.8%) vs baseline: +0.4%

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.8%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.148µs (SLO: <80.000µs 📉 -17.3%) vs baseline: -0.1%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.607µs (SLO: <10.000µs 📉 -83.9%) vs baseline: ~same

Memory: ✅ 34.210MB (SLO: <35.500MB -3.6%) vs baseline: +3.7%

✅ full_t_id_datadog_headers

Time: ✅ 22.902µs (SLO: <30.000µs 📉 -23.7%) vs baseline: +1.8%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.7%

✅ invalid_priority_header

Time: ✅ 6.559µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.1%

Memory: ✅ 34.151MB (SLO: <35.500MB -3.8%) vs baseline: +4.6%

✅ invalid_span_id_header

Time: ✅ 6.554µs (SLO: <10.000µs 📉 -34.5%) vs baseline: ~same

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.8%

✅ invalid_tags_header

Time: ✅ 6.570µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.1%

Memory: ✅ 34.190MB (SLO: <35.500MB -3.7%) vs baseline: +3.6%

✅ invalid_trace_id_header

Time: ✅ 6.613µs (SLO: <10.000µs 📉 -33.9%) vs baseline: ~same

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.6%

✅ large_header_no_matches

Time: ✅ 27.712µs (SLO: <30.000µs -7.6%) vs baseline: ~same

Memory: ✅ 34.151MB (SLO: <35.500MB -3.8%) vs baseline: +3.7%

✅ large_valid_headers_all

Time: ✅ 28.757µs (SLO: <40.000µs 📉 -28.1%) vs baseline: -0.3%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.5%

✅ medium_header_no_matches

Time: ✅ 9.944µs (SLO: <20.000µs 📉 -50.3%) vs baseline: ~same

Memory: ✅ 34.151MB (SLO: <35.500MB -3.8%) vs baseline: +3.6%

✅ medium_valid_headers_all

Time: ✅ 11.299µs (SLO: <20.000µs 📉 -43.5%) vs baseline: -0.3%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ none_propagation_style

Time: ✅ 1.696µs (SLO: <10.000µs 📉 -83.0%) vs baseline: +0.6%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.7%

✅ tracecontext_headers

Time: ✅ 35.293µs (SLO: <40.000µs 📉 -11.8%) vs baseline: +0.4%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.5%

✅ valid_headers_all

Time: ✅ 6.560µs (SLO: <10.000µs 📉 -34.4%) vs baseline: ~same

Memory: ✅ 34.603MB (SLO: <35.500MB -2.5%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.222µs (SLO: <10.000µs 📉 -37.8%) vs baseline: +1.8%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ wsgi_empty_headers

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.2%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ wsgi_invalid_priority_header

Time: ✅ 6.661µs (SLO: <10.000µs 📉 -33.4%) vs baseline: +0.4%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.8%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ wsgi_invalid_tags_header

Time: ✅ 6.574µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.1%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.606µs (SLO: <10.000µs 📉 -33.9%) vs baseline: -0.2%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +4.7%

✅ wsgi_large_header_no_matches

Time: ✅ 28.602µs (SLO: <40.000µs 📉 -28.5%) vs baseline: -0.3%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.7%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.883µs (SLO: <40.000µs 📉 -25.3%) vs baseline: ~same

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.6%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.160µs (SLO: <20.000µs 📉 -49.2%) vs baseline: -0.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.632µs (SLO: <20.000µs 📉 -41.8%) vs baseline: +0.6%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ wsgi_valid_headers_all

Time: ✅ 6.589µs (SLO: <10.000µs 📉 -34.1%) vs baseline: -0.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.8%

✅ wsgi_valid_headers_basic

Time: ✅ 6.133µs (SLO: <10.000µs 📉 -38.7%) vs baseline: -0.5%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.170µs (SLO: <30.000µs 📉 -29.4%) vs baseline: +0.5%

Memory: ✅ 34.583MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ with_all

Time: ✅ 28.252µs (SLO: <40.000µs 📉 -29.4%) vs baseline: +0.5%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.9%

✅ with_dd_origin

Time: ✅ 25.101µs (SLO: <30.000µs 📉 -16.3%) vs baseline: +0.5%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.7%

✅ with_priority_and_origin

Time: ✅ 24.320µs (SLO: <40.000µs 📉 -39.2%) vs baseline: -0.6%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +5.0%

✅ with_sampling_priority

Time: ✅ 21.234µs (SLO: <30.000µs 📉 -29.2%) vs baseline: ~same

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +4.6%

✅ with_tags

Time: ✅ 26.223µs (SLO: <40.000µs 📉 -34.4%) vs baseline: +0.6%

Memory: ✅ 34.564MB (SLO: <35.500MB -2.6%) vs baseline: +4.9%

✅ with_tags_invalid

Time: ✅ 27.668µs (SLO: <40.000µs 📉 -30.8%) vs baseline: -0.6%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ with_tags_max_size

Time: ✅ 26.727µs (SLO: <40.000µs 📉 -33.2%) vs baseline: +0.8%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.955µs (SLO: <40.000µs 📉 -20.1%) vs baseline: +0.2%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.9%

✅ re_expand_noaspect

Time: ✅ 28.719µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 37.827MB (SLO: <41.000MB -7.7%) vs baseline: +4.6%

✅ re_findall_aspect

Time: ✅ 2.929µs (SLO: <10.000µs 📉 -70.7%) vs baseline: +1.0%

Memory: ✅ 37.808MB (SLO: <41.000MB -7.8%) vs baseline: +4.7%

✅ re_findall_noaspect

Time: ✅ 1.409µs (SLO: <10.000µs 📉 -85.9%) vs baseline: ~same

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +5.1%

✅ re_finditer_aspect

Time: ✅ 4.426µs (SLO: <10.000µs 📉 -55.7%) vs baseline: +0.2%

Memory: ✅ 37.926MB (SLO: <41.000MB -7.5%) vs baseline: +4.9%

✅ re_finditer_noaspect

Time: ✅ 1.398µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.4%

Memory: ✅ 37.827MB (SLO: <41.000MB -7.7%) vs baseline: +4.7%

✅ re_fullmatch_aspect

Time: ✅ 2.679µs (SLO: <10.000µs 📉 -73.2%) vs baseline: +0.4%

Memory: ✅ 37.827MB (SLO: <41.000MB -7.7%) vs baseline: +4.7%

✅ re_fullmatch_noaspect

Time: ✅ 1.329µs (SLO: <10.000µs 📉 -86.7%) vs baseline: +1.6%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +5.0%

✅ re_group_aspect

Time: ✅ 3.009µs (SLO: <10.000µs 📉 -69.9%) vs baseline: +1.6%

Memory: ✅ 37.808MB (SLO: <41.000MB -7.8%) vs baseline: +4.6%

✅ re_group_noaspect

Time: ✅ 1.639µs (SLO: <10.000µs 📉 -83.6%) vs baseline: +1.1%

Memory: ✅ 37.867MB (SLO: <41.000MB -7.6%) vs baseline: +4.9%

✅ re_groups_aspect

Time: ✅ 3.267µs (SLO: <10.000µs 📉 -67.3%) vs baseline: +5.6%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.9%

✅ re_groups_noaspect

Time: ✅ 1.706µs (SLO: <10.000µs 📉 -82.9%) vs baseline: -1.1%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +4.9%

✅ re_match_aspect

Time: ✅ 2.755µs (SLO: <10.000µs 📉 -72.5%) vs baseline: +0.6%

Memory: ✅ 37.945MB (SLO: <41.000MB -7.5%) vs baseline: +5.1%

✅ re_match_noaspect

Time: ✅ 1.318µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +1.6%

Memory: ✅ 37.867MB (SLO: <41.000MB -7.6%) vs baseline: +4.8%

✅ re_search_aspect

Time: ✅ 2.531µs (SLO: <10.000µs 📉 -74.7%) vs baseline: +0.7%

Memory: ✅ 37.847MB (SLO: <41.000MB -7.7%) vs baseline: +4.9%

✅ re_search_noaspect

Time: ✅ 1.207µs (SLO: <10.000µs 📉 -87.9%) vs baseline: +0.4%

Memory: ✅ 37.808MB (SLO: <41.000MB -7.8%) vs baseline: +4.7%

✅ re_sub_aspect

Time: ✅ 3.374µs (SLO: <10.000µs 📉 -66.3%) vs baseline: +0.3%

Memory: ✅ 37.886MB (SLO: <41.000MB -7.6%) vs baseline: +4.9%

✅ re_sub_noaspect

Time: ✅ 1.559µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +2.4%

Memory: ✅ 37.847MB (SLO: <41.000MB -7.7%) vs baseline: +4.7%

✅ re_subn_aspect

Time: ✅ 3.625µs (SLO: <10.000µs 📉 -63.7%) vs baseline: +0.4%

Memory: ✅ 37.867MB (SLO: <41.000MB -7.6%) vs baseline: +5.0%

✅ re_subn_noaspect

Time: ✅ 1.629µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.5%

Memory: ✅ 37.906MB (SLO: <41.000MB -7.5%) vs baseline: +4.7%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.2%

Memory: ✅ 37.708MB (SLO: <41.500MB -9.1%) vs baseline: +4.7%

✅ add_inplace_aspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.6%

Memory: ✅ 37.800MB (SLO: <41.500MB -8.9%) vs baseline: +4.9%

✅ add_inplace_noaspect

Time: ✅ 0.286µs (SLO: <10.000µs 📉 -97.1%) vs baseline: -0.5%

Memory: ✅ 37.753MB (SLO: <41.500MB -9.0%) vs baseline: +4.8%

✅ add_noaspect

Time: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.1%

Memory: ✅ 37.760MB (SLO: <41.500MB -9.0%) vs baseline: +5.0%

✅ bytearray_aspect

Time: ✅ 1.330µs (SLO: <10.000µs 📉 -86.7%) vs baseline: -1.4%

Memory: ✅ 37.821MB (SLO: <41.500MB -8.9%) vs baseline: +4.9%

✅ bytearray_extend_aspect

Time: ✅ 1.518µs (SLO: <10.000µs 📉 -84.8%) vs baseline: +0.4%

Memory: ✅ 37.782MB (SLO: <41.500MB -9.0%) vs baseline: +4.8%

✅ bytearray_extend_noaspect

Time: ✅ 0.621µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +0.6%

Memory: ✅ 37.728MB (SLO: <41.500MB -9.1%) vs baseline: +4.8%

✅ bytearray_noaspect

Time: ✅ 0.485µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -1.0%

Memory: ✅ 37.774MB (SLO: <41.500MB -9.0%) vs baseline: +4.6%

✅ bytes_aspect

Time: ✅ 1.283µs (SLO: <10.000µs 📉 -87.2%) vs baseline: +0.9%

Memory: ✅ 37.763MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ bytes_noaspect

Time: ✅ 0.496µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.4%

Memory: ✅ 37.755MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ bytesio_aspect

Time: ✅ 1.322µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +0.7%

Memory: ✅ 37.787MB (SLO: <41.500MB -8.9%) vs baseline: +5.0%

✅ bytesio_noaspect

Time: ✅ 0.502µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.5%

Memory: ✅ 37.713MB (SLO: <41.500MB -9.1%) vs baseline: +4.7%

✅ capitalize_aspect

Time: ✅ 0.742µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.9%

Memory: ✅ 37.777MB (SLO: <41.500MB -9.0%) vs baseline: +4.8%

✅ capitalize_noaspect

Time: ✅ 0.442µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +1.2%

Memory: ✅ 37.827MB (SLO: <41.500MB -8.8%) vs baseline: +4.9%

✅ casefold_aspect

Time: ✅ 0.734µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -1.2%

Memory: ✅ 37.736MB (SLO: <41.500MB -9.1%) vs baseline: +4.8%

✅ casefold_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.6%

Memory: ✅ 37.744MB (SLO: <41.500MB -9.0%) vs baseline: +5.0%

✅ decode_aspect

Time: ✅ 0.732µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.9%

Memory: ✅ 37.824MB (SLO: <41.500MB -8.9%) vs baseline: +4.9%

✅ decode_noaspect

Time: ✅ 0.425µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +1.1%

Memory: ✅ 37.753MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ encode_aspect

Time: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.1%

Memory: ✅ 37.846MB (SLO: <41.500MB -8.8%) vs baseline: +5.2%

✅ encode_noaspect

Time: ✅ 0.413µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +2.5%

Memory: ✅ 37.860MB (SLO: <41.500MB -8.8%) vs baseline: +5.0%

✅ format_aspect

Time: ✅ 3.418µs (SLO: <10.000µs 📉 -65.8%) vs baseline: -0.3%

Memory: ✅ 37.763MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ format_map_aspect

Time: ✅ 3.650µs (SLO: <10.000µs 📉 -63.5%) vs baseline: +0.5%

Memory: ✅ 37.864MB (SLO: <41.500MB -8.8%) vs baseline: +5.2%

✅ format_map_noaspect

Time: ✅ 0.821µs (SLO: <10.000µs 📉 -91.8%) vs baseline: -0.7%

Memory: ✅ 37.769MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ format_noaspect

Time: ✅ 0.594µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.9%

Memory: ✅ 37.798MB (SLO: <41.500MB -8.9%) vs baseline: +5.2%

✅ index_aspect

Time: ✅ 0.340µs (SLO: <10.000µs 📉 -96.6%) vs baseline: ~same

Memory: ✅ 37.847MB (SLO: <41.500MB -8.8%) vs baseline: +5.0%

✅ index_noaspect

Time: ✅ 0.314µs (SLO: <10.000µs 📉 -96.9%) vs baseline: -0.2%

Memory: ✅ 37.784MB (SLO: <41.500MB -9.0%) vs baseline: +5.1%

✅ join_aspect

Time: ✅ 1.278µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -0.5%

Memory: ✅ 37.726MB (SLO: <41.500MB -9.1%) vs baseline: +4.8%

✅ join_noaspect

Time: ✅ 0.537µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +1.3%

Memory: ✅ 37.822MB (SLO: <41.500MB -8.9%) vs baseline: +4.8%

✅ ljust_aspect

Time: ✅ 2.606µs (SLO: <20.000µs 📉 -87.0%) vs baseline: +1.0%

Memory: ✅ 37.805MB (SLO: <41.500MB -8.9%) vs baseline: +4.9%

✅ ljust_noaspect

Time: ✅ 0.405µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.9%

Memory: ✅ 37.818MB (SLO: <41.500MB -8.9%) vs baseline: +4.8%

✅ lower_aspect

Time: ✅ 2.291µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +0.3%

Memory: ✅ 37.781MB (SLO: <41.500MB -9.0%) vs baseline: +4.8%

✅ lower_noaspect

Time: ✅ 0.371µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.5%

Memory: ✅ 37.701MB (SLO: <41.500MB -9.2%) vs baseline: +4.7%

✅ lstrip_aspect

Time: ✅ 2.178µs (SLO: <20.000µs 📉 -89.1%) vs baseline: -0.5%

Memory: ✅ 37.803MB (SLO: <41.500MB -8.9%) vs baseline: +4.8%

✅ lstrip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.3%

Memory: ✅ 37.751MB (SLO: <41.500MB -9.0%) vs baseline: +4.7%

✅ modulo_aspect

Time: ✅ 0.975µs (SLO: <10.000µs 📉 -90.2%) vs baseline: +0.5%

Memory: ✅ 37.698MB (SLO: <41.500MB -9.2%) vs baseline: +4.6%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.494µs (SLO: <10.000µs 📉 -85.1%) vs baseline: +0.3%

Memory: ✅ 37.798MB (SLO: <41.500MB -8.9%) vs baseline: +4.7%

✅ modulo_aspect_for_bytes

Time: ✅ 0.958µs (SLO: <10.000µs 📉 -90.4%) vs baseline: +1.1%

Memory: ✅ 37.805MB (SLO: <41.500MB -8.9%) vs baseline: +5.0%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.181µs (SLO: <10.000µs 📉 -88.2%) vs baseline: +1.6%

Memory: ✅ 37.773MB (SLO: <41.500MB -9.0%) vs baseline: +4.8%

✅ modulo_noaspect

Time: ✅ 0.668µs (SLO: <10.000µs 📉 -93.3%) vs baseline: +0.6%

Memory: ✅ 37.818MB (SLO: <41.500MB -8.9%) vs baseline: +5.1%

✅ replace_aspect

Time: ✅ 4.947µs (SLO: <10.000µs 📉 -50.5%) vs baseline: +0.4%

Memory: ✅ 37.704MB (SLO: <41.500MB -9.1%) vs baseline: +4.8%

✅ replace_noaspect

Time: ✅ 0.460µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.3%

Memory: ✅ 37.749MB (SLO: <41.500MB -9.0%) vs baseline: +4.7%

✅ repr_aspect

Time: ✅ 0.949µs (SLO: <10.000µs 📉 -90.5%) vs baseline: ~same

Memory: ✅ 37.784MB (SLO: <41.500MB -9.0%) vs baseline: +5.0%

✅ repr_noaspect

Time: ✅ 0.454µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.5%

Memory: ✅ 37.684MB (SLO: <41.500MB -9.2%) vs baseline: +4.6%

✅ rstrip_aspect

Time: ✅ 1.875µs (SLO: <20.000µs 📉 -90.6%) vs baseline: +0.5%

Memory: ✅ 37.820MB (SLO: <41.500MB -8.9%) vs baseline: +5.0%

✅ rstrip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.4%

Memory: ✅ 37.750MB (SLO: <41.500MB -9.0%) vs baseline: +4.7%

✅ slice_aspect

Time: ✅ 0.487µs (SLO: <10.000µs 📉 -95.1%) vs baseline: ~same

Memory: ✅ 37.765MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ slice_noaspect

Time: ✅ 0.447µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.5%

Memory: ✅ 37.758MB (SLO: <41.500MB -9.0%) vs baseline: +4.7%

✅ stringio_aspect

Time: ✅ 1.693µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.2%

Memory: ✅ 37.778MB (SLO: <41.500MB -9.0%) vs baseline: +5.0%

✅ stringio_noaspect

Time: ✅ 0.923µs (SLO: <10.000µs 📉 -90.8%) vs baseline: +1.3%

Memory: ✅ 37.785MB (SLO: <41.500MB -9.0%) vs baseline: +5.1%

✅ strip_aspect

Time: ✅ 2.204µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +1.0%

Memory: ✅ 37.878MB (SLO: <41.500MB -8.7%) vs baseline: +5.0%

✅ strip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.2%

Memory: ✅ 37.798MB (SLO: <41.500MB -8.9%) vs baseline: +5.0%

✅ swapcase_aspect

Time: ✅ 2.486µs (SLO: <10.000µs 📉 -75.1%) vs baseline: +0.2%

Memory: ✅ 37.701MB (SLO: <41.500MB -9.2%) vs baseline: +4.8%

✅ swapcase_noaspect

Time: ✅ 0.537µs (SLO: <10.000µs 📉 -94.6%) vs baseline: ~same

Memory: ✅ 37.813MB (SLO: <41.500MB -8.9%) vs baseline: +5.0%

✅ title_aspect

Time: ✅ 2.416µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +0.3%

Memory: ✅ 37.930MB (SLO: <41.500MB -8.6%) vs baseline: +5.2%

✅ title_noaspect

Time: ✅ 0.504µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.7%

Memory: ✅ 37.809MB (SLO: <41.500MB -8.9%) vs baseline: +5.2%

✅ translate_aspect

Time: ✅ 3.351µs (SLO: <10.000µs 📉 -66.5%) vs baseline: +0.8%

Memory: ✅ 37.720MB (SLO: <41.500MB -9.1%) vs baseline: +4.7%

✅ translate_noaspect

Time: ✅ 1.041µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.6%

Memory: ✅ 37.788MB (SLO: <41.500MB -8.9%) vs baseline: +5.0%

✅ upper_aspect

Time: ✅ 2.323µs (SLO: <10.000µs 📉 -76.8%) vs baseline: -0.3%

Memory: ✅ 37.762MB (SLO: <41.500MB -9.0%) vs baseline: +4.9%

✅ upper_noaspect

Time: ✅ 0.371µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.5%

Memory: ✅ 37.718MB (SLO: <41.500MB -9.1%) vs baseline: +4.6%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.388µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +1.1%

Memory: ✅ 37.867MB (SLO: <41.000MB -7.6%) vs baseline: +5.0%

✅ rsplit_noaspect

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.3%

Memory: ✅ 37.808MB (SLO: <41.000MB -7.8%) vs baseline: +4.7%

✅ split_aspect

Time: ✅ 1.366µs (SLO: <10.000µs 📉 -86.3%) vs baseline: +1.1%

Memory: ✅ 37.808MB (SLO: <41.000MB -7.8%) vs baseline: +4.8%

✅ split_noaspect

Time: ✅ 0.567µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.9%

Memory: ✅ 37.788MB (SLO: <41.000MB -7.8%) vs baseline: +4.5%

✅ splitlines_aspect

Time: ✅ 1.394µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +1.6%

Memory: ✅ 37.808MB (SLO: <41.000MB -7.8%) vs baseline: +4.6%

✅ splitlines_noaspect

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.1%

Memory: ✅ 37.867MB (SLO: <41.000MB -7.6%) vs baseline: +4.5%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.887ms (SLO: <42.000ms -2.6%) vs baseline: +1.3%

Memory: ✅ 36.982MB (SLO: <39.000MB -5.2%) vs baseline: +5.2%

✅ add-link

Time: ✅ 36.490ms (SLO: <38.550ms -5.3%) vs baseline: +1.2%

Memory: ✅ 36.884MB (SLO: <39.000MB -5.4%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 220.565ms (SLO: <232.000ms -4.9%) vs baseline: ~same

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 209.781ms (SLO: <221.600ms -5.3%) vs baseline: -0.4%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.7%

✅ get-context

Time: ✅ 29.272ms (SLO: <31.300ms -6.5%) vs baseline: +1.0%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 29.563ms (SLO: <31.000ms -4.6%) vs baseline: +1.9%

Memory: ✅ 36.962MB (SLO: <39.000MB -5.2%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 62.835ms (SLO: <65.850ms -4.6%) vs baseline: -0.5%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.7%

✅ set-status

Time: ✅ 31.930ms (SLO: <34.150ms -6.5%) vs baseline: -0.2%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +5.0%

✅ start

Time: ✅ 28.758ms (SLO: <30.150ms -4.6%) vs baseline: -0.2%

Memory: ✅ 36.923MB (SLO: <39.000MB -5.3%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 34.110ms (SLO: <35.350ms -3.5%) vs baseline: +1.4%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 33.920ms (SLO: <35.450ms -4.3%) vs baseline: -0.4%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.9%

✅ update-name

Time: ✅ 31.229ms (SLO: <33.400ms -6.5%) vs baseline: +0.9%

Memory: ✅ 36.903MB (SLO: <39.000MB -5.4%) vs baseline: +4.9%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 38.470ms (SLO: <47.150ms 📉 -18.4%) vs baseline: +0.2%

Memory: ✅ 38.927MB (SLO: <47.000MB 📉 -17.2%) vs baseline: +4.8%

✅ add-metrics

Time: ✅ 257.006ms (SLO: <344.800ms 📉 -25.5%) vs baseline: -0.3%

Memory: ✅ 43.213MB (SLO: <47.500MB -9.0%) vs baseline: +4.7%

✅ add-tags

Time: ✅ 312.799ms (SLO: <321.000ms -2.6%) vs baseline: -0.6%

Memory: ✅ 43.313MB (SLO: <47.500MB -8.8%) vs baseline: +4.8%

✅ get-context

Time: ✅ 78.869ms (SLO: <92.350ms 📉 -14.6%) vs baseline: ~same

Memory: ✅ 39.203MB (SLO: <46.500MB 📉 -15.7%) vs baseline: +4.6%

✅ is-recording

Time: ✅ 36.049ms (SLO: <44.500ms 📉 -19.0%) vs baseline: -0.9%

Memory: ✅ 38.741MB (SLO: <47.500MB 📉 -18.4%) vs baseline: +4.6%

✅ record-exception

Time: ✅ 56.499ms (SLO: <67.650ms 📉 -16.5%) vs baseline: ~same

Memory: ✅ 39.369MB (SLO: <47.000MB 📉 -16.2%) vs baseline: +5.0%

✅ set-status

Time: ✅ 42.546ms (SLO: <50.400ms 📉 -15.6%) vs baseline: -0.7%

Memory: ✅ 38.827MB (SLO: <47.000MB 📉 -17.4%) vs baseline: +4.9%

✅ start

Time: ✅ 35.343ms (SLO: <43.450ms 📉 -18.7%) vs baseline: -0.4%

Memory: ✅ 38.742MB (SLO: <47.000MB 📉 -17.6%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 81.753ms (SLO: <88.000ms -7.1%) vs baseline: +0.4%

Memory: ✅ 36.569MB (SLO: <46.500MB 📉 -21.4%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 83.433ms (SLO: <89.000ms -6.3%) vs baseline: +0.4%

Memory: ✅ 36.648MB (SLO: <46.500MB 📉 -21.2%) vs baseline: +4.9%

✅ update-name

Time: ✅ 36.907ms (SLO: <45.150ms 📉 -18.3%) vs baseline: -0.1%

Memory: ✅ 38.901MB (SLO: <47.000MB 📉 -17.2%) vs baseline: +5.1%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 154.654µs (SLO: <170.000µs -9.0%) vs baseline: -0.7%

Memory: ✅ 38.931MB (SLO: <41.000MB -5.0%) vs baseline: +5.2%

✅ import_many_cached

Time: ✅ 120.921µs (SLO: <130.000µs -7.0%) vs baseline: -1.8%

Memory: ✅ 38.956MB (SLO: <41.000MB -5.0%) vs baseline: +5.7%

✅ import_many_stdlib

Time: ✅ 1.634ms (SLO: <1.750ms -6.6%) vs baseline: -0.7%

Memory: ✅ 39.024MB (SLO: <41.000MB -4.8%) vs baseline: +4.9%

✅ import_many_stdlib_cached

Time: ✅ 0.993ms (SLO: <1.100ms -9.8%) vs baseline: +0.5%

Memory: ✅ 38.996MB (SLO: <41.000MB -4.9%) vs baseline: +5.2%

✅ import_many_unknown

Time: ✅ 830.800µs (SLO: <890.000µs -6.7%) vs baseline: -0.7%

Memory: ✅ 39.091MB (SLO: <41.000MB -4.7%) vs baseline: +5.3%

✅ import_many_unknown_cached

Time: ✅ 797.255µs (SLO: <870.000µs -8.4%) vs baseline: -0.2%

Memory: ✅ 39.105MB (SLO: <41.000MB -4.6%) vs baseline: +5.4%

✅ import_one

Time: ✅ 19.767µs (SLO: <30.000µs 📉 -34.1%) vs baseline: ~same

Memory: ✅ 38.777MB (SLO: <41.000MB -5.4%) vs baseline: +5.1%

✅ import_one_cache

Time: ✅ 6.331µs (SLO: <10.000µs 📉 -36.7%) vs baseline: +0.5%

Memory: ✅ 38.947MB (SLO: <41.000MB -5.0%) vs baseline: +4.7%

✅ import_one_stdlib

Time: ✅ 18.690µs (SLO: <20.000µs -6.5%) vs baseline: +0.3%

Memory: ✅ 38.903MB (SLO: <41.000MB -5.1%) vs baseline: +4.7%

✅ import_one_stdlib_cache

Time: ✅ 6.286µs (SLO: <10.000µs 📉 -37.1%) vs baseline: -0.8%

Memory: ✅ 38.616MB (SLO: <41.000MB -5.8%) vs baseline: +4.6%

✅ import_one_unknown

Time: ✅ 45.243µs (SLO: <50.000µs -9.5%) vs baseline: -0.8%

Memory: ✅ 38.884MB (SLO: <41.000MB -5.2%) vs baseline: +4.6%

✅ import_one_unknown_cache

Time: ✅ 6.271µs (SLO: <10.000µs 📉 -37.3%) vs baseline: -0.8%

Memory: ✅ 38.502MB (SLO: <41.000MB -6.1%) vs baseline: +4.5%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.352µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.2%

Memory: ✅ 34.406MB (SLO: <35.500MB -3.1%) vs baseline: +4.8%

✅ high_rate_limit

Time: ✅ 2.409µs (SLO: <10.000µs 📉 -75.9%) vs baseline: -0.3%

Memory: ✅ 34.387MB (SLO: <35.500MB -3.1%) vs baseline: +4.6%

✅ long_window

Time: ✅ 2.358µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.1%

Memory: ✅ 34.367MB (SLO: <35.500MB -3.2%) vs baseline: +4.4%

✅ low_rate_limit

Time: ✅ 2.362µs (SLO: <10.000µs 📉 -76.4%) vs baseline: +0.5%

Memory: ✅ 34.426MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ no_rate_limit

Time: ✅ 0.827µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +1.1%

Memory: ✅ 34.485MB (SLO: <35.500MB -2.9%) vs baseline: +5.0%

✅ short_window

Time: ✅ 2.498µs (SLO: <10.000µs 📉 -75.0%) vs baseline: ~same

Memory: ✅ 34.387MB (SLO: <35.500MB -3.1%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 308.664ms (SLO: <320.950ms -3.8%) vs baseline: +0.3%

Memory: ✅ 35.212MB (SLO: <36.500MB -3.5%) vs baseline: +4.8%

✅ deep-profiled

Time: ✅ 327.384ms (SLO: <359.150ms -8.8%) vs baseline: -0.3%

Memory: ✅ 39.322MB (SLO: <40.500MB -2.9%) vs baseline: +4.9%

✅ medium

Time: ✅ 7.014ms (SLO: <7.400ms -5.2%) vs baseline: +0.4%

Memory: ✅ 34.367MB (SLO: <35.500MB -3.2%) vs baseline: +4.4%

✅ shallow

Time: ✅ 0.943ms (SLO: <1.050ms 📉 -10.2%) vs baseline: +0.2%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 136.550µs (SLO: <290.000µs 📉 -52.9%) vs baseline: -0.3%

Memory: ✅ 34.269MB (SLO: <35.500MB -3.5%) vs baseline: +5.3%

✅ high_match

Time: ✅ 174.308µs (SLO: <480.000µs 📉 -63.7%) vs baseline: ~same

Memory: ✅ 34.013MB (SLO: <35.500MB -4.2%) vs baseline: +4.7%

✅ low_match

Time: ✅ 98.682µs (SLO: <120.000µs 📉 -17.8%) vs baseline: +0.2%

Memory: ✅ 602.937MB (SLO: <700.000MB 📉 -13.9%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.669ms (SLO: <8.500ms 📉 -68.6%) vs baseline: +0.3%

Memory: ✅ 70.427MB (SLO: <75.000MB -6.1%) vs baseline: +5.0%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.496µs (SLO: <20.000µs 📉 -47.5%) vs baseline: -0.4%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.9%

✅ all-enabled

Time: ✅ 39.645µs (SLO: <50.000µs 📉 -20.7%) vs baseline: -0.8%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +5.0%

✅ collectipvariant_exists

Time: ✅ 40.615µs (SLO: <50.000µs 📉 -18.8%) vs baseline: -0.2%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.9%

✅ no-collectipvariant

Time: ✅ 39.723µs (SLO: <50.000µs 📉 -20.6%) vs baseline: -0.6%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.9%

✅ no-useragentvariant

Time: ✅ 38.577µs (SLO: <50.000µs 📉 -22.8%) vs baseline: -0.5%

Memory: ✅ 34.918MB (SLO: <36.000MB -3.0%) vs baseline: +4.7%

✅ obfuscation-no-query

Time: ✅ 40.382µs (SLO: <50.000µs 📉 -19.2%) vs baseline: -0.2%

Memory: ✅ 34.977MB (SLO: <36.000MB -2.8%) vs baseline: +5.2%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.703µs (SLO: <90.000µs 📉 -15.9%) vs baseline: -0.3%

Memory: ✅ 34.898MB (SLO: <36.500MB -4.4%) vs baseline: +4.7%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.276µs (SLO: <90.000µs 📉 -15.2%) vs baseline: ~same

Memory: ✅ 34.977MB (SLO: <36.500MB -4.2%) vs baseline: +4.9%

✅ obfuscation-send-querystring-disabled

Time: ✅ 155.467µs (SLO: <170.000µs -8.5%) vs baseline: +0.8%

Memory: ✅ 34.918MB (SLO: <36.500MB -4.3%) vs baseline: +4.6%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.466µs (SLO: <160.000µs -7.2%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <36.500MB -4.3%) vs baseline: +4.7%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.667µs (SLO: <170.000µs -9.0%) vs baseline: +0.1%

Memory: ✅ 34.918MB (SLO: <36.500MB -4.3%) vs baseline: +4.6%

✅ useragentvariant_exists_1

Time: ✅ 39.227µs (SLO: <50.000µs 📉 -21.5%) vs baseline: -1.2%

Memory: ✅ 34.957MB (SLO: <36.000MB -2.9%) vs baseline: +4.9%

✅ useragentvariant_exists_2

Time: ✅ 40.262µs (SLO: <50.000µs 📉 -19.5%) vs baseline: -0.5%

Memory: ✅ 34.918MB (SLO: <36.000MB -3.0%) vs baseline: +4.7%

✅ useragentvariant_exists_3

Time: ✅ 39.671µs (SLO: <50.000µs 📉 -20.7%) vs baseline: -0.8%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.7%

✅ useragentvariant_not_exists_1

Time: ✅ 39.190µs (SLO: <50.000µs 📉 -21.6%) vs baseline: -0.9%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +4.8%

✅ useragentvariant_not_exists_2

Time: ✅ 39.337µs (SLO: <50.000µs 📉 -21.3%) vs baseline: -0.2%

Memory: ✅ 34.937MB (SLO: <36.000MB -3.0%) vs baseline: +5.0%

✅ span - 26/26

✅ add-event

Time: ✅ 17.308ms (SLO: <22.500ms 📉 -23.1%) vs baseline: +1.1%

Memory: ✅ 36.220MB (SLO: <53.000MB 📉 -31.7%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 87.467ms (SLO: <93.500ms -6.5%) vs baseline: +1.3%

Memory: ✅ 40.465MB (SLO: <53.000MB 📉 -23.7%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 139.283ms (SLO: <155.000ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 40.305MB (SLO: <53.000MB 📉 -24.0%) vs baseline: +4.9%

✅ get-context

Time: ✅ 16.049ms (SLO: <20.500ms 📉 -21.7%) vs baseline: +0.2%

Memory: ✅ 35.973MB (SLO: <53.000MB 📉 -32.1%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 16.279ms (SLO: <20.500ms 📉 -20.6%) vs baseline: +0.1%

Memory: ✅ 36.085MB (SLO: <53.000MB 📉 -31.9%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 35.364ms (SLO: <40.000ms 📉 -11.6%) vs baseline: +0.3%

Memory: ✅ 36.625MB (SLO: <53.000MB 📉 -30.9%) vs baseline: +4.7%

✅ set-status

Time: ✅ 17.810ms (SLO: <22.000ms 📉 -19.0%) vs baseline: +0.7%

Memory: ✅ 35.929MB (SLO: <53.000MB 📉 -32.2%) vs baseline: +4.7%

✅ start

Time: ✅ 16.054ms (SLO: <20.500ms 📉 -21.7%) vs baseline: +1.0%

Memory: ✅ 36.106MB (SLO: <53.000MB 📉 -31.9%) vs baseline: +5.1%

✅ start-finish

Time: ✅ 50.929ms (SLO: <52.500ms -3.0%) vs baseline: +0.9%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 52.344ms (SLO: <54.500ms -4.0%) vs baseline: +1.0%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.9%

✅ start-finish-traceid128

Time: ✅ 54.031ms (SLO: <57.000ms -5.2%) vs baseline: +0.8%

Memory: ✅ 34.387MB (SLO: <35.500MB -3.1%) vs baseline: +4.9%

✅ start-traceid128

Time: ✅ 16.379ms (SLO: <22.500ms 📉 -27.2%) vs baseline: +0.7%

Memory: ✅ 36.082MB (SLO: <53.000MB 📉 -31.9%) vs baseline: +4.5%

✅ update-name

Time: ✅ 16.614ms (SLO: <22.000ms 📉 -24.5%) vs baseline: +1.7%

Memory: ✅ 36.207MB (SLO: <53.000MB 📉 -31.7%) vs baseline: +4.7%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.955µs (SLO: <20.000µs 📉 -85.2%) vs baseline: ~same

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ 1-count-metrics-100-times

Time: ✅ 201.286µs (SLO: <220.000µs -8.5%) vs baseline: -1.1%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.6%

✅ 1-distribution-metric-1-times

Time: ✅ 3.366µs (SLO: <20.000µs 📉 -83.2%) vs baseline: +2.0%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ 1-distribution-metrics-100-times

Time: ✅ 218.630µs (SLO: <230.000µs -4.9%) vs baseline: -1.0%

Memory: ✅ 34.426MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ 1-gauge-metric-1-times

Time: ✅ 2.171µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +0.5%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +5.0%

✅ 1-gauge-metrics-100-times

Time: ✅ 137.534µs (SLO: <150.000µs -8.3%) vs baseline: +0.2%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +5.0%

✅ 1-rate-metric-1-times

Time: ✅ 3.113µs (SLO: <20.000µs 📉 -84.4%) vs baseline: +0.1%

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ 1-rate-metrics-100-times

Time: ✅ 215.421µs (SLO: <250.000µs 📉 -13.8%) vs baseline: ~same

Memory: ✅ 34.524MB (SLO: <35.500MB -2.7%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 20.001ms (SLO: <22.000ms -9.1%) vs baseline: -0.2%

Memory: ✅ 34.505MB (SLO: <35.500MB -2.8%) vs baseline: +5.2%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.242ms (SLO: <2.300ms -2.5%) vs baseline: -0.8%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.6%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.404ms (SLO: <1.550ms -9.4%) vs baseline: +0.7%

Memory: ✅ 34.465MB (SLO: <35.500MB -2.9%) vs baseline: +4.7%

✅ 100-rate-metrics-100-times

Time: ✅ 2.184ms (SLO: <2.550ms 📉 -14.4%) vs baseline: -1.0%

Memory: ✅ 34.446MB (SLO: <35.500MB -3.0%) vs baseline: +4.7%

✅ flush-1-metric

Time: ✅ 4.574µs (SLO: <20.000µs 📉 -77.1%) vs baseline: +1.3%

Memory: ✅ 34.544MB (SLO: <35.500MB -2.7%) vs baseline: +4.8%

✅ flush-100-metrics

Time: ✅ 173.831µs (SLO: <250.000µs 📉 -30.5%) vs baseline: -0.1%

Memory: ✅ 34.387MB (SLO: <35.500MB -3.1%) vs baseline: +4.8%

✅ flush-1000-metrics

Time: ✅ 2.138ms (SLO: <2.500ms 📉 -14.5%) vs baseline: +0.5%

Memory: ✅ 35.271MB (SLO: <36.500MB -3.4%) vs baseline: +5.0%

✅ tracer - 6/6

✅ large

Time: ✅ 29.124ms (SLO: <32.950ms 📉 -11.6%) vs baseline: -0.4%

Memory: ✅ 35.212MB (SLO: <36.500MB -3.5%) vs baseline: +5.1%

✅ medium

Time: ✅ 2.895ms (SLO: <3.200ms -9.5%) vs baseline: +0.7%

Memory: ✅ 34.092MB (SLO: <35.500MB -4.0%) vs baseline: +5.0%

✅ small

Time: ✅ 327.433µs (SLO: <370.000µs 📉 -11.5%) vs baseline: +0.5%

Memory: ✅ 34.072MB (SLO: <35.500MB -4.0%) vs baseline: +3.9%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

This updates system tests to pick up fixes for Injection tests which are currently breaking our CI. (cherry picked from commit c5b5e17)

taegyunkim · 2026-01-05T19:44:13Z

I believe this is needed for tests to pass on #15744

Was there a specific reason that you disabled automerge?

taegyunkim · 2026-01-05T19:50:45Z

OK, looks like there's an error in this system-tests.yaml file, which would have come from merge conflict. Let me retry the backport cleanly.

taegyunkim · 2026-01-05T20:00:11Z

tests: update system tests [backport 4.0] is the one to go with

KowalskiThomas requested review from a team as code owners December 23, 2025 12:04

KowalskiThomas requested review from brettlangdon and christophe-papazian December 23, 2025 12:04

KowalskiThomas changed the title ~~chore(ci): update system tests to 4.0~~ chore(ci): update system tests [backport 4.0] Dec 23, 2025

KowalskiThomas added the changelog/no-changelog A changelog entry is not required for this PR. label Dec 23, 2025

KowalskiThomas mentioned this pull request Dec 23, 2025

test: update system tests #15767

Merged

KowalskiThomas changed the title ~~chore(ci): update system tests [backport 4.0]~~ tests: update system tests [backport 4.0] Dec 23, 2025

avara1986 approved these changes Dec 23, 2025

View reviewed changes

KowalskiThomas enabled auto-merge (squash) December 23, 2025 12:40

test: update system tests (#15767)

9539cc3

This updates system tests to pick up fixes for Injection tests which are currently breaking our CI. (cherry picked from commit c5b5e17)

KowalskiThomas force-pushed the backport-15767-to-4.0 branch from 412ff77 to 9539cc3 Compare December 26, 2025 08:21

KowalskiThomas disabled auto-merge December 31, 2025 15:56

brettlangdon approved these changes Jan 5, 2026

View reviewed changes

taegyunkim closed this Jan 5, 2026

tests: update system tests [backport 4.0] #15770

tests: update system tests [backport 4.0] #15770

Conversation

KowalskiThomas commented Dec 23, 2025

Description

Uh oh!

github-actions bot commented Dec 23, 2025

Uh oh!

github-actions bot commented Dec 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Dec 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ ospathbasename_aspect

✅ ospathbasename_noaspect

✅ ospathjoin_aspect

✅ ospathjoin_noaspect

✅ ospathnormcase_aspect

✅ ospathnormcase_noaspect

✅ ospathsplit_aspect

✅ ospathsplit_noaspect

✅ ospathsplitdrive_aspect

✅ ospathsplitdrive_noaspect

✅ ospathsplitext_aspect

✅ ospathsplitext_noaspect

✅ appsec-get

✅ appsec-post

✅ appsec-telemetry

✅ debugger

✅ iast-get

✅ profiler

✅ resource-renaming

✅ tracer

✅ tracer-native

✅ cache_off

✅ cache_on

⚠️ context_with_data_listeners

✅ context_with_data_no_listeners

✅ get_item_exists

✅ get_item_missing

✅ set_item

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ resource-renaming

✅ span-code-origin

✅ tracer

✅ tracer-and-profiler

✅ tracer-dont-create-db-spans

✅ tracer-minimal

✅ tracer-native

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-enabled

✅ iast-enabled

✅ tracer-enabled

✅ all_styles_all_headers

✅ b3_headers

✅ b3_single_headers

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

✅ empty_headers

✅ full_t_id_datadog_headers

✅ invalid_priority_header

✅ invalid_span_id_header

✅ invalid_tags_header

✅ invalid_trace_id_header

github-actions bot commented Dec 23, 2025 •

edited

Loading

pr-commenter bot commented Dec 23, 2025 •

edited

Loading