Skip to content

Update latest tracing benchmark SLOs#11284

Open
sarahchen6 wants to merge 1 commit intomasterfrom
sarahchen6/update-load-thresholds
Open

Update latest tracing benchmark SLOs#11284
sarahchen6 wants to merge 1 commit intomasterfrom
sarahchen6/update-load-thresholds

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

@sarahchen6 sarahchen6 commented May 5, 2026

What Does This Do

Update latest macrobenchmark benchmark failure thresholds based on automatically generated SLOs. Exact changes include:

  • normal_operation/only-tracing:
    • tighten agg_http_req_duration_p50 by 3.5%
    • tighten agg_http_req_duration_p99 by 1.7%
  • normal_operation/otel-latest:
    • tighten agg_http_req_duration_p50 by 3.5%
    • loosen agg_http_req_duration_p99 by 4.8%
  • high_load/only-tracing:
    • loosen throughput by 5.2%
  • high_load/otel-latest:
    • loosen throughput by 3.2%

Motivation

The benchmarks are stable according to the APM SDKs Perf SLOs dashboard, but they have been emitting warnings for the past few weeks. Loosen the threshold with T=15% to avoid these noisy warnings while still maintaining a strict bound. The values were auto-generated based on the latest runs of master, so even with the increase of T from 10 to 15%, some thresholds tightened.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 requested a review from a team as a code owner May 5, 2026 17:51
@sarahchen6 sarahchen6 added the tag: no release notes Changes to exclude from release notes label May 5, 2026
@sarahchen6 sarahchen6 requested review from randomanderson and removed request for a team May 5, 2026 17:51
@sarahchen6 sarahchen6 added the comp: tooling Build & Tooling label May 5, 2026
@sarahchen6 sarahchen6 requested a review from bric3 May 5, 2026 17:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant