Skip to content

Fix exploration tests #10473

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
jpbempel wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Fix exploration tests #10473

jpbempel wants to merge 1 commit into from

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Jan 29, 2026 •
edited by atlassian bot
Loading

What Does This Do

disable proxy tests for jsoup
update jackson-base to point on a stable release

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-5044

@pr-commenter
Copy link

pr-commenter bot commented Jan 29, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-jsoup
git_commit_date 1769699414 1769763271
git_commit_sha 7b4f50c e32e4ab
release_version 1.59.0-SNAPSHOT~7b4f50cd76 1.59.0-SNAPSHOT~e32e4ab898
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769765086 1769765086
ci_job_id 1389259187 1389259187
ci_pipeline_id 93770754 93770754
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-39gul3mb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-39gul3mb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055845
Total [baseline] (10.942 s) : 0, 10942129
Agent [candidate] (1.066 s) : 0, 1066079
Total [candidate] (11.012 s) : 0, 11012465
section appsec
Agent [baseline] (1.232 s) : 0, 1231756
Total [baseline] (10.999 s) : 0, 10998879
Agent [candidate] (1.232 s) : 0, 1232296
Total [candidate] (11.063 s) : 0, 11063075
section iast
Agent [baseline] (1.231 s) : 0, 1231141
Total [baseline] (11.169 s) : 0, 11169431
Agent [candidate] (1.231 s) : 0, 1231490
Total [candidate] (11.165 s) : 0, 11165137
section profiling
Agent [baseline] (1.191 s) : 0, 1190720
Total [baseline] (11.034 s) : 0, 11033901
Agent [candidate] (1.187 s) : 0, 1186616
Total [candidate] (10.962 s) : 0, 10961892
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.232 s 175.911 ms (16.7%)
Agent iast 1.231 s 175.296 ms (16.6%)
Agent profiling 1.191 s 134.875 ms (12.8%)
Total tracing 10.942 s -
Total appsec 10.999 s 56.75 ms (0.5%)
Total iast 11.169 s 227.302 ms (2.1%)
Total profiling 11.034 s 91.773 ms (0.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.232 s 166.217 ms (15.6%)
Agent iast 1.231 s 165.411 ms (15.5%)
Agent profiling 1.187 s 120.537 ms (11.3%)
Total tracing 11.012 s -
Total appsec 11.063 s 50.61 ms (0.5%)
Total iast 11.165 s 152.672 ms (1.4%)
Total profiling 10.962 s -50.573 ms (-0.5%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (622.944 ms) : 0, 622944
BytebuddyAgent [candidate] (626.934 ms) : 0, 626934
AgentMeter [baseline] (28.736 ms) : 0, 28736
AgentMeter [candidate] (29.079 ms) : 0, 29079
GlobalTracer [baseline] (256.693 ms) : 0, 256693
GlobalTracer [candidate] (259.678 ms) : 0, 259678
AppSec [baseline] (32.722 ms) : 0, 32722
AppSec [candidate] (33.092 ms) : 0, 33092
Debugger [baseline] (61.727 ms) : 0, 61727
Debugger [candidate] (61.923 ms) : 0, 61923
Remote Config [baseline] (617.77 µs) : 0, 618
Remote Config [candidate] (625.604 µs) : 0, 626
Telemetry [baseline] (9.935 ms) : 0, 9935
Telemetry [candidate] (10.247 ms) : 0, 10247
Flare Poller [baseline] (6.021 ms) : 0, 6021
Flare Poller [candidate] (7.754 ms) : 0, 7754
section appsec
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (651.944 ms) : 0, 651944
BytebuddyAgent [candidate] (652.275 ms) : 0, 652275
AgentMeter [baseline] (11.878 ms) : 0, 11878
AgentMeter [candidate] (11.851 ms) : 0, 11851
GlobalTracer [baseline] (257.626 ms) : 0, 257626
GlobalTracer [candidate] (257.445 ms) : 0, 257445
IAST [baseline] (25.31 ms) : 0, 25310
IAST [candidate] (25.189 ms) : 0, 25189
AppSec [baseline] (167.688 ms) : 0, 167688
AppSec [candidate] (167.692 ms) : 0, 167692
Debugger [baseline] (67.291 ms) : 0, 67291
Debugger [candidate] (67.856 ms) : 0, 67856
Remote Config [baseline] (682.049 µs) : 0, 682
Remote Config [candidate] (653.485 µs) : 0, 653
Telemetry [baseline] (9.232 ms) : 0, 9232
Telemetry [candidate] (9.303 ms) : 0, 9303
Flare Poller [baseline] (3.646 ms) : 0, 3646
Flare Poller [candidate] (3.629 ms) : 0, 3629
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (793.805 ms) : 0, 793805
BytebuddyAgent [candidate] (793.768 ms) : 0, 793768
AgentMeter [baseline] (11.239 ms) : 0, 11239
AgentMeter [candidate] (11.21 ms) : 0, 11210
GlobalTracer [baseline] (248.846 ms) : 0, 248846
GlobalTracer [candidate] (249.096 ms) : 0, 249096
IAST [baseline] (26.943 ms) : 0, 26943
IAST [candidate] (26.84 ms) : 0, 26840
AppSec [baseline] (32.97 ms) : 0, 32970
AppSec [candidate] (32.18 ms) : 0, 32180
Debugger [baseline] (68.121 ms) : 0, 68121
Debugger [candidate] (69.032 ms) : 0, 69032
Remote Config [baseline] (553.033 µs) : 0, 553
Remote Config [candidate] (539.612 µs) : 0, 540
Telemetry [baseline] (8.587 ms) : 0, 8587
Telemetry [candidate] (8.624 ms) : 0, 8624
Flare Poller [baseline] (3.506 ms) : 0, 3506
Flare Poller [candidate] (3.506 ms) : 0, 3506
section profiling
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (681.326 ms) : 0, 681326
BytebuddyAgent [candidate] (677.946 ms) : 0, 677946
AgentMeter [baseline] (8.688 ms) : 0, 8688
AgentMeter [candidate] (8.705 ms) : 0, 8705
GlobalTracer [baseline] (216.947 ms) : 0, 216947
GlobalTracer [candidate] (216.914 ms) : 0, 216914
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.396 ms) : 0, 32396
Debugger [baseline] (67.816 ms) : 0, 67816
Debugger [candidate] (67.426 ms) : 0, 67426
Remote Config [baseline] (586.659 µs) : 0, 587
Remote Config [candidate] (581.814 µs) : 0, 582
Telemetry [baseline] (8.74 ms) : 0, 8740
Telemetry [candidate] (8.644 ms) : 0, 8644
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.751 ms) : 0, 3751
ProfilingAgent [baseline] (99.198 ms) : 0, 99198
ProfilingAgent [candidate] (99.05 ms) : 0, 99050
Profiling [baseline] (99.762 ms) : 0, 99762
Profiling [candidate] (99.62 ms) : 0, 99620
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055338
Total [baseline] (8.748 s) : 0, 8747758
Agent [candidate] (1.057 s) : 0, 1057208
Total [candidate] (8.764 s) : 0, 8763547
section iast
Agent [baseline] (1.235 s) : 0, 1235323
Total [baseline] (9.401 s) : 0, 9400683
Agent [candidate] (1.227 s) : 0, 1226777
Total [candidate] (9.363 s) : 0, 9363087
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.235 s 179.986 ms (17.1%)
Total tracing 8.748 s -
Total iast 9.401 s 652.925 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.227 s 169.569 ms (16.0%)
Total tracing 8.764 s -
Total iast 9.363 s 599.541 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (622.223 ms) : 0, 622223
BytebuddyAgent [candidate] (623.937 ms) : 0, 623937
AgentMeter [baseline] (28.661 ms) : 0, 28661
AgentMeter [candidate] (28.721 ms) : 0, 28721
GlobalTracer [baseline] (256.526 ms) : 0, 256526
GlobalTracer [candidate] (257.251 ms) : 0, 257251
AppSec [baseline] (32.878 ms) : 0, 32878
AppSec [candidate] (32.906 ms) : 0, 32906
Debugger [baseline] (61.045 ms) : 0, 61045
Debugger [candidate] (61.088 ms) : 0, 61088
Remote Config [baseline] (620.332 µs) : 0, 620
Remote Config [candidate] (610.529 µs) : 0, 611
Telemetry [baseline] (9.157 ms) : 0, 9157
Telemetry [candidate] (9.191 ms) : 0, 9191
Flare Poller [baseline] (7.634 ms) : 0, 7634
Flare Poller [candidate] (6.914 ms) : 0, 6914
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (796.639 ms) : 0, 796639
BytebuddyAgent [candidate] (790.884 ms) : 0, 790884
AgentMeter [baseline] (11.418 ms) : 0, 11418
AgentMeter [candidate] (11.244 ms) : 0, 11244
GlobalTracer [baseline] (249.478 ms) : 0, 249478
GlobalTracer [candidate] (248.456 ms) : 0, 248456
IAST [baseline] (27.328 ms) : 0, 27328
IAST [candidate] (26.82 ms) : 0, 26820
AppSec [baseline] (34.301 ms) : 0, 34301
AppSec [candidate] (33.165 ms) : 0, 33165
Debugger [baseline] (66.649 ms) : 0, 66649
Debugger [candidate] (67.173 ms) : 0, 67173
Remote Config [baseline] (544.952 µs) : 0, 545
Remote Config [candidate] (548.115 µs) : 0, 548
Telemetry [baseline] (8.661 ms) : 0, 8661
Telemetry [candidate] (8.499 ms) : 0, 8499
Flare Poller [baseline] (3.578 ms) : 0, 3578
Flare Poller [candidate] (3.467 ms) : 0, 3467
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-jsoup
git_commit_date 1769699414 1769763271
git_commit_sha 7b4f50c e32e4ab
release_version 1.59.0-SNAPSHOT~7b4f50cd76 1.59.0-SNAPSHOT~e32e4ab898
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769765804 1769765804
ci_job_id 1389259191 1389259191
ci_pipeline_id 93770754 93770754
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-8lb97hvz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-8lb97hvz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 17 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+159.449µs; +285.030µs] or [+6.077%; +10.863%]		 worse
[+310.768µs; +847.136µs] or [+4.112%; +11.210%]		 unstable
[-259.002op/s; +40.752op/s] or [-19.046%; +2.997%]		 2.846ms 8.136ms 1250.719op/s 2.624ms 7.557ms 1359.844op/s
scenario:load:insecure-bank:iast:high_load worse
[+62.064µs; +215.229µs] or [+2.510%; +8.703%]		 unsure
[+82.593µs; +811.242µs] or [+1.127%; +11.065%]		 unstable
[-213.484op/s; +105.859op/s] or [-14.969%; +7.422%]		 2.612ms 7.778ms 1372.406op/s 2.473ms 7.331ms 1426.219op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.957 ms) : 18768, 19145
.   : milestone, 18957,
appsec (18.358 ms) : 18170, 18545
.   : milestone, 18358,
code_origins (17.68 ms) : 17505, 17854
.   : milestone, 17680,
iast (18.526 ms) : 18342, 18710
.   : milestone, 18526,
profiling (18.725 ms) : 18537, 18913
.   : milestone, 18725,
tracing (17.635 ms) : 17461, 17808
.   : milestone, 17635,
section candidate
no_agent (18.902 ms) : 18713, 19090
.   : milestone, 18902,
appsec (18.552 ms) : 18362, 18741
.   : milestone, 18552,
code_origins (17.611 ms) : 17437, 17785
.   : milestone, 17611,
iast (18.36 ms) : 18176, 18544
.   : milestone, 18360,
profiling (18.333 ms) : 18149, 18517
.   : milestone, 18333,
tracing (17.789 ms) : 17613, 17965
.   : milestone, 17789,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.957 ms [18.768 ms, 19.145 ms] -
appsec 18.358 ms [18.17 ms, 18.545 ms] -599.192 µs (-3.2%)
code_origins 17.68 ms [17.505 ms, 17.854 ms] -1.277 ms (-6.7%)
iast 18.526 ms [18.342 ms, 18.71 ms] -430.655 µs (-2.3%)
profiling 18.725 ms [18.537 ms, 18.913 ms] -231.595 µs (-1.2%)
tracing 17.635 ms [17.461 ms, 17.808 ms] -1.322 ms (-7.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.902 ms [18.713 ms, 19.09 ms] -
appsec 18.552 ms [18.362 ms, 18.741 ms] -350.024 µs (-1.9%)
code_origins 17.611 ms [17.437 ms, 17.785 ms] -1.291 ms (-6.8%)
iast 18.36 ms [18.176 ms, 18.544 ms] -541.718 µs (-2.9%)
profiling 18.333 ms [18.149 ms, 18.517 ms] -568.648 µs (-3.0%)
tracing 17.789 ms [17.613 ms, 17.965 ms] -1.112 ms (-5.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.176 ms) : 1164, 1187
.   : milestone, 1176,
iast (3.209 ms) : 3164, 3254
.   : milestone, 3209,
iast_FULL (6.095 ms) : 6033, 6157
.   : milestone, 6095,
iast_GLOBAL (3.369 ms) : 3317, 3421
.   : milestone, 3369,
profiling (2.149 ms) : 2127, 2170
.   : milestone, 2149,
tracing (1.758 ms) : 1744, 1772
.   : milestone, 1758,
section candidate
no_agent (1.176 ms) : 1165, 1188
.   : milestone, 1176,
iast (3.336 ms) : 3293, 3379
.   : milestone, 3336,
iast_FULL (5.91 ms) : 5850, 5970
.   : milestone, 5910,
iast_GLOBAL (3.668 ms) : 3605, 3732
.   : milestone, 3668,
profiling (2.343 ms) : 2320, 2365
.   : milestone, 2343,
tracing (1.788 ms) : 1773, 1802
.   : milestone, 1788,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.164 ms, 1.187 ms] -
iast 3.209 ms [3.164 ms, 3.254 ms] 2.033 ms (172.9%)
iast_FULL 6.095 ms [6.033 ms, 6.157 ms] 4.919 ms (418.3%)
iast_GLOBAL 3.369 ms [3.317 ms, 3.421 ms] 2.193 ms (186.5%)
profiling 2.149 ms [2.127 ms, 2.17 ms] 972.764 µs (82.7%)
tracing 1.758 ms [1.744 ms, 1.772 ms] 581.625 µs (49.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.165 ms, 1.188 ms] -
iast 3.336 ms [3.293 ms, 3.379 ms] 2.16 ms (183.7%)
iast_FULL 5.91 ms [5.85 ms, 5.97 ms] 4.734 ms (402.5%)
iast_GLOBAL 3.668 ms [3.605 ms, 3.732 ms] 2.492 ms (211.9%)
profiling 2.343 ms [2.32 ms, 2.365 ms] 1.167 ms (99.2%)
tracing 1.788 ms [1.773 ms, 1.802 ms] 611.523 µs (52.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-jsoup
git_commit_date 1769699414 1769763271
git_commit_sha 7b4f50c e32e4ab
release_version 1.59.0-SNAPSHOT~7b4f50cd76 1.59.0-SNAPSHOT~e32e4ab898
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769765474 1769765474
ci_job_id 1389259193 1389259193
ci_pipeline_id 93770754 93770754
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-0sb8g04s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-0sb8g04s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,
appsec (15.106 s) : 15106000, 15106000
.   : milestone, 15106000,
iast (18.593 s) : 18593000, 18593000
.   : milestone, 18593000,
iast_GLOBAL (17.783 s) : 17783000, 17783000
.   : milestone, 17783000,
profiling (15.06 s) : 15060000, 15060000
.   : milestone, 15060000,
tracing (14.538 s) : 14538000, 14538000
.   : milestone, 14538000,
section candidate
no_agent (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
appsec (14.681 s) : 14681000, 14681000
.   : milestone, 14681000,
iast (18.204 s) : 18204000, 18204000
.   : milestone, 18204000,
iast_GLOBAL (17.69 s) : 17690000, 17690000
.   : milestone, 17690000,
profiling (15.599 s) : 15599000, 15599000
.   : milestone, 15599000,
tracing (14.568 s) : 14568000, 14568000
.   : milestone, 14568000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.83 s [14.83 s, 14.83 s] -
appsec 15.106 s [15.106 s, 15.106 s] 276.0 ms (1.9%)
iast 18.593 s [18.593 s, 18.593 s] 3.763 s (25.4%)
iast_GLOBAL 17.783 s [17.783 s, 17.783 s] 2.953 s (19.9%)
profiling 15.06 s [15.06 s, 15.06 s] 230.0 ms (1.6%)
tracing 14.538 s [14.538 s, 14.538 s] -292.0 ms (-2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.872 s [14.872 s, 14.872 s] -
appsec 14.681 s [14.681 s, 14.681 s] -191.0 ms (-1.3%)
iast 18.204 s [18.204 s, 18.204 s] 3.332 s (22.4%)
iast_GLOBAL 17.69 s [17.69 s, 17.69 s] 2.818 s (18.9%)
profiling 15.599 s [15.599 s, 15.599 s] 727.0 ms (4.9%)
tracing 14.568 s [14.568 s, 14.568 s] -304.0 ms (-2.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~e32e4ab898, baseline=1.59.0-SNAPSHOT~7b4f50cd76
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.76 ms) : 3535, 3984
.   : milestone, 3760,
iast (2.265 ms) : 2195, 2335
.   : milestone, 2265,
iast_GLOBAL (2.304 ms) : 2234, 2373
.   : milestone, 2304,
profiling (2.116 ms) : 2058, 2173
.   : milestone, 2116,
tracing (2.088 ms) : 2034, 2142
.   : milestone, 2088,
section candidate
no_agent (1.478 ms) : 1467, 1490
.   : milestone, 1478,
appsec (3.752 ms) : 3531, 3972
.   : milestone, 3752,
iast (2.268 ms) : 2198, 2337
.   : milestone, 2268,
iast_GLOBAL (2.302 ms) : 2232, 2371
.   : milestone, 2302,
profiling (2.087 ms) : 2032, 2142
.   : milestone, 2087,
tracing (2.075 ms) : 2021, 2129
.   : milestone, 2075,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 3.76 ms [3.535 ms, 3.984 ms] 2.287 ms (155.4%)
iast 2.265 ms [2.195 ms, 2.335 ms] 792.786 µs (53.8%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.373 ms] 831.363 µs (56.5%)
profiling 2.116 ms [2.058 ms, 2.173 ms] 643.566 µs (43.7%)
tracing 2.088 ms [2.034 ms, 2.142 ms] 615.541 µs (41.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.467 ms, 1.49 ms] -
appsec 3.752 ms [3.531 ms, 3.972 ms] 2.273 ms (153.8%)
iast 2.268 ms [2.198 ms, 2.337 ms] 789.098 µs (53.4%)
iast_GLOBAL 2.302 ms [2.232 ms, 2.371 ms] 823.183 µs (55.7%)
profiling 2.087 ms [2.032 ms, 2.142 ms] 608.179 µs (41.1%)
tracing 2.075 ms [2.021 ms, 2.129 ms] 596.604 µs (40.4%)

@pr-commenter
Copy link

pr-commenter bot commented Jan 30, 2026 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1769763790 1769764136
end_time 2026-01-30T09:04:31 2026-01-30T09:10:16
git_branch master jpbempel/fix-jsoup
git_commit_sha 02cc483 e32e4ab
start_time 2026-01-30T09:03:11 2026-01-30T09:08:57
See matching parameters
Baseline Candidate
ci_job_id 1389259209 1389259209
ci_pipeline_id 93770754 93770754
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1769763271 1769763271

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-52.528µs; +23.263µs] or [-18.251%; +8.083%]		 unstable
[-73.319µs; +27.781µs] or [-22.020%; +8.344%]		 unstable
[-82.286µs; +34.038µs] or [-23.652%; +9.784%]		 unstable
[-437.786µs; +286.992µs] or [-40.051%; +26.256%]		 unstable
[-93.859op/s; +155.588op/s] or [-3.801%; +6.301%]
scenario:basic same same same unstable
[-27.162µs; +200.019µs] or [-3.495%; +25.734%]		 unstable
[-117.985op/s; +260.232op/s] or [-4.483%; +9.889%]
scenario:loop unsure
[-10.172µs; -3.179µs] or [-0.115%; -0.036%]		 unsure
[-11.153µs; -1.766µs] or [-0.124%; -0.020%]		 same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (332.961 µs) : 270, 396
.   : milestone, 333,
basic (275.854 µs) : 269, 283
.   : milestone, 276,
loop (8.962 ms) : 8958, 8967
.   : milestone, 8962,
section candidate
noprobe (310.192 µs) : 285, 336
.   : milestone, 310,
basic (275.75 µs) : 270, 282
.   : milestone, 276,
loop (8.956 ms) : 8952, 8960
.   : milestone, 8956,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 332.961 µs [269.891 µs, 396.032 µs]
basic 275.854 µs [268.515 µs, 283.192 µs]
loop 8.962 ms [8.958 ms, 8.967 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 310.192 µs [284.618 µs, 335.767 µs]
basic 275.75 µs [269.671 µs, 281.83 µs]
loop 8.956 ms [8.952 ms, 8.96 ms]

@jpbempel jpbempel force-pushed the jpbempel/fix-jsoup branch 2 times, most recently from 2234010 to 4653a38 Compare January 30, 2026 07:44
@jpbempel
Fix exploration tests
e32e4ab 
disable proxy tests for jsoup
update jackson-base to point on a stable release
@jpbempel jpbempel changed the title DRAFT Fix exploration tests Jan 30, 2026
@jpbempel jpbempel marked this pull request as ready for review January 30, 2026 09:26
@jpbempel jpbempel requested review from a team as code owners January 30, 2026 09:26
@jpbempel jpbempel requested review from erikayasuda and ojung and removed request for a team January 30, 2026 09:26
@github-actions
Copy link
Contributor

github-actions bot commented Jan 30, 2026 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: bug Bug report and fix labels Jan 30, 2026
@jpbempel jpbempel requested review from evanchooly and removed request for ojung January 30, 2026 13:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@erikayasuda erikayasuda Awaiting requested review from erikayasuda erikayasuda is a code owner automatically assigned from DataDog/apm-release-platform

@evanchooly evanchooly Awaiting requested review from evanchooly

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jpbempel