Atomics benchmark by dougqh · Pull Request #10862 · DataDog/dd-trace-java

dougqh · 2026-03-16T18:46:09Z

Benchmark to show cost of Atomic vs AtomicFieldUpdater

What Does This Do

Benchmark to show cost of Atomic vs AtomicFieldUpdater

Overall conclusion is to favor AtomicFieldUpdater when possible.
While Atomic is sometimes slightly better in ops/sec, AtomicFieldUpdater reduces memory footprint which is typically more important for the system as a whole

Motivation

Provide and illustrate recommendations to follow when contributing to the Java agent

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

Benchmark to show cost of Atomic vs AtomicFieldUpdater

github-actions · 2026-03-16T18:46:23Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2026-03-16T19:31:09Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/atomics-benchmark
git_commit_date	1773686106	1773686814
git_commit_sha	`3c59e03`	`a18c330`
release_version	1.61.0-SNAPSHOT~3c59e03c2c	1.61.0-SNAPSHOT~a18c330344

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773688572	1773688572
ci_job_id	1510192425	1510192425
ci_pipeline_id	102772893	102772893
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-tjd6s88f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-tjd6s88f 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058134
Total [baseline] (8.851 s) : 0, 8850769
Agent [candidate] (1.07 s) : 0, 1070240
Total [candidate] (8.892 s) : 0, 8891526
section iast
Agent [baseline] (1.224 s) : 0, 1224129
Total [baseline] (9.581 s) : 0, 9581023
Agent [candidate] (1.228 s) : 0, 1227589
Total [candidate] (9.585 s) : 0, 9585066

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.224 s	165.995 ms (15.7%)
Total	tracing	8.851 s	-
Total	iast	9.581 s	730.253 ms (8.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.07 s	-
Agent	iast	1.228 s	157.35 ms (14.7%)
Total	tracing	8.892 s	-
Total	iast	9.585 s	693.54 ms (7.8%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (628.028 ms) : 0, 628028
BytebuddyAgent [candidate] (636.812 ms) : 0, 636812
AgentMeter [baseline] (29.286 ms) : 0, 29286
AgentMeter [candidate] (29.489 ms) : 0, 29489
GlobalTracer [baseline] (257.262 ms) : 0, 257262
GlobalTracer [candidate] (260.129 ms) : 0, 260129
AppSec [baseline] (31.609 ms) : 0, 31609
AppSec [candidate] (32.07 ms) : 0, 32070
Debugger [baseline] (58.818 ms) : 0, 58818
Debugger [candidate] (59.704 ms) : 0, 59704
Remote Config [baseline] (586.633 µs) : 0, 587
Remote Config [candidate] (600.677 µs) : 0, 601
Telemetry [baseline] (8.024 ms) : 0, 8024
Telemetry [candidate] (8.129 ms) : 0, 8129
Flare Poller [baseline] (7.191 ms) : 0, 7191
Flare Poller [candidate] (5.747 ms) : 0, 5747
section iast
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (794.314 ms) : 0, 794314
BytebuddyAgent [candidate] (795.388 ms) : 0, 795388
AgentMeter [baseline] (11.33 ms) : 0, 11330
AgentMeter [candidate] (11.418 ms) : 0, 11418
GlobalTracer [baseline] (247.197 ms) : 0, 247197
GlobalTracer [candidate] (248.854 ms) : 0, 248854
AppSec [baseline] (26.427 ms) : 0, 26427
AppSec [candidate] (26.656 ms) : 0, 26656
Debugger [baseline] (62.585 ms) : 0, 62585
Debugger [candidate] (62.834 ms) : 0, 62834
Remote Config [baseline] (511.73 µs) : 0, 512
Remote Config [candidate] (503.202 µs) : 0, 503
Telemetry [baseline] (14.245 ms) : 0, 14245
Telemetry [candidate] (14.209 ms) : 0, 14209
Flare Poller [baseline] (4.902 ms) : 0, 4902
Flare Poller [candidate] (4.918 ms) : 0, 4918
IAST [baseline] (25.296 ms) : 0, 25296
IAST [candidate] (25.485 ms) : 0, 25485

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071041
Total [baseline] (11.136 s) : 0, 11135538
Agent [candidate] (1.06 s) : 0, 1060416
Total [candidate] (11.165 s) : 0, 11164876
section appsec
Agent [baseline] (1.247 s) : 0, 1247015
Total [baseline] (11.238 s) : 0, 11238166
Agent [candidate] (1.252 s) : 0, 1252338
Total [candidate] (11.166 s) : 0, 11166042
section iast
Agent [baseline] (1.228 s) : 0, 1227670
Total [baseline] (11.346 s) : 0, 11346449
Agent [candidate] (1.227 s) : 0, 1227461
Total [candidate] (11.338 s) : 0, 11337549
section profiling
Agent [baseline] (1.182 s) : 0, 1182107
Total [baseline] (11.136 s) : 0, 11135744
Agent [candidate] (1.186 s) : 0, 1186448
Total [candidate] (11.107 s) : 0, 11107470

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.071 s	-
Agent	appsec	1.247 s	175.974 ms (16.4%)
Agent	iast	1.228 s	156.629 ms (14.6%)
Agent	profiling	1.182 s	111.066 ms (10.4%)
Total	tracing	11.136 s	-
Total	appsec	11.238 s	102.628 ms (0.9%)
Total	iast	11.346 s	210.911 ms (1.9%)
Total	profiling	11.136 s	205.917 µs (0.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	appsec	1.252 s	191.922 ms (18.1%)
Agent	iast	1.227 s	167.045 ms (15.8%)
Agent	profiling	1.186 s	126.032 ms (11.9%)
Total	tracing	11.165 s	-
Total	appsec	11.166 s	1.166 ms (0.0%)
Total	iast	11.338 s	172.673 ms (1.5%)
Total	profiling	11.107 s	-57.406 ms (-0.5%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.22 ms) : 0, 1220
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (636.456 ms) : 0, 636456
BytebuddyAgent [candidate] (628.422 ms) : 0, 628422
AgentMeter [baseline] (29.51 ms) : 0, 29510
AgentMeter [candidate] (29.131 ms) : 0, 29131
GlobalTracer [baseline] (259.739 ms) : 0, 259739
GlobalTracer [candidate] (257.888 ms) : 0, 257888
AppSec [baseline] (32.146 ms) : 0, 32146
AppSec [candidate] (31.747 ms) : 0, 31747
Debugger [baseline] (60.313 ms) : 0, 60313
Debugger [candidate] (59.553 ms) : 0, 59553
Remote Config [baseline] (607.779 µs) : 0, 608
Remote Config [candidate] (591.333 µs) : 0, 591
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.014 ms) : 0, 8014
Flare Poller [baseline] (6.545 ms) : 0, 6545
Flare Poller [candidate] (7.867 ms) : 0, 7867
section appsec
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.211 ms) : 0, 1211
BytebuddyAgent [baseline] (658.263 ms) : 0, 658263
BytebuddyAgent [candidate] (663.307 ms) : 0, 663307
AgentMeter [baseline] (12.101 ms) : 0, 12101
AgentMeter [candidate] (12.116 ms) : 0, 12116
GlobalTracer [baseline] (258.645 ms) : 0, 258645
GlobalTracer [candidate] (259.236 ms) : 0, 259236
AppSec [baseline] (177.79 ms) : 0, 177790
AppSec [candidate] (177.806 ms) : 0, 177806
Debugger [baseline] (66.021 ms) : 0, 66021
Debugger [candidate] (65.571 ms) : 0, 65571
Remote Config [baseline] (617.879 µs) : 0, 618
Remote Config [candidate] (627.073 µs) : 0, 627
Telemetry [baseline] (8.211 ms) : 0, 8211
Telemetry [candidate] (8.218 ms) : 0, 8218
Flare Poller [baseline] (3.586 ms) : 0, 3586
Flare Poller [candidate] (3.608 ms) : 0, 3608
IAST [baseline] (24.226 ms) : 0, 24226
IAST [candidate] (24.146 ms) : 0, 24146
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (796.21 ms) : 0, 796210
BytebuddyAgent [candidate] (795.904 ms) : 0, 795904
AgentMeter [baseline] (11.378 ms) : 0, 11378
AgentMeter [candidate] (11.378 ms) : 0, 11378
GlobalTracer [baseline] (247.686 ms) : 0, 247686
GlobalTracer [candidate] (247.712 ms) : 0, 247712
AppSec [baseline] (26.566 ms) : 0, 26566
AppSec [candidate] (27.36 ms) : 0, 27360
Debugger [baseline] (70.072 ms) : 0, 70072
Debugger [candidate] (69.334 ms) : 0, 69334
Remote Config [baseline] (528.137 µs) : 0, 528
Remote Config [candidate] (525.673 µs) : 0, 526
Telemetry [baseline] (9.196 ms) : 0, 9196
Telemetry [candidate] (9.188 ms) : 0, 9188
Flare Poller [baseline] (3.359 ms) : 0, 3359
Flare Poller [candidate] (3.341 ms) : 0, 3341
IAST [baseline] (25.332 ms) : 0, 25332
IAST [candidate] (25.31 ms) : 0, 25310
section profiling
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.164 ms) : 0, 1164
BytebuddyAgent [baseline] (682.397 ms) : 0, 682397
BytebuddyAgent [candidate] (684.593 ms) : 0, 684593
AgentMeter [baseline] (8.635 ms) : 0, 8635
AgentMeter [candidate] (8.686 ms) : 0, 8686
GlobalTracer [baseline] (215.526 ms) : 0, 215526
GlobalTracer [candidate] (216.936 ms) : 0, 216936
AppSec [baseline] (32.267 ms) : 0, 32267
AppSec [candidate] (32.468 ms) : 0, 32468
Debugger [baseline] (64.628 ms) : 0, 64628
Debugger [candidate] (64.28 ms) : 0, 64280
Remote Config [baseline] (580.971 µs) : 0, 581
Remote Config [candidate] (583.834 µs) : 0, 584
Telemetry [baseline] (7.641 ms) : 0, 7641
Telemetry [candidate] (9.202 ms) : 0, 9202
Flare Poller [baseline] (4.254 ms) : 0, 4254
Flare Poller [candidate] (3.492 ms) : 0, 3492
ProfilingAgent [baseline] (94.152 ms) : 0, 94152
ProfilingAgent [candidate] (94.081 ms) : 0, 94081
Profiling [baseline] (94.721 ms) : 0, 94721
Profiling [candidate] (94.649 ms) : 0, 94649

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/atomics-benchmark
git_commit_date	1773686106	1773686814
git_commit_sha	`3c59e03`	`a18c330`
release_version	1.61.0-SNAPSHOT~3c59e03c2c	1.61.0-SNAPSHOT~a18c330344

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773688978	1773688978
ci_job_id	1510192426	1510192426
ci_pipeline_id	102772893	102772893
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-c6ym27se 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-c6ym27se 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+70.772µs; +138.114µs] or [+2.899%; +5.658%]	unsure [+19.490µs; +444.727µs] or [+0.271%; +6.174%]	unstable [-200.708op/s; +106.021op/s] or [-13.802%; +7.291%]	2.545ms	7.436ms	1406.812op/s	2.441ms	7.204ms	1454.156op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	worse [+67.643µs; +173.053µs] or [+2.446%; +6.257%]	unsure [+53.950µs; +445.287µs] or [+0.693%; +5.718%]	unstable [-173.793op/s; +104.231op/s] or [-13.377%; +8.023%]	2.886ms	8.037ms	1264.406op/s	2.766ms	7.787ms	1299.188op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.191 ms) : 1179, 1203
.   : milestone, 1191,
iast (3.145 ms) : 3103, 3187
.   : milestone, 3145,
iast_FULL (6.084 ms) : 6022, 6146
.   : milestone, 6084,
iast_GLOBAL (3.53 ms) : 3467, 3593
.   : milestone, 3530,
profiling (2.25 ms) : 2229, 2272
.   : milestone, 2250,
tracing (1.821 ms) : 1804, 1839
.   : milestone, 1821,
section candidate
no_agent (1.171 ms) : 1160, 1183
.   : milestone, 1171,
iast (3.252 ms) : 3209, 3295
.   : milestone, 3252,
iast_FULL (5.905 ms) : 5845, 5965
.   : milestone, 5905,
iast_GLOBAL (3.629 ms) : 3568, 3689
.   : milestone, 3629,
profiling (2.267 ms) : 2244, 2289
.   : milestone, 2267,
tracing (1.833 ms) : 1817, 1849
.   : milestone, 1833,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.191 ms [1.179 ms, 1.203 ms]	-
iast	3.145 ms [3.103 ms, 3.187 ms]	1.954 ms (164.0%)
iast_FULL	6.084 ms [6.022 ms, 6.146 ms]	4.893 ms (410.8%)
iast_GLOBAL	3.53 ms [3.467 ms, 3.593 ms]	2.339 ms (196.3%)
profiling	2.25 ms [2.229 ms, 2.272 ms]	1.059 ms (88.9%)
tracing	1.821 ms [1.804 ms, 1.839 ms]	630.367 µs (52.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.171 ms [1.16 ms, 1.183 ms]	-
iast	3.252 ms [3.209 ms, 3.295 ms]	2.08 ms (177.6%)
iast_FULL	5.905 ms [5.845 ms, 5.965 ms]	4.734 ms (404.1%)
iast_GLOBAL	3.629 ms [3.568 ms, 3.689 ms]	2.457 ms (209.7%)
profiling	2.267 ms [2.244 ms, 2.289 ms]	1.095 ms (93.5%)
tracing	1.833 ms [1.817 ms, 1.849 ms]	661.523 µs (56.5%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.376 ms) : 18184, 18569
.   : milestone, 18376,
appsec (18.51 ms) : 18322, 18698
.   : milestone, 18510,
code_origins (17.784 ms) : 17608, 17960
.   : milestone, 17784,
iast (17.907 ms) : 17729, 18085
.   : milestone, 17907,
profiling (18.693 ms) : 18508, 18878
.   : milestone, 18693,
tracing (18.023 ms) : 17847, 18200
.   : milestone, 18023,
section candidate
no_agent (18.033 ms) : 17848, 18217
.   : milestone, 18033,
appsec (18.511 ms) : 18323, 18700
.   : milestone, 18511,
code_origins (17.972 ms) : 17791, 18152
.   : milestone, 17972,
iast (17.802 ms) : 17622, 17981
.   : milestone, 17802,
profiling (18.684 ms) : 18496, 18871
.   : milestone, 18684,
tracing (17.752 ms) : 17576, 17928
.   : milestone, 17752,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.376 ms [18.184 ms, 18.569 ms]	-
appsec	18.51 ms [18.322 ms, 18.698 ms]	133.805 µs (0.7%)
code_origins	17.784 ms [17.608 ms, 17.96 ms]	-592.607 µs (-3.2%)
iast	17.907 ms [17.729 ms, 18.085 ms]	-469.453 µs (-2.6%)
profiling	18.693 ms [18.508 ms, 18.878 ms]	316.318 µs (1.7%)
tracing	18.023 ms [17.847 ms, 18.2 ms]	-353.073 µs (-1.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.033 ms [17.848 ms, 18.217 ms]	-
appsec	18.511 ms [18.323 ms, 18.7 ms]	478.857 µs (2.7%)
code_origins	17.972 ms [17.791 ms, 18.152 ms]	-60.984 µs (-0.3%)
iast	17.802 ms [17.622 ms, 17.981 ms]	-230.901 µs (-1.3%)
profiling	18.684 ms [18.496 ms, 18.871 ms]	651.158 µs (3.6%)
tracing	17.752 ms [17.576 ms, 17.928 ms]	-280.894 µs (-1.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/atomics-benchmark
git_commit_date	1773686106	1773686814
git_commit_sha	`3c59e03`	`a18c330`
release_version	1.61.0-SNAPSHOT~3c59e03c2c	1.61.0-SNAPSHOT~a18c330344

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1773688730	1773688730
ci_job_id	1510192428	1510192428
ci_pipeline_id	102772893	102772893
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-dwip10iq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-dwip10iq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (3.768 ms) : 3544, 3992
.   : milestone, 3768,
iast (2.252 ms) : 2183, 2321
.   : milestone, 2252,
iast_GLOBAL (2.29 ms) : 2220, 2359
.   : milestone, 2290,
profiling (2.076 ms) : 2021, 2131
.   : milestone, 2076,
tracing (2.063 ms) : 2009, 2116
.   : milestone, 2063,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.792 ms) : 3572, 4012
.   : milestone, 3792,
iast (2.26 ms) : 2191, 2330
.   : milestone, 2260,
iast_GLOBAL (2.293 ms) : 2224, 2362
.   : milestone, 2293,
profiling (2.07 ms) : 2015, 2124
.   : milestone, 2070,
tracing (2.053 ms) : 2000, 2106
.   : milestone, 2053,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	3.768 ms [3.544 ms, 3.992 ms]	2.298 ms (156.3%)
iast	2.252 ms [2.183 ms, 2.321 ms]	781.846 µs (53.2%)
iast_GLOBAL	2.29 ms [2.22 ms, 2.359 ms]	819.268 µs (55.7%)
profiling	2.076 ms [2.021 ms, 2.131 ms]	605.668 µs (41.2%)
tracing	2.063 ms [2.009 ms, 2.116 ms]	592.262 µs (40.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	3.792 ms [3.572 ms, 4.012 ms]	2.319 ms (157.4%)
iast	2.26 ms [2.191 ms, 2.33 ms]	787.207 µs (53.4%)
iast_GLOBAL	2.293 ms [2.224 ms, 2.362 ms]	820.008 µs (55.7%)
profiling	2.07 ms [2.015 ms, 2.124 ms]	596.764 µs (40.5%)
tracing	2.053 ms [2.0 ms, 2.106 ms]	580.076 µs (39.4%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~a18c330344, baseline=1.61.0-SNAPSHOT~3c59e03c2c
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.998 s) : 14998000, 14998000
.   : milestone, 14998000,
appsec (15.044 s) : 15044000, 15044000
.   : milestone, 15044000,
iast (18.257 s) : 18257000, 18257000
.   : milestone, 18257000,
iast_GLOBAL (17.915 s) : 17915000, 17915000
.   : milestone, 17915000,
profiling (14.837 s) : 14837000, 14837000
.   : milestone, 14837000,
tracing (15.03 s) : 15030000, 15030000
.   : milestone, 15030000,
section candidate
no_agent (15.605 s) : 15605000, 15605000
.   : milestone, 15605000,
appsec (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
iast (17.756 s) : 17756000, 17756000
.   : milestone, 17756000,
iast_GLOBAL (17.785 s) : 17785000, 17785000
.   : milestone, 17785000,
profiling (14.906 s) : 14906000, 14906000
.   : milestone, 14906000,
tracing (15.116 s) : 15116000, 15116000
.   : milestone, 15116000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.998 s [14.998 s, 14.998 s]	-
appsec	15.044 s [15.044 s, 15.044 s]	46.0 ms (0.3%)
iast	18.257 s [18.257 s, 18.257 s]	3.259 s (21.7%)
iast_GLOBAL	17.915 s [17.915 s, 17.915 s]	2.917 s (19.4%)
profiling	14.837 s [14.837 s, 14.837 s]	-161.0 ms (-1.1%)
tracing	15.03 s [15.03 s, 15.03 s]	32.0 ms (0.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.605 s [15.605 s, 15.605 s]	-
appsec	14.843 s [14.843 s, 14.843 s]	-762.0 ms (-4.9%)
iast	17.756 s [17.756 s, 17.756 s]	2.151 s (13.8%)
iast_GLOBAL	17.785 s [17.785 s, 17.785 s]	2.18 s (14.0%)
profiling	14.906 s [14.906 s, 14.906 s]	-699.0 ms (-4.5%)
tracing	15.116 s [15.116 s, 15.116 s]	-489.0 ms (-3.1%)

Atomics benchmark

f12e40e

Benchmark to show cost of Atomic vs AtomicFieldUpdater

dougqh requested a review from a team as a code owner March 16, 2026 18:46

dougqh requested a review from manuel-alvarez-alvarez March 16, 2026 18:46

dougqh added comp: core Tracer core type: documentation tag: performance Performance related changes labels Mar 16, 2026

Merge branch 'master' into dougqh/atomics-benchmark

a18c330

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Atomics benchmark#10862

Atomics benchmark#10862
dougqh wants to merge 2 commits intomasterfrom
dougqh/atomics-benchmark

dougqh commented Mar 16, 2026

Uh oh!

github-actions bot commented Mar 16, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Mar 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

dougqh commented Mar 16, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actions bot commented Mar 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Mar 16, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actions bot commented Mar 16, 2026 •

edited

Loading