Skip to content

Protocol v1#10801

Draft
AlexeyKuznetsov-DD wants to merge 26 commits intomasterfrom
alexeyk/protocol-v1-1
Draft

Protocol v1#10801
AlexeyKuznetsov-DD wants to merge 26 commits intomasterfrom
alexeyk/protocol-v1-1

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

What Does This Do

Java implementation for protocol v1.

Motivation

Additional Notes

DO NOT MERGE, WIP.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Mar 10, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: core Tracer core labels Mar 10, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 11, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/protocol-v1-1
git_commit_date 1773761481 1773787404
git_commit_sha 3ff081c 690427a
release_version 1.61.0-SNAPSHOT~3ff081cd4b 1.61.0-SNAPSHOT~690427a062
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773789365 1773789365
ci_job_id 1515564614 1515564614
ci_pipeline_id 103169781 103169781
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-agzkov16 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-agzkov16 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 58 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config worse
[+21.325µs; +49.355µs] or [+3.620%; +8.378%]
624.429µs 589.089µs
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059715
Total [baseline] (8.875 s) : 0, 8874796
Agent [candidate] (1.058 s) : 0, 1058450
Total [candidate] (8.852 s) : 0, 8851555
section iast
Agent [baseline] (1.235 s) : 0, 1235303
Total [baseline] (9.55 s) : 0, 9550052
Agent [candidate] (1.223 s) : 0, 1223346
Total [candidate] (9.588 s) : 0, 9587840
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.235 s 175.588 ms (16.6%)
Total tracing 8.875 s -
Total iast 9.55 s 675.256 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.223 s 164.895 ms (15.6%)
Total tracing 8.852 s -
Total iast 9.588 s 736.284 ms (8.3%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (627.055 ms) : 0, 627055
BytebuddyAgent [candidate] (627.867 ms) : 0, 627867
AgentMeter [baseline] (29.056 ms) : 0, 29056
AgentMeter [candidate] (28.786 ms) : 0, 28786
GlobalTracer [baseline] (256.95 ms) : 0, 256950
GlobalTracer [candidate] (256.235 ms) : 0, 256235
AppSec [baseline] (31.761 ms) : 0, 31761
AppSec [candidate] (31.606 ms) : 0, 31606
Debugger [baseline] (59.409 ms) : 0, 59409
Debugger [candidate] (58.966 ms) : 0, 58966
Remote Config [baseline] (589.089 µs) : 0, 589
Remote Config [candidate] (624.429 µs) : 0, 624
Telemetry [baseline] (8.051 ms) : 0, 8051
Telemetry [candidate] (8.259 ms) : 0, 8259
Flare Poller [baseline] (9.577 ms) : 0, 9577
Flare Poller [candidate] (8.858 ms) : 0, 8858
section iast
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (802.145 ms) : 0, 802145
BytebuddyAgent [candidate] (794.083 ms) : 0, 794083
AgentMeter [baseline] (11.627 ms) : 0, 11627
AgentMeter [candidate] (11.249 ms) : 0, 11249
GlobalTracer [baseline] (248.702 ms) : 0, 248702
GlobalTracer [candidate] (246.237 ms) : 0, 246237
AppSec [baseline] (27.763 ms) : 0, 27763
AppSec [candidate] (26.317 ms) : 0, 26317
Debugger [baseline] (68.984 ms) : 0, 68984
Debugger [candidate] (68.575 ms) : 0, 68575
Remote Config [baseline] (533.394 µs) : 0, 533
Remote Config [candidate] (540.016 µs) : 0, 540
Telemetry [baseline] (9.212 ms) : 0, 9212
Telemetry [candidate] (10.184 ms) : 0, 10184
Flare Poller [baseline] (3.307 ms) : 0, 3307
Flare Poller [candidate] (3.698 ms) : 0, 3698
IAST [baseline] (25.554 ms) : 0, 25554
IAST [candidate] (25.219 ms) : 0, 25219
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060204
Total [baseline] (11.047 s) : 0, 11046517
Agent [candidate] (1.059 s) : 0, 1058740
Total [candidate] (10.999 s) : 0, 10999181
section appsec
Agent [baseline] (1.248 s) : 0, 1248071
Total [baseline] (11.189 s) : 0, 11188775
Agent [candidate] (1.248 s) : 0, 1247820
Total [candidate] (11.175 s) : 0, 11175046
section iast
Agent [baseline] (1.237 s) : 0, 1236559
Total [baseline] (11.356 s) : 0, 11355982
Agent [candidate] (1.239 s) : 0, 1239114
Total [candidate] (11.383 s) : 0, 11383265
section profiling
Agent [baseline] (1.182 s) : 0, 1181925
Total [baseline] (11.094 s) : 0, 11093531
Agent [candidate] (1.186 s) : 0, 1186176
Total [candidate] (11.098 s) : 0, 11097661
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.248 s 187.867 ms (17.7%)
Agent iast 1.237 s 176.356 ms (16.6%)
Agent profiling 1.182 s 121.721 ms (11.5%)
Total tracing 11.047 s -
Total appsec 11.189 s 142.257 ms (1.3%)
Total iast 11.356 s 309.465 ms (2.8%)
Total profiling 11.094 s 47.014 ms (0.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.248 s 189.08 ms (17.9%)
Agent iast 1.239 s 180.373 ms (17.0%)
Agent profiling 1.186 s 127.435 ms (12.0%)
Total tracing 10.999 s -
Total appsec 11.175 s 175.865 ms (1.6%)
Total iast 11.383 s 384.084 ms (3.5%)
Total profiling 11.098 s 98.48 ms (0.9%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (627.658 ms) : 0, 627658
BytebuddyAgent [candidate] (626.409 ms) : 0, 626409
AgentMeter [baseline] (29.091 ms) : 0, 29091
AgentMeter [candidate] (28.939 ms) : 0, 28939
GlobalTracer [baseline] (256.785 ms) : 0, 256785
GlobalTracer [candidate] (256.275 ms) : 0, 256275
AppSec [baseline] (31.689 ms) : 0, 31689
AppSec [candidate] (31.517 ms) : 0, 31517
Debugger [baseline] (60.176 ms) : 0, 60176
Debugger [candidate] (60.09 ms) : 0, 60090
Remote Config [baseline] (597.676 µs) : 0, 598
Remote Config [candidate] (615.561 µs) : 0, 616
Telemetry [baseline] (8.129 ms) : 0, 8129
Telemetry [candidate] (8.152 ms) : 0, 8152
Flare Poller [baseline] (8.827 ms) : 0, 8827
Flare Poller [candidate] (9.589 ms) : 0, 9589
section appsec
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (657.244 ms) : 0, 657244
BytebuddyAgent [candidate] (660.017 ms) : 0, 660017
AgentMeter [baseline] (12.118 ms) : 0, 12118
AgentMeter [candidate] (12.043 ms) : 0, 12043
GlobalTracer [baseline] (258.892 ms) : 0, 258892
GlobalTracer [candidate] (258.039 ms) : 0, 258039
AppSec [baseline] (178.472 ms) : 0, 178472
AppSec [candidate] (177.39 ms) : 0, 177390
Debugger [baseline] (66.663 ms) : 0, 66663
Debugger [candidate] (66.111 ms) : 0, 66111
Remote Config [baseline] (621.331 µs) : 0, 621
Remote Config [candidate] (613.479 µs) : 0, 613
Telemetry [baseline] (8.354 ms) : 0, 8354
Telemetry [candidate] (8.311 ms) : 0, 8311
Flare Poller [baseline] (3.634 ms) : 0, 3634
Flare Poller [candidate] (3.56 ms) : 0, 3560
IAST [baseline] (24.346 ms) : 0, 24346
IAST [candidate] (24.135 ms) : 0, 24135
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (800.866 ms) : 0, 800866
BytebuddyAgent [candidate] (803.946 ms) : 0, 803946
AgentMeter [baseline] (11.653 ms) : 0, 11653
AgentMeter [candidate] (11.614 ms) : 0, 11614
GlobalTracer [baseline] (249.826 ms) : 0, 249826
GlobalTracer [candidate] (249.101 ms) : 0, 249101
AppSec [baseline] (26.94 ms) : 0, 26940
AppSec [candidate] (28.551 ms) : 0, 28551
Debugger [baseline] (71.06 ms) : 0, 71060
Debugger [candidate] (68.28 ms) : 0, 68280
Remote Config [baseline] (528.261 µs) : 0, 528
Remote Config [candidate] (535.481 µs) : 0, 535
Telemetry [baseline] (9.11 ms) : 0, 9110
Telemetry [candidate] (10.246 ms) : 0, 10246
Flare Poller [baseline] (3.333 ms) : 0, 3333
Flare Poller [candidate] (3.574 ms) : 0, 3574
IAST [baseline] (25.719 ms) : 0, 25719
IAST [candidate] (25.737 ms) : 0, 25737
section profiling
crashtracking [baseline] (1.165 ms) : 0, 1165
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (682.367 ms) : 0, 682367
BytebuddyAgent [candidate] (685.664 ms) : 0, 685664
AgentMeter [baseline] (8.608 ms) : 0, 8608
AgentMeter [candidate] (8.671 ms) : 0, 8671
GlobalTracer [baseline] (215.397 ms) : 0, 215397
GlobalTracer [candidate] (216.202 ms) : 0, 216202
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.227 ms) : 0, 32227
Debugger [baseline] (63.585 ms) : 0, 63585
Debugger [candidate] (63.293 ms) : 0, 63293
Remote Config [baseline] (585.818 µs) : 0, 586
Remote Config [candidate] (579.577 µs) : 0, 580
Telemetry [baseline] (10.084 ms) : 0, 10084
Telemetry [candidate] (9.976 ms) : 0, 9976
Flare Poller [baseline] (3.473 ms) : 0, 3473
Flare Poller [candidate] (4.243 ms) : 0, 4243
ProfilingAgent [baseline] (93.709 ms) : 0, 93709
ProfilingAgent [candidate] (93.004 ms) : 0, 93004
Profiling [baseline] (94.277 ms) : 0, 94277
Profiling [candidate] (93.564 ms) : 0, 93564
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/protocol-v1-1
git_commit_date 1773761481 1773787404
git_commit_sha 3ff081c 690427a
release_version 1.61.0-SNAPSHOT~3ff081cd4b 1.61.0-SNAPSHOT~690427a062
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773789835 1773789835
ci_job_id 1515564615 1515564615
ci_pipeline_id 103169781 103169781
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-1srr2y34 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-1srr2y34 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 6 performance regressions! Performance is the same for 12 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+55.998µs; +185.732µs] or [+2.074%; +6.879%]
same
[-127.255µs; +413.478µs] or [-1.668%; +5.420%]
unstable
[-200.893op/s; +113.143op/s] or [-15.071%; +8.488%]
2.821ms 7.772ms 1289.062op/s 2.700ms 7.629ms 1332.938op/s
scenario:load:insecure-bank:no_agent:high_load worse
[+19.572µs; +83.667µs] or [+2.022%; +8.644%]
unstable
[+25.369µs; +817.637µs] or [+0.945%; +30.451%]
unstable
[-741.500op/s; +222.312op/s] or [-19.799%; +5.936%]
1019.542µs 3.107ms 3485.531op/s 967.923µs 2.685ms 3745.125op/s
scenario:load:petclinic:iast:high_load better
[-1012.431µs; -529.244µs] or [-5.607%; -2.931%]
unsure
[-1200.520µs; -52.293µs] or [-4.103%; -0.179%]
unstable
[-18.357op/s; +37.732op/s] or [-7.220%; +14.841%]
17.285ms 28.634ms 263.938op/s 18.056ms 29.260ms 254.250op/s
scenario:load:petclinic:profiling:high_load worse
[+1.180ms; +2.083ms] or [+6.073%; +10.722%]
worse
[+1.142ms; +2.755ms] or [+3.689%; +8.901%]
unstable
[-43.550op/s; +7.550op/s] or [-18.277%; +3.169%]
21.055ms 32.896ms 220.281op/s 19.424ms 30.948ms 238.281op/s
scenario:load:petclinic:appsec:high_load worse
[+0.940ms; +1.954ms] or [+5.162%; +10.728%]
worse
[+0.636ms; +2.214ms] or [+2.125%; +7.399%]
unstable
[-42.946op/s; +10.633op/s] or [-17.155%; +4.247%]
19.663ms 31.349ms 234.188op/s 18.216ms 29.924ms 250.344op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.036 ms) : 16869, 17203
.   : milestone, 17036,
appsec (18.644 ms) : 18454, 18833
.   : milestone, 18644,
code_origins (17.913 ms) : 17735, 18092
.   : milestone, 17913,
iast (18.356 ms) : 18172, 18540
.   : milestone, 18356,
profiling (19.595 ms) : 19394, 19796
.   : milestone, 19595,
tracing (17.985 ms) : 17806, 18165
.   : milestone, 17985,
section candidate
no_agent (18.004 ms) : 17817, 18192
.   : milestone, 18004,
appsec (19.931 ms) : 19727, 20134
.   : milestone, 19931,
code_origins (17.924 ms) : 17747, 18101
.   : milestone, 17924,
iast (17.676 ms) : 17500, 17853
.   : milestone, 17676,
profiling (21.202 ms) : 20991, 21414
.   : milestone, 21202,
tracing (18.035 ms) : 17854, 18216
.   : milestone, 18035,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.036 ms [16.869 ms, 17.203 ms] -
appsec 18.644 ms [18.454 ms, 18.833 ms] 1.607 ms (9.4%)
code_origins 17.913 ms [17.735 ms, 18.092 ms] 877.17 µs (5.1%)
iast 18.356 ms [18.172 ms, 18.54 ms] 1.32 ms (7.7%)
profiling 19.595 ms [19.394 ms, 19.796 ms] 2.559 ms (15.0%)
tracing 17.985 ms [17.806 ms, 18.165 ms] 949.278 µs (5.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.004 ms [17.817 ms, 18.192 ms] -
appsec 19.931 ms [19.727 ms, 20.134 ms] 1.926 ms (10.7%)
code_origins 17.924 ms [17.747 ms, 18.101 ms] -80.079 µs (-0.4%)
iast 17.676 ms [17.5 ms, 17.853 ms] -327.991 µs (-1.8%)
profiling 21.202 ms [20.991 ms, 21.414 ms] 3.198 ms (17.8%)
tracing 18.035 ms [17.854 ms, 18.216 ms] 30.937 µs (0.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.176 ms) : 1165, 1188
.   : milestone, 1176,
iast (3.065 ms) : 3025, 3104
.   : milestone, 3065,
iast_FULL (5.98 ms) : 5918, 6042
.   : milestone, 5980,
iast_GLOBAL (3.437 ms) : 3384, 3490
.   : milestone, 3437,
profiling (2.111 ms) : 2090, 2132
.   : milestone, 2111,
tracing (1.817 ms) : 1801, 1833
.   : milestone, 1817,
section candidate
no_agent (1.268 ms) : 1254, 1282
.   : milestone, 1268,
iast (3.188 ms) : 3141, 3235
.   : milestone, 3188,
iast_FULL (5.992 ms) : 5931, 6054
.   : milestone, 5992,
iast_GLOBAL (3.557 ms) : 3503, 3610
.   : milestone, 3557,
profiling (2.195 ms) : 2175, 2215
.   : milestone, 2195,
tracing (1.799 ms) : 1782, 1815
.   : milestone, 1799,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.176 ms [1.165 ms, 1.188 ms] -
iast 3.065 ms [3.025 ms, 3.104 ms] 1.888 ms (160.6%)
iast_FULL 5.98 ms [5.918 ms, 6.042 ms] 4.804 ms (408.4%)
iast_GLOBAL 3.437 ms [3.384 ms, 3.49 ms] 2.261 ms (192.2%)
profiling 2.111 ms [2.09 ms, 2.132 ms] 934.651 µs (79.5%)
tracing 1.817 ms [1.801 ms, 1.833 ms] 640.695 µs (54.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.268 ms [1.254 ms, 1.282 ms] -
iast 3.188 ms [3.141 ms, 3.235 ms] 1.919 ms (151.4%)
iast_FULL 5.992 ms [5.931 ms, 6.054 ms] 4.724 ms (372.5%)
iast_GLOBAL 3.557 ms [3.503 ms, 3.61 ms] 2.289 ms (180.5%)
profiling 2.195 ms [2.175 ms, 2.215 ms] 926.783 µs (73.1%)
tracing 1.799 ms [1.782 ms, 1.815 ms] 530.392 µs (41.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/protocol-v1-1
git_commit_date 1773761481 1773787404
git_commit_sha 3ff081c 690427a
release_version 1.61.0-SNAPSHOT~3ff081cd4b 1.61.0-SNAPSHOT~690427a062
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773789686 1773789686
ci_job_id 1515564616 1515564616
ci_pipeline_id 103169781 103169781
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-vyja3igq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-vyja3igq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.806 ms) : 3583, 4029
.   : milestone, 3806,
iast (2.272 ms) : 2203, 2342
.   : milestone, 2272,
iast_GLOBAL (2.306 ms) : 2236, 2377
.   : milestone, 2306,
profiling (2.124 ms) : 2067, 2182
.   : milestone, 2124,
tracing (2.088 ms) : 2033, 2142
.   : milestone, 2088,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (3.841 ms) : 3616, 4066
.   : milestone, 3841,
iast (2.268 ms) : 2198, 2338
.   : milestone, 2268,
iast_GLOBAL (2.31 ms) : 2240, 2380
.   : milestone, 2310,
profiling (2.122 ms) : 2065, 2180
.   : milestone, 2122,
tracing (2.081 ms) : 2026, 2136
.   : milestone, 2081,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.806 ms [3.583 ms, 4.029 ms] 2.332 ms (158.2%)
iast 2.272 ms [2.203 ms, 2.342 ms] 798.288 µs (54.2%)
iast_GLOBAL 2.306 ms [2.236 ms, 2.377 ms] 832.061 µs (56.4%)
profiling 2.124 ms [2.067 ms, 2.182 ms] 650.215 µs (44.1%)
tracing 2.088 ms [2.033 ms, 2.142 ms] 613.587 µs (41.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 3.841 ms [3.616 ms, 4.066 ms] 2.364 ms (160.1%)
iast 2.268 ms [2.198 ms, 2.338 ms] 791.162 µs (53.6%)
iast_GLOBAL 2.31 ms [2.24 ms, 2.38 ms] 832.839 µs (56.4%)
profiling 2.122 ms [2.065 ms, 2.18 ms] 645.416 µs (43.7%)
tracing 2.081 ms [2.026 ms, 2.136 ms] 604.014 µs (40.9%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~690427a062, baseline=1.61.0-SNAPSHOT~3ff081cd4b
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.719 s) : 14719000, 14719000
.   : milestone, 14719000,
appsec (14.674 s) : 14674000, 14674000
.   : milestone, 14674000,
iast (18.041 s) : 18041000, 18041000
.   : milestone, 18041000,
iast_GLOBAL (17.875 s) : 17875000, 17875000
.   : milestone, 17875000,
profiling (14.954 s) : 14954000, 14954000
.   : milestone, 14954000,
tracing (14.894 s) : 14894000, 14894000
.   : milestone, 14894000,
section candidate
no_agent (15.498 s) : 15498000, 15498000
.   : milestone, 15498000,
appsec (14.794 s) : 14794000, 14794000
.   : milestone, 14794000,
iast (18.161 s) : 18161000, 18161000
.   : milestone, 18161000,
iast_GLOBAL (18.031 s) : 18031000, 18031000
.   : milestone, 18031000,
profiling (14.903 s) : 14903000, 14903000
.   : milestone, 14903000,
tracing (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.719 s [14.719 s, 14.719 s] -
appsec 14.674 s [14.674 s, 14.674 s] -45.0 ms (-0.3%)
iast 18.041 s [18.041 s, 18.041 s] 3.322 s (22.6%)
iast_GLOBAL 17.875 s [17.875 s, 17.875 s] 3.156 s (21.4%)
profiling 14.954 s [14.954 s, 14.954 s] 235.0 ms (1.6%)
tracing 14.894 s [14.894 s, 14.894 s] 175.0 ms (1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.498 s [15.498 s, 15.498 s] -
appsec 14.794 s [14.794 s, 14.794 s] -704.0 ms (-4.5%)
iast 18.161 s [18.161 s, 18.161 s] 2.663 s (17.2%)
iast_GLOBAL 18.031 s [18.031 s, 18.031 s] 2.533 s (16.3%)
profiling 14.903 s [14.903 s, 14.903 s] -595.0 ms (-3.8%)
tracing 14.977 s [14.977 s, 14.977 s] -521.0 ms (-3.4%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: core Tracer core tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant