Skip to content

Conversation

@PerfectSlayer
Copy link
Contributor

This PR mirrors the changes from the original community contribution to enable CI testing with maintainer privileges.

Original PR: #9576
Original Author: @deejgregor
Original Branch: deejgregor/dd-trace-java:debugger-java-5-classes


This is an automated mirror created to run CI checks. All credit goes to the original contributor @deejgregor.

deejgregor and others added 3 commits September 22, 2025 10:01
Pre-Java 6 classes can contain JSR/RET instructions which are not
supported by ASM when the COMPUTE_FRAMES is used. This leads to
exceptions like this:

13:34:29.407 [Test worker] ERROR com.datadog.debugger.agent.DebuggerTransformer - Cannot write classfile for class: org.apache.felix.gogo.runtime.Pipe Exception:
java.lang.IllegalArgumentException: JSR/RET are not supported with computeFrames option
        at org.objectweb.asm.Frame.execute(Frame.java:1028)
        at org.objectweb.asm.MethodWriter.visitJumpInsn(MethodWriter.java:1147)
        at org.objectweb.asm.tree.JumpInsnNode.accept(JumpInsnNode.java:79)
        at org.objectweb.asm.tree.InsnList.accept(InsnList.java:144)
        at org.objectweb.asm.tree.MethodNode.accept(MethodNode.java:749)
        at org.objectweb.asm.tree.MethodNode.accept(MethodNode.java:647)
        at org.objectweb.asm.tree.ClassNode.accept(ClassNode.java:468)
        at com.datadog.debugger.agent.DebuggerTransformer.writeClassFile(DebuggerTransformer.java:492)
        ...

This uses ASM's JSRInlinerAdapter to rewrite the problematic JSR/RET
instructions as the class file is written.
@PerfectSlayer PerfectSlayer requested a review from a team as a code owner September 23, 2025 12:08
@PerfectSlayer PerfectSlayer requested review from jpbempel and removed request for a team September 23, 2025 12:08
@github-actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@pr-commenter
Copy link

pr-commenter bot commented Sep 23, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1758629952 1758630297
end_time 2025-09-23T12:20:32 2025-09-23T12:26:18
git_branch master community-pr-9576
git_commit_sha 0094a60 376c515
start_time 2025-09-23T12:19:13 2025-09-23T12:24:58
See matching parameters
Baseline Candidate
ci_job_id 1142897482 1142897482
ci_pipeline_id 77269690 77269690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1758615307 1758615307

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 5 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:basic worse
[+2.914µs; +11.979µs] or [+1.169%; +4.807%]
worse
[+2.809µs; +15.598µs] or [+1.019%; +5.656%]
unsure
[+1.319µs; +15.203µs] or [+0.462%; +5.328%]
unstable
[-30.928µs; +222.506µs] or [-3.912%; +28.143%]
same
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-15.776µs; +20.675µs] or [-5.729%; +7.509%]
unstable
[-28.501µs; +30.551µs] or [-9.009%; +9.656%]
unstable
[-39608.408ns; +38840.302ns] or [-11.981%; +11.749%]
unstable
[-5.374µs; +224.410µs] or [-0.584%; +24.378%]
same
scenario:loop unsure
[+19.402µs; +24.752µs] or [+0.219%; +0.280%]
unsure
[+14.396µs; +24.507µs] or [+0.161%; +0.274%]
unsure
[+6.174µs; +15.872µs] or [+0.069%; +0.176%]
same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (316.379 µs) : 285, 347
.   : milestone, 316,
basic (275.753 µs) : 270, 282
.   : milestone, 276,
loop (8.941 ms) : 8936, 8946
.   : milestone, 8941,
section candidate
noprobe (317.404 µs) : 292, 342
.   : milestone, 317,
basic (284.956 µs) : 278, 292
.   : milestone, 285,
loop (8.961 ms) : 8956, 8965
.   : milestone, 8961,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 316.379 µs [285.464 µs, 347.294 µs]
basic 275.753 µs [269.885 µs, 281.62 µs]
loop 8.941 ms [8.936 ms, 8.946 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 317.404 µs [292.404 µs, 342.404 µs]
basic 284.956 µs [278.311 µs, 291.601 µs]
loop 8.961 ms [8.956 ms, 8.965 ms]

@pr-commenter
Copy link

pr-commenter bot commented Sep 23, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master community-pr-9576
git_commit_date 1758615873 1758615307
git_commit_sha 0094a60 376c515
release_version 1.54.0-SNAPSHOT~0094a60a80 1.54.0-SNAPSHOT~376c5150bc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758631132 1758631132
ci_job_id 1142897475 1142897475
ci_pipeline_id 77269690 77269690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-i8eh6aav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-i8eh6aav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 7 performance regressions! Performance is the same for 43 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+8.799ms; +10.558ms] or [+3.699%; +4.438%]
247.572ms 237.893ms
scenario:startup:insecure-bank:tracing:GlobalTracer worse
[+8.980ms; +11.039ms] or [+3.628%; +4.460%]
257.506ms 247.497ms
scenario:startup:insecure-bank:tracing:Telemetry worse
[+7.062ms; +7.565ms] or [+78.280%; +83.863%]
16.335ms 9.021ms
scenario:startup:petclinic:appsec:GlobalTracer worse
[+5.708ms; +14.148ms] or [+2.364%; +5.859%]
251.424ms 241.496ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+9.089ms; +10.743ms] or [+3.824%; +4.520%]
247.574ms 237.658ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+8.724ms; +15.210ms] or [+3.892%; +6.786%]
236.119ms 224.152ms
scenario:startup:petclinic:tracing:GlobalTracer worse
[+7.831ms; +10.252ms] or [+3.152%; +4.126%]
257.480ms 248.438ms
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.005 s) : 0, 1005469
Total [baseline] (8.659 s) : 0, 8659337
Agent [candidate] (1.023 s) : 0, 1022639
Total [candidate] (8.639 s) : 0, 8638921
section iast
Agent [baseline] (1.146 s) : 0, 1145783
Total [baseline] (9.312 s) : 0, 9312253
Agent [candidate] (1.152 s) : 0, 1152122
Total [candidate] (9.354 s) : 0, 9354435
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent iast 1.146 s 140.315 ms (14.0%)
Total tracing 8.659 s -
Total iast 9.312 s 652.916 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.152 s 129.483 ms (12.7%)
Total tracing 8.639 s -
Total iast 9.354 s 715.514 ms (8.3%)
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (688.344 ms) : 0, 688344
BytebuddyAgent [candidate] (687.75 ms) : 0, 687750
GlobalTracer [baseline] (247.497 ms) : 0, 247497
GlobalTracer [candidate] (257.506 ms) : 0, 257506
AppSec [baseline] (31.056 ms) : 0, 31056
AppSec [candidate] (31.602 ms) : 0, 31602
Debugger [baseline] (6.311 ms) : 0, 6311
Debugger [candidate] (6.344 ms) : 0, 6344
Remote Config [baseline] (680.95 µs) : 0, 681
Remote Config [candidate] (673.42 µs) : 0, 673
Telemetry [baseline] (9.021 ms) : 0, 9021
Telemetry [candidate] (16.335 ms) : 0, 16335
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (810.388 ms) : 0, 810388
BytebuddyAgent [candidate] (807.753 ms) : 0, 807753
GlobalTracer [baseline] (237.893 ms) : 0, 237893
GlobalTracer [candidate] (247.572 ms) : 0, 247572
AppSec [baseline] (33.67 ms) : 0, 33670
AppSec [candidate] (27.418 ms) : 0, 27418
Debugger [baseline] (6.129 ms) : 0, 6129
Debugger [candidate] (6.217 ms) : 0, 6217
Remote Config [baseline] (597.887 µs) : 0, 598
Remote Config [candidate] (598.803 µs) : 0, 599
Telemetry [baseline] (8.242 ms) : 0, 8242
Telemetry [candidate] (8.344 ms) : 0, 8344
IAST [baseline] (26.197 ms) : 0, 26197
IAST [candidate] (31.908 ms) : 0, 31908
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.008 s) : 0, 1007763
Total [baseline] (10.61 s) : 0, 10610277
Agent [candidate] (1.02 s) : 0, 1019534
Total [candidate] (10.616 s) : 0, 10616327
section appsec
Agent [baseline] (1.193 s) : 0, 1193148
Total [baseline] (10.96 s) : 0, 10959930
Agent [candidate] (1.204 s) : 0, 1204110
Total [candidate] (10.985 s) : 0, 10985047
section iast
Agent [baseline] (1.143 s) : 0, 1143311
Total [baseline] (10.898 s) : 0, 10897822
Agent [candidate] (1.152 s) : 0, 1151955
Total [candidate] (11.086 s) : 0, 11085734
section profiling
Agent [baseline] (1.153 s) : 0, 1152543
Total [baseline] (10.992 s) : 0, 10992070
Agent [candidate] (1.171 s) : 0, 1171086
Total [candidate] (11.057 s) : 0, 11056529
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.008 s -
Agent appsec 1.193 s 185.385 ms (18.4%)
Agent iast 1.143 s 135.548 ms (13.5%)
Agent profiling 1.153 s 144.78 ms (14.4%)
Total tracing 10.61 s -
Total appsec 10.96 s 349.653 ms (3.3%)
Total iast 10.898 s 287.545 ms (2.7%)
Total profiling 10.992 s 381.794 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.204 s 184.576 ms (18.1%)
Agent iast 1.152 s 132.421 ms (13.0%)
Agent profiling 1.171 s 151.551 ms (14.9%)
Total tracing 10.616 s -
Total appsec 10.985 s 368.719 ms (3.5%)
Total iast 11.086 s 469.407 ms (4.4%)
Total profiling 11.057 s 440.202 ms (4.1%)
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (689.141 ms) : 0, 689141
BytebuddyAgent [candidate] (686.734 ms) : 0, 686734
GlobalTracer [baseline] (248.438 ms) : 0, 248438
GlobalTracer [candidate] (257.48 ms) : 0, 257480
AppSec [baseline] (31.356 ms) : 0, 31356
AppSec [candidate] (31.728 ms) : 0, 31728
Debugger [baseline] (6.341 ms) : 0, 6341
Debugger [candidate] (6.388 ms) : 0, 6388
Remote Config [baseline] (684.296 µs) : 0, 684
Remote Config [candidate] (689.294 µs) : 0, 689
Telemetry [baseline] (9.106 ms) : 0, 9106
Telemetry [candidate] (14.07 ms) : 0, 14070
section appsec
crashtracking [baseline] (1.49 ms) : 0, 1490
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (716.583 ms) : 0, 716583
BytebuddyAgent [candidate] (716.624 ms) : 0, 716624
GlobalTracer [baseline] (241.496 ms) : 0, 241496
GlobalTracer [candidate] (251.424 ms) : 0, 251424
AppSec [baseline] (172.172 ms) : 0, 172172
AppSec [candidate] (171.456 ms) : 0, 171456
Debugger [baseline] (6.022 ms) : 0, 6022
Debugger [candidate] (6.138 ms) : 0, 6138
Remote Config [baseline] (651.105 µs) : 0, 651
Remote Config [candidate] (615.117 µs) : 0, 615
Telemetry [baseline] (8.453 ms) : 0, 8453
Telemetry [candidate] (10.031 ms) : 0, 10031
IAST [baseline] (25.049 ms) : 0, 25049
IAST [candidate] (25.12 ms) : 0, 25120
section iast
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (808.219 ms) : 0, 808219
BytebuddyAgent [candidate] (808.045 ms) : 0, 808045
GlobalTracer [baseline] (237.658 ms) : 0, 237658
GlobalTracer [candidate] (247.574 ms) : 0, 247574
AppSec [baseline] (33.625 ms) : 0, 33625
AppSec [candidate] (27.218 ms) : 0, 27218
Debugger [baseline] (6.08 ms) : 0, 6080
Debugger [candidate] (6.169 ms) : 0, 6169
Remote Config [baseline] (595.808 µs) : 0, 596
Remote Config [candidate] (594.72 µs) : 0, 595
Telemetry [baseline] (8.191 ms) : 0, 8191
Telemetry [candidate] (8.258 ms) : 0, 8258
IAST [baseline] (26.234 ms) : 0, 26234
IAST [candidate] (31.679 ms) : 0, 31679
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.443 ms) : 0, 1443
BytebuddyAgent [baseline] (719.103 ms) : 0, 719103
BytebuddyAgent [candidate] (724.809 ms) : 0, 724809
GlobalTracer [baseline] (224.152 ms) : 0, 224152
GlobalTracer [candidate] (236.119 ms) : 0, 236119
AppSec [baseline] (31.56 ms) : 0, 31560
AppSec [candidate] (31.442 ms) : 0, 31442
Debugger [baseline] (7.26 ms) : 0, 7260
Debugger [candidate] (6.578 ms) : 0, 6578
Remote Config [baseline] (713.881 µs) : 0, 714
Remote Config [candidate] (713.848 µs) : 0, 714
Telemetry [baseline] (14.814 ms) : 0, 14814
Telemetry [candidate] (16.762 ms) : 0, 16762
ProfilingAgent [baseline] (102.357 ms) : 0, 102357
ProfilingAgent [candidate] (101.935 ms) : 0, 101935
Profiling [baseline] (102.957 ms) : 0, 102957
Profiling [candidate] (102.516 ms) : 0, 102516
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master community-pr-9576
git_commit_date 1758615873 1758615307
git_commit_sha 0094a60 376c515
release_version 1.54.0-SNAPSHOT~0094a60a80 1.54.0-SNAPSHOT~376c5150bc
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758630878 1758630878
ci_job_id 1142897476 1142897476
ci_pipeline_id 77269690 77269690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-o8o4eljh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-o8o4eljh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-976.191µs; -614.231µs] or [-9.592%; -6.035%]
unstable
[-18.131op/s; +94.631op/s] or [-3.971%; +20.727%]
9.382ms 494.812op/s 10.177ms 456.562op/s
scenario:load:insecure-bank:profiling:high_load better
[-635.085µs; -341.881µs] or [-6.928%; -3.729%]
unstable
[-35.791op/s; +91.853op/s] or [-7.070%; +18.144%]
8.679ms 534.281op/s 9.168ms 506.250op/s
scenario:load:petclinic:appsec:high_load better
[-2.207ms; -1.279ms] or [-4.459%; -2.584%]
unstable
[-3.732op/s; +10.707op/s] or [-3.948%; +11.327%]
47.751ms 98.013op/s 49.494ms 94.525op/s
scenario:load:petclinic:tracing:high_load better
[-1.921ms; -1.091ms] or [-4.202%; -2.387%]
unstable
[-4.076op/s; +10.951op/s] or [-3.983%; +10.700%]
44.215ms 105.787op/s 45.722ms 102.350op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.431 ms) : 4381, 4481
.   : milestone, 4431,
iast (10.177 ms) : 10006, 10348
.   : milestone, 10177,
iast_FULL (14.566 ms) : 14275, 14857
.   : milestone, 14566,
iast_GLOBAL (10.425 ms) : 10242, 10608
.   : milestone, 10425,
profiling (9.168 ms) : 9026, 9309
.   : milestone, 9168,
tracing (7.872 ms) : 7760, 7985
.   : milestone, 7872,
section candidate
no_agent (4.397 ms) : 4347, 4447
.   : milestone, 4397,
iast (9.382 ms) : 9217, 9547
.   : milestone, 9382,
iast_FULL (14.591 ms) : 14299, 14883
.   : milestone, 14591,
iast_GLOBAL (10.501 ms) : 10316, 10687
.   : milestone, 10501,
profiling (8.679 ms) : 8549, 8810
.   : milestone, 8679,
tracing (7.74 ms) : 7632, 7849
.   : milestone, 7740,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.431 ms [4.381 ms, 4.481 ms] -
iast 10.177 ms [10.006 ms, 10.348 ms] 5.746 ms (129.7%)
iast_FULL 14.566 ms [14.275 ms, 14.857 ms] 10.135 ms (228.7%)
iast_GLOBAL 10.425 ms [10.242 ms, 10.608 ms] 5.994 ms (135.3%)
profiling 9.168 ms [9.026 ms, 9.309 ms] 4.737 ms (106.9%)
tracing 7.872 ms [7.76 ms, 7.985 ms] 3.441 ms (77.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.397 ms [4.347 ms, 4.447 ms] -
iast 9.382 ms [9.217 ms, 9.547 ms] 4.985 ms (113.4%)
iast_FULL 14.591 ms [14.299 ms, 14.883 ms] 10.194 ms (231.8%)
iast_GLOBAL 10.501 ms [10.316 ms, 10.687 ms] 6.104 ms (138.8%)
profiling 8.679 ms [8.549 ms, 8.81 ms] 4.282 ms (97.4%)
tracing 7.74 ms [7.632 ms, 7.849 ms] 3.343 ms (76.0%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.963 ms) : 36663, 37264
.   : milestone, 36963,
appsec (49.494 ms) : 49047, 49940
.   : milestone, 49494,
code_origins (45.034 ms) : 44649, 45418
.   : milestone, 45034,
iast (45.169 ms) : 44771, 45567
.   : milestone, 45169,
profiling (48.221 ms) : 47798, 48643
.   : milestone, 48221,
tracing (45.722 ms) : 45337, 46107
.   : milestone, 45722,
section candidate
no_agent (37.235 ms) : 36937, 37534
.   : milestone, 37235,
appsec (47.751 ms) : 47336, 48166
.   : milestone, 47751,
code_origins (45.123 ms) : 44735, 45511
.   : milestone, 45123,
iast (46.228 ms) : 45827, 46630
.   : milestone, 46228,
profiling (49.455 ms) : 48942, 49969
.   : milestone, 49455,
tracing (44.215 ms) : 43829, 44602
.   : milestone, 44215,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.963 ms [36.663 ms, 37.264 ms] -
appsec 49.494 ms [49.047 ms, 49.94 ms] 12.53 ms (33.9%)
code_origins 45.034 ms [44.649 ms, 45.418 ms] 8.07 ms (21.8%)
iast 45.169 ms [44.771 ms, 45.567 ms] 8.206 ms (22.2%)
profiling 48.221 ms [47.798 ms, 48.643 ms] 11.257 ms (30.5%)
tracing 45.722 ms [45.337 ms, 46.107 ms] 8.758 ms (23.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.235 ms [36.937 ms, 37.534 ms] -
appsec 47.751 ms [47.336 ms, 48.166 ms] 10.515 ms (28.2%)
code_origins 45.123 ms [44.735 ms, 45.511 ms] 7.888 ms (21.2%)
iast 46.228 ms [45.827 ms, 46.63 ms] 8.993 ms (24.2%)
profiling 49.455 ms [48.942 ms, 49.969 ms] 12.22 ms (32.8%)
tracing 44.215 ms [43.829 ms, 44.602 ms] 6.98 ms (18.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master community-pr-9576
git_commit_date 1758615873 1758615307
git_commit_sha 0094a60 376c515
release_version 1.54.0-SNAPSHOT~0094a60a80 1.54.0-SNAPSHOT~376c5150bc
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758631425 1758631425
ci_job_id 1142897477 1142897477
ci_pipeline_id 77269690 77269690
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-eft1zfnf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-eft1zfnf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.492 s) : 15492000, 15492000
.   : milestone, 15492000,
appsec (14.959 s) : 14959000, 14959000
.   : milestone, 14959000,
iast (18.463 s) : 18463000, 18463000
.   : milestone, 18463000,
iast_GLOBAL (17.851 s) : 17851000, 17851000
.   : milestone, 17851000,
profiling (15.347 s) : 15347000, 15347000
.   : milestone, 15347000,
tracing (15.299 s) : 15299000, 15299000
.   : milestone, 15299000,
section candidate
no_agent (14.989 s) : 14989000, 14989000
.   : milestone, 14989000,
appsec (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
iast (18.197 s) : 18197000, 18197000
.   : milestone, 18197000,
iast_GLOBAL (18.136 s) : 18136000, 18136000
.   : milestone, 18136000,
profiling (15.142 s) : 15142000, 15142000
.   : milestone, 15142000,
tracing (15.356 s) : 15356000, 15356000
.   : milestone, 15356000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.492 s [15.492 s, 15.492 s] -
appsec 14.959 s [14.959 s, 14.959 s] -533.0 ms (-3.4%)
iast 18.463 s [18.463 s, 18.463 s] 2.971 s (19.2%)
iast_GLOBAL 17.851 s [17.851 s, 17.851 s] 2.359 s (15.2%)
profiling 15.347 s [15.347 s, 15.347 s] -145.0 ms (-0.9%)
tracing 15.299 s [15.299 s, 15.299 s] -193.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.989 s [14.989 s, 14.989 s] -
appsec 15.014 s [15.014 s, 15.014 s] 25.0 ms (0.2%)
iast 18.197 s [18.197 s, 18.197 s] 3.208 s (21.4%)
iast_GLOBAL 18.136 s [18.136 s, 18.136 s] 3.147 s (21.0%)
profiling 15.142 s [15.142 s, 15.142 s] 153.0 ms (1.0%)
tracing 15.356 s [15.356 s, 15.356 s] 367.0 ms (2.4%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~376c5150bc, baseline=1.54.0-SNAPSHOT~0094a60a80
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (3.714 ms) : 3496, 3931
.   : milestone, 3714,
iast (2.184 ms) : 2121, 2247
.   : milestone, 2184,
iast_GLOBAL (2.237 ms) : 2174, 2300
.   : milestone, 2237,
profiling (2.071 ms) : 2019, 2123
.   : milestone, 2071,
tracing (2.011 ms) : 1962, 2060
.   : milestone, 2011,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.673 ms) : 3458, 3888
.   : milestone, 3673,
iast (2.195 ms) : 2132, 2258
.   : milestone, 2195,
iast_GLOBAL (2.235 ms) : 2172, 2298
.   : milestone, 2235,
profiling (2.042 ms) : 1991, 2092
.   : milestone, 2042,
tracing (2.028 ms) : 1978, 2077
.   : milestone, 2028,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 3.714 ms [3.496 ms, 3.931 ms] 2.245 ms (152.9%)
iast 2.184 ms [2.121 ms, 2.247 ms] 715.596 µs (48.7%)
iast_GLOBAL 2.237 ms [2.174 ms, 2.3 ms] 768.599 µs (52.3%)
profiling 2.071 ms [2.019 ms, 2.123 ms] 602.587 µs (41.0%)
tracing 2.011 ms [1.962 ms, 2.06 ms] 542.47 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.673 ms [3.458 ms, 3.888 ms] 2.199 ms (149.2%)
iast 2.195 ms [2.132 ms, 2.258 ms] 720.955 µs (48.9%)
iast_GLOBAL 2.235 ms [2.172 ms, 2.298 ms] 761.342 µs (51.7%)
profiling 2.042 ms [1.991 ms, 2.092 ms] 567.806 µs (38.5%)
tracing 2.028 ms [1.978 ms, 2.077 ms] 554.0 µs (37.6%)

@bric3
Copy link
Contributor

bric3 commented Sep 23, 2025

Isn't it duplicating #9591 from @jpbempel as well ?

@PerfectSlayer
Copy link
Contributor Author

Closing. Used as test for #9602

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants