Update GitHub Actions spec tests fixtures #10574

daniel-mohedano · 2026-02-12T10:40:00Z

What Does This Do

Updates the spec tests fixtures for the GitHub Actions provider according to https://github.com/DataDog/datadog-ci-spec/pull/248

Additional Information

test-environment-trigger: skip

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-02-12T11:30:27Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/gha-spec-tests
git_commit_date	1770896941	1770896959
git_commit_sha	`79fa8aa`	`004b18c`
release_version	1.60.0-SNAPSHOT~79fa8aa6a9	1.60.0-SNAPSHOT~004b18ce2c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1770899012	1770899012
ci_job_id	1420669159	1420669159
ci_pipeline_id	96059818	96059818
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-wagpdhtf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-wagpdhtf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062674
Total [baseline] (10.898 s) : 0, 10898162
Agent [candidate] (1.07 s) : 0, 1070329
Total [candidate] (11.016 s) : 0, 11016000
section appsec
Agent [baseline] (1.242 s) : 0, 1242379
Total [baseline] (10.971 s) : 0, 10971014
Agent [candidate] (1.24 s) : 0, 1239614
Total [candidate] (10.971 s) : 0, 10970707
section iast
Agent [baseline] (1.234 s) : 0, 1234168
Total [baseline] (11.127 s) : 0, 11126565
Agent [candidate] (1.233 s) : 0, 1232523
Total [candidate] (11.259 s) : 0, 11259345
section profiling
Agent [baseline] (1.192 s) : 0, 1191817
Total [baseline] (10.967 s) : 0, 10967248
Agent [candidate] (1.196 s) : 0, 1196410
Total [candidate] (11.035 s) : 0, 11034695

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	appsec	1.242 s	179.706 ms (16.9%)
Agent	iast	1.234 s	171.494 ms (16.1%)
Agent	profiling	1.192 s	129.144 ms (12.2%)
Total	tracing	10.898 s	-
Total	appsec	10.971 s	72.852 ms (0.7%)
Total	iast	11.127 s	228.403 ms (2.1%)
Total	profiling	10.967 s	69.086 ms (0.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.07 s	-
Agent	appsec	1.24 s	169.285 ms (15.8%)
Agent	iast	1.233 s	162.194 ms (15.2%)
Agent	profiling	1.196 s	126.081 ms (11.8%)
Total	tracing	11.016 s	-
Total	appsec	10.971 s	-45.293 ms (-0.4%)
Total	iast	11.259 s	243.346 ms (2.2%)
Total	profiling	11.035 s	18.696 ms (0.2%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.178 ms) : 0, 1178
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (626.991 ms) : 0, 626991
BytebuddyAgent [candidate] (632.997 ms) : 0, 632997
AgentMeter [baseline] (28.919 ms) : 0, 28919
AgentMeter [candidate] (29.126 ms) : 0, 29126
GlobalTracer [baseline] (256.904 ms) : 0, 256904
GlobalTracer [candidate] (258.904 ms) : 0, 258904
AppSec [baseline] (32.779 ms) : 0, 32779
AppSec [candidate] (32.901 ms) : 0, 32901
Debugger [baseline] (64.913 ms) : 0, 64913
Debugger [candidate] (63.013 ms) : 0, 63013
Remote Config [baseline] (611.998 µs) : 0, 612
Remote Config [candidate] (610.251 µs) : 0, 610
Telemetry [baseline] (9.825 ms) : 0, 9825
Telemetry [candidate] (10.733 ms) : 0, 10733
Flare Poller [baseline] (5.286 ms) : 0, 5286
Flare Poller [candidate] (5.4 ms) : 0, 5400
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (658.587 ms) : 0, 658587
BytebuddyAgent [candidate] (656.714 ms) : 0, 656714
AgentMeter [baseline] (11.978 ms) : 0, 11978
AgentMeter [candidate] (12.069 ms) : 0, 12069
GlobalTracer [baseline] (259.244 ms) : 0, 259244
GlobalTracer [candidate] (258.886 ms) : 0, 258886
IAST [baseline] (25.474 ms) : 0, 25474
IAST [candidate] (25.427 ms) : 0, 25427
AppSec [baseline] (168.597 ms) : 0, 168597
AppSec [candidate] (168.23 ms) : 0, 168230
Debugger [baseline] (67.674 ms) : 0, 67674
Debugger [candidate] (67.751 ms) : 0, 67751
Remote Config [baseline] (663.192 µs) : 0, 663
Remote Config [candidate] (651.515 µs) : 0, 652
Telemetry [baseline] (9.83 ms) : 0, 9830
Telemetry [candidate] (9.647 ms) : 0, 9647
Flare Poller [baseline] (3.829 ms) : 0, 3829
Flare Poller [candidate] (3.689 ms) : 0, 3689
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (796.676 ms) : 0, 796676
BytebuddyAgent [candidate] (795.781 ms) : 0, 795781
AgentMeter [baseline] (11.281 ms) : 0, 11281
AgentMeter [candidate] (11.249 ms) : 0, 11249
GlobalTracer [baseline] (248.814 ms) : 0, 248814
GlobalTracer [candidate] (248.133 ms) : 0, 248133
IAST [baseline] (27.125 ms) : 0, 27125
IAST [candidate] (26.886 ms) : 0, 26886
AppSec [baseline] (32.255 ms) : 0, 32255
AppSec [candidate] (32.395 ms) : 0, 32395
Debugger [baseline] (68.828 ms) : 0, 68828
Debugger [candidate] (69.054 ms) : 0, 69054
Remote Config [baseline] (543.104 µs) : 0, 543
Remote Config [candidate] (534.283 µs) : 0, 534
Telemetry [baseline] (8.66 ms) : 0, 8660
Telemetry [candidate] (8.555 ms) : 0, 8555
Flare Poller [baseline] (3.504 ms) : 0, 3504
Flare Poller [candidate] (3.483 ms) : 0, 3483
section profiling
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (683.572 ms) : 0, 683572
BytebuddyAgent [candidate] (686.579 ms) : 0, 686579
AgentMeter [baseline] (8.678 ms) : 0, 8678
AgentMeter [candidate] (8.643 ms) : 0, 8643
GlobalTracer [baseline] (216.169 ms) : 0, 216169
GlobalTracer [candidate] (217.041 ms) : 0, 217041
AppSec [baseline] (32.516 ms) : 0, 32516
AppSec [candidate] (32.662 ms) : 0, 32662
Debugger [baseline] (67.284 ms) : 0, 67284
Debugger [candidate] (67.656 ms) : 0, 67656
Remote Config [baseline] (629.572 µs) : 0, 630
Remote Config [candidate] (625.446 µs) : 0, 625
Telemetry [baseline] (9.044 ms) : 0, 9044
Telemetry [candidate] (8.965 ms) : 0, 8965
Flare Poller [baseline] (3.773 ms) : 0, 3773
Flare Poller [candidate] (3.76 ms) : 0, 3760
ProfilingAgent [baseline] (98.94 ms) : 0, 98940
ProfilingAgent [candidate] (98.993 ms) : 0, 98993
Profiling [baseline] (99.513 ms) : 0, 99513
Profiling [candidate] (99.581 ms) : 0, 99581

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.067 s) : 0, 1067339
Total [baseline] (8.729 s) : 0, 8729183
Agent [candidate] (1.072 s) : 0, 1071875
Total [candidate] (8.732 s) : 0, 8731960
section iast
Agent [baseline] (1.234 s) : 0, 1233985
Total [baseline] (9.345 s) : 0, 9344631
Agent [candidate] (1.234 s) : 0, 1233793
Total [candidate] (9.342 s) : 0, 9341506

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.067 s	-
Agent	iast	1.234 s	166.646 ms (15.6%)
Total	tracing	8.729 s	-
Total	iast	9.345 s	615.448 ms (7.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.072 s	-
Agent	iast	1.234 s	161.918 ms (15.1%)
Total	tracing	8.732 s	-
Total	iast	9.342 s	609.546 ms (7.0%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (633.22 ms) : 0, 633220
BytebuddyAgent [candidate] (634.116 ms) : 0, 634116
AgentMeter [baseline] (29.22 ms) : 0, 29220
AgentMeter [candidate] (29.182 ms) : 0, 29182
GlobalTracer [baseline] (258.411 ms) : 0, 258411
GlobalTracer [candidate] (259.134 ms) : 0, 259134
AppSec [baseline] (32.807 ms) : 0, 32807
AppSec [candidate] (32.941 ms) : 0, 32941
Debugger [baseline] (60.437 ms) : 0, 60437
Debugger [candidate] (61.651 ms) : 0, 61651
Remote Config [baseline] (625.562 µs) : 0, 626
Remote Config [candidate] (631.066 µs) : 0, 631
Telemetry [baseline] (11.459 ms) : 0, 11459
Telemetry [candidate] (12.261 ms) : 0, 12261
Flare Poller [baseline] (4.537 ms) : 0, 4537
Flare Poller [candidate] (5.339 ms) : 0, 5339
section iast
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (797.879 ms) : 0, 797879
BytebuddyAgent [candidate] (797.667 ms) : 0, 797667
AgentMeter [baseline] (11.304 ms) : 0, 11304
AgentMeter [candidate] (11.297 ms) : 0, 11297
GlobalTracer [baseline] (248.873 ms) : 0, 248873
GlobalTracer [candidate] (248.856 ms) : 0, 248856
IAST [baseline] (27.031 ms) : 0, 27031
IAST [candidate] (26.989 ms) : 0, 26989
AppSec [baseline] (34.892 ms) : 0, 34892
AppSec [candidate] (34.142 ms) : 0, 34142
Debugger [baseline] (64.908 ms) : 0, 64908
Debugger [candidate] (65.873 ms) : 0, 65873
Remote Config [baseline] (544.106 µs) : 0, 544
Remote Config [candidate] (522.265 µs) : 0, 522
Telemetry [baseline] (8.602 ms) : 0, 8602
Telemetry [candidate] (8.555 ms) : 0, 8555
Flare Poller [baseline] (3.48 ms) : 0, 3480
Flare Poller [candidate] (3.43 ms) : 0, 3430

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/gha-spec-tests
git_commit_date	1770896941	1770896959
git_commit_sha	`79fa8aa`	`004b18c`
release_version	1.60.0-SNAPSHOT~79fa8aa6a9	1.60.0-SNAPSHOT~004b18ce2c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1770899505	1770899505
ci_job_id	1420669160	1420669160
ci_pipeline_id	96059818	96059818
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-hd0wbxq1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-hd0wbxq1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 4 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	better [-163.247µs; -37.192µs] or [-9.470%; -2.158%]	unstable [-1125.209µs; -192.959µs] or [-21.729%; -3.726%]	unstable [-62.784op/s; +489.347op/s] or [-3.045%; +23.733%]	1.624ms	4.519ms	2275.125op/s	1.724ms	5.178ms	2061.844op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-194.459µs; -73.630µs] or [-6.978%; -2.642%]	unsure [-505.023µs; -14.860µs] or [-6.402%; -0.188%]	unstable [-77.000op/s; +231.125op/s] or [-6.027%; +18.090%]	2.653ms	7.629ms	1354.688op/s	2.787ms	7.889ms	1277.625op/s
scenario:load:insecure-bank:iast:high_load	worse [+115.473µs; +214.506µs] or [+4.774%; +8.869%]	unsure [+128.076µs; +550.741µs] or [+1.783%; +7.667%]	unstable [-228.392op/s; +105.767op/s] or [-15.796%; +7.315%]	2.584ms	7.523ms	1384.594op/s	2.419ms	7.184ms	1445.906op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.851ms; +2.300ms] or [+4.981%; +13.456%]	unstable [+0.391ms; +3.723ms] or [+1.369%; +13.040%]	unstable [-51.952op/s; +8.452op/s] or [-19.522%; +3.176%]	18.667ms	30.608ms	244.375op/s	17.092ms	28.551ms	266.125op/s
scenario:load:petclinic:appsec:high_load	worse [+1.173ms; +2.413ms] or [+6.494%; +13.355%]	worse [+1.433ms; +3.022ms] or [+4.853%; +10.230%]	unstable [-47.759op/s; +8.571op/s] or [-18.870%; +3.387%]	19.862ms	31.763ms	233.500op/s	18.069ms	29.536ms	253.094op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.534 ms) : 17359, 17709
.   : milestone, 17534,
appsec (18.437 ms) : 18250, 18625
.   : milestone, 18437,
code_origins (17.454 ms) : 17280, 17627
.   : milestone, 17454,
iast (17.906 ms) : 17729, 18083
.   : milestone, 17906,
profiling (18.708 ms) : 18519, 18898
.   : milestone, 18708,
tracing (17.648 ms) : 17470, 17826
.   : milestone, 17648,
section candidate
no_agent (19.102 ms) : 18903, 19300
.   : milestone, 19102,
appsec (19.993 ms) : 19784, 20201
.   : milestone, 19993,
code_origins (17.534 ms) : 17358, 17710
.   : milestone, 17534,
iast (18.674 ms) : 18485, 18863
.   : milestone, 18674,
profiling (18.575 ms) : 18390, 18761
.   : milestone, 18575,
tracing (17.734 ms) : 17555, 17912
.   : milestone, 17734,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.534 ms [17.359 ms, 17.709 ms]	-
appsec	18.437 ms [18.25 ms, 18.625 ms]	903.648 µs (5.2%)
code_origins	17.454 ms [17.28 ms, 17.627 ms]	-80.162 µs (-0.5%)
iast	17.906 ms [17.729 ms, 18.083 ms]	372.391 µs (2.1%)
profiling	18.708 ms [18.519 ms, 18.898 ms]	1.174 ms (6.7%)
tracing	17.648 ms [17.47 ms, 17.826 ms]	114.117 µs (0.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.102 ms [18.903 ms, 19.3 ms]	-
appsec	19.993 ms [19.784 ms, 20.201 ms]	891.119 µs (4.7%)
code_origins	17.534 ms [17.358 ms, 17.71 ms]	-1.568 ms (-8.2%)
iast	18.674 ms [18.485 ms, 18.863 ms]	-428.024 µs (-2.2%)
profiling	18.575 ms [18.39 ms, 18.761 ms]	-526.29 µs (-2.8%)
tracing	17.734 ms [17.555 ms, 17.912 ms]	-1.368 ms (-7.2%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.179 ms) : 1167, 1191
.   : milestone, 1179,
iast (3.169 ms) : 3121, 3217
.   : milestone, 3169,
iast_FULL (5.628 ms) : 5572, 5685
.   : milestone, 5628,
iast_GLOBAL (3.588 ms) : 3522, 3655
.   : milestone, 3588,
profiling (2.196 ms) : 2173, 2219
.   : milestone, 2196,
tracing (1.857 ms) : 1841, 1874
.   : milestone, 1857,
section candidate
no_agent (1.181 ms) : 1170, 1192
.   : milestone, 1181,
iast (3.306 ms) : 3262, 3350
.   : milestone, 3306,
iast_FULL (5.776 ms) : 5718, 5834
.   : milestone, 5776,
iast_GLOBAL (3.382 ms) : 3337, 3426
.   : milestone, 3382,
profiling (1.983 ms) : 1966, 2001
.   : milestone, 1983,
tracing (1.78 ms) : 1765, 1795
.   : milestone, 1780,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.179 ms [1.167 ms, 1.191 ms]	-
iast	3.169 ms [3.121 ms, 3.217 ms]	1.99 ms (168.8%)
iast_FULL	5.628 ms [5.572 ms, 5.685 ms]	4.449 ms (377.4%)
iast_GLOBAL	3.588 ms [3.522 ms, 3.655 ms]	2.409 ms (204.4%)
profiling	2.196 ms [2.173 ms, 2.219 ms]	1.017 ms (86.3%)
tracing	1.857 ms [1.841 ms, 1.874 ms]	678.427 µs (57.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.181 ms [1.17 ms, 1.192 ms]	-
iast	3.306 ms [3.262 ms, 3.35 ms]	2.125 ms (180.0%)
iast_FULL	5.776 ms [5.718 ms, 5.834 ms]	4.596 ms (389.3%)
iast_GLOBAL	3.382 ms [3.337 ms, 3.426 ms]	2.201 ms (186.4%)
profiling	1.983 ms [1.966 ms, 2.001 ms]	802.602 µs (68.0%)
tracing	1.78 ms [1.765 ms, 1.795 ms]	599.56 µs (50.8%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/gha-spec-tests
git_commit_date	1770896941	1770896959
git_commit_sha	`79fa8aa`	`004b18c`
release_version	1.60.0-SNAPSHOT~79fa8aa6a9	1.60.0-SNAPSHOT~004b18ce2c

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1770899237	1770899237
ci_job_id	1420669161	1420669161
ci_pipeline_id	96059818	96059818
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-9s87fkce 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-9s87fkce 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.574 s) : 15574000, 15574000
.   : milestone, 15574000,
appsec (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
iast (18.46 s) : 18460000, 18460000
.   : milestone, 18460000,
iast_GLOBAL (17.837 s) : 17837000, 17837000
.   : milestone, 17837000,
profiling (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
tracing (14.752 s) : 14752000, 14752000
.   : milestone, 14752000,
section candidate
no_agent (15.562 s) : 15562000, 15562000
.   : milestone, 15562000,
appsec (15.129 s) : 15129000, 15129000
.   : milestone, 15129000,
iast (18.224 s) : 18224000, 18224000
.   : milestone, 18224000,
iast_GLOBAL (18.205 s) : 18205000, 18205000
.   : milestone, 18205000,
profiling (15.505 s) : 15505000, 15505000
.   : milestone, 15505000,
tracing (14.663 s) : 14663000, 14663000
.   : milestone, 14663000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.574 s [15.574 s, 15.574 s]	-
appsec	15.04 s [15.04 s, 15.04 s]	-534.0 ms (-3.4%)
iast	18.46 s [18.46 s, 18.46 s]	2.886 s (18.5%)
iast_GLOBAL	17.837 s [17.837 s, 17.837 s]	2.263 s (14.5%)
profiling	14.969 s [14.969 s, 14.969 s]	-605.0 ms (-3.9%)
tracing	14.752 s [14.752 s, 14.752 s]	-822.0 ms (-5.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.562 s [15.562 s, 15.562 s]	-
appsec	15.129 s [15.129 s, 15.129 s]	-433.0 ms (-2.8%)
iast	18.224 s [18.224 s, 18.224 s]	2.662 s (17.1%)
iast_GLOBAL	18.205 s [18.205 s, 18.205 s]	2.643 s (17.0%)
profiling	15.505 s [15.505 s, 15.505 s]	-57.0 ms (-0.4%)
tracing	14.663 s [14.663 s, 14.663 s]	-899.0 ms (-5.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~004b18ce2c, baseline=1.60.0-SNAPSHOT~79fa8aa6a9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.513 ms) : 2458, 2568
.   : milestone, 2513,
iast (2.27 ms) : 2201, 2339
.   : milestone, 2270,
iast_GLOBAL (2.309 ms) : 2239, 2379
.   : milestone, 2309,
profiling (2.09 ms) : 2035, 2145
.   : milestone, 2090,
tracing (2.082 ms) : 2028, 2136
.   : milestone, 2082,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.805 ms) : 3583, 4026
.   : milestone, 3805,
iast (2.266 ms) : 2197, 2336
.   : milestone, 2266,
iast_GLOBAL (2.311 ms) : 2241, 2381
.   : milestone, 2311,
profiling (2.104 ms) : 2048, 2160
.   : milestone, 2104,
tracing (2.062 ms) : 2009, 2115
.   : milestone, 2062,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.464 ms, 1.487 ms]	-
appsec	2.513 ms [2.458 ms, 2.568 ms]	1.038 ms (70.3%)
iast	2.27 ms [2.201 ms, 2.339 ms]	794.471 µs (53.8%)
iast_GLOBAL	2.309 ms [2.239 ms, 2.379 ms]	833.476 µs (56.5%)
profiling	2.09 ms [2.035 ms, 2.145 ms]	614.753 µs (41.7%)
tracing	2.082 ms [2.028 ms, 2.136 ms]	606.281 µs (41.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.468 ms, 1.491 ms]	-
appsec	3.805 ms [3.583 ms, 4.026 ms]	2.325 ms (157.1%)
iast	2.266 ms [2.197 ms, 2.336 ms]	786.484 µs (53.1%)
iast_GLOBAL	2.311 ms [2.241 ms, 2.381 ms]	831.025 µs (56.2%)
profiling	2.104 ms [2.048 ms, 2.16 ms]	623.953 µs (42.2%)
tracing	2.062 ms [2.009 ms, 2.115 ms]	582.137 µs (39.3%)

chore: update GHA specs fixtures

bef4732

daniel-mohedano added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes labels Feb 12, 2026

Merge branch 'master' into daniel.mohedano/gha-spec-tests

004b18c

daniel-mohedano added the comp: ci visibility Continuous Integration Visibility label Feb 12, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update GitHub Actions spec tests fixtures #10574

Update GitHub Actions spec tests fixtures #10574

Uh oh!

daniel-mohedano commented Feb 12, 2026 •

edited

Loading

Uh oh!

pr-commenter bot commented Feb 12, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Update GitHub Actions spec tests fixtures #10574

Are you sure you want to change the base?

Update GitHub Actions spec tests fixtures #10574

Uh oh!

Conversation

daniel-mohedano commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Additional Information

Contributor Checklist

Uh oh!

pr-commenter bot commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

daniel-mohedano commented Feb 12, 2026 •

edited

Loading

pr-commenter bot commented Feb 12, 2026 •

edited

Loading