Tag intermediate `initializationError` retries with `test.final_status=skip` in JUnit XML by cbeauchesne · Pull Request #11010 · DataDog/dd-trace-java

cbeauchesne · 2026-03-31T13:01:46Z

Motivation

When a JUnit setup method (e.g. @BeforeAll) fails and is retried via Gradle's retry plugin, Gradle generates a synthetic <testcase name="initializationError"> for each attempt. If the final retry succeeds, the build passes, but Test Optimization receives all intermediate failure entries with no indication that they were retried, making them appear as genuine failures in the dashboard.

What Does This Do

Add a doLast post-processor to every Test task that rewrites the JUnit XML reports after execution. For any suite with multiple initializationError testcases (i.e. retries occurred), all entries except the last one are tagged with:

<properties>                                                                                                                                                              
    <property name="dd_tags[test.final_status]" value="skip" />                                                                                                             
</properties>

The last entry is left unmodified, allowing Test Optimization to apply its default status inference based on the actual outcome. Files with only one (or zero) initializationError testcases are not modified.

The post-processor runs as a doLast action directly on the test task, keeping it within the task's up-to-date and caching scope so it doesn't interfere with downstream consumers of the JUnit reports.

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

buildSrc/src/main/kotlin/dd-trace-java.configure-tests.gradle.kts

github-actions · 2026-04-02T17:28:26Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

.gitlab/TagInitializationErrors.java

pr-commenter · 2026-04-07T14:35:59Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cbeauchesne/remove-initialization-error
git_commit_date	1776096266	1776097701
git_commit_sha	`4b85865`	`eed685e`
release_version	1.62.0-SNAPSHOT~4b85865643	1.61.0-SNAPSHOT~eed685e483

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776099562	1776099562
ci_job_id	1590518343	1590518343
ci_pipeline_id	107418214	107418214
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ex7exwf1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ex7exwf1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 12 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.063 s) : 0, 1062966
Total [baseline] (8.862 s) : 0, 8861779
Agent [candidate] (1.057 s) : 0, 1057325
Total [candidate] (8.85 s) : 0, 8849764
section iast
Agent [baseline] (1.225 s) : 0, 1225192
Total [baseline] (9.616 s) : 0, 9615607
Agent [candidate] (1.229 s) : 0, 1229113
Total [candidate] (9.609 s) : 0, 9609457

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.063 s	-
Agent	iast	1.225 s	162.226 ms (15.3%)
Total	tracing	8.862 s	-
Total	iast	9.616 s	753.828 ms (8.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	iast	1.229 s	171.788 ms (16.2%)
Total	tracing	8.85 s	-
Total	iast	9.609 s	759.693 ms (8.6%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.247 ms) : 0, 1247
crashtracking [candidate] (1.224 ms) : 0, 1224
BytebuddyAgent [baseline] (636.572 ms) : 0, 636572
BytebuddyAgent [candidate] (632.871 ms) : 0, 632871
AgentMeter [baseline] (29.576 ms) : 0, 29576
AgentMeter [candidate] (29.332 ms) : 0, 29332
GlobalTracer [baseline] (249.618 ms) : 0, 249618
GlobalTracer [candidate] (248.706 ms) : 0, 248706
AppSec [baseline] (32.234 ms) : 0, 32234
AppSec [candidate] (32.124 ms) : 0, 32124
Debugger [baseline] (59.618 ms) : 0, 59618
Debugger [candidate] (59.256 ms) : 0, 59256
Remote Config [baseline] (604.483 µs) : 0, 604
Remote Config [candidate] (592.683 µs) : 0, 593
Telemetry [baseline] (8.096 ms) : 0, 8096
Telemetry [candidate] (8.082 ms) : 0, 8082
Flare Poller [baseline] (9.222 ms) : 0, 9222
Flare Poller [candidate] (9.124 ms) : 0, 9124
section iast
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (801.781 ms) : 0, 801781
BytebuddyAgent [candidate] (806.176 ms) : 0, 806176
AgentMeter [baseline] (11.356 ms) : 0, 11356
AgentMeter [candidate] (11.427 ms) : 0, 11427
GlobalTracer [baseline] (239.47 ms) : 0, 239470
GlobalTracer [candidate] (239.647 ms) : 0, 239647
IAST [baseline] (26.676 ms) : 0, 26676
IAST [candidate] (25.836 ms) : 0, 25836
AppSec [baseline] (31.243 ms) : 0, 31243
AppSec [candidate] (30.937 ms) : 0, 30937
Debugger [baseline] (61.12 ms) : 0, 61120
Debugger [candidate] (61.307 ms) : 0, 61307
Remote Config [baseline] (1.124 ms) : 0, 1124
Remote Config [candidate] (1.684 ms) : 0, 1684
Telemetry [baseline] (11.395 ms) : 0, 11395
Telemetry [candidate] (11.147 ms) : 0, 11147
Flare Poller [baseline] (3.47 ms) : 0, 3470
Flare Poller [candidate] (3.511 ms) : 0, 3511

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068636
Total [baseline] (11.136 s) : 0, 11136415
Agent [candidate] (1.055 s) : 0, 1054993
Total [candidate] (11.183 s) : 0, 11183409
section appsec
Agent [baseline] (1.259 s) : 0, 1258670
Total [baseline] (11.118 s) : 0, 11118174
Agent [candidate] (1.256 s) : 0, 1255729
Total [candidate] (11.214 s) : 0, 11213536
section iast
Agent [baseline] (1.226 s) : 0, 1225692
Total [baseline] (11.298 s) : 0, 11298146
Agent [candidate] (1.221 s) : 0, 1221022
Total [candidate] (11.327 s) : 0, 11327266
section profiling
Agent [baseline] (1.188 s) : 0, 1188286
Total [baseline] (11.107 s) : 0, 11106972
Agent [candidate] (1.183 s) : 0, 1182927
Total [candidate] (11.169 s) : 0, 11168712

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.069 s	-
Agent	appsec	1.259 s	190.034 ms (17.8%)
Agent	iast	1.226 s	157.056 ms (14.7%)
Agent	profiling	1.188 s	119.65 ms (11.2%)
Total	tracing	11.136 s	-
Total	appsec	11.118 s	-18.241 ms (-0.2%)
Total	iast	11.298 s	161.731 ms (1.5%)
Total	profiling	11.107 s	-29.443 ms (-0.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	appsec	1.256 s	200.737 ms (19.0%)
Agent	iast	1.221 s	166.029 ms (15.7%)
Agent	profiling	1.183 s	127.934 ms (12.1%)
Total	tracing	11.183 s	-
Total	appsec	11.214 s	30.126 ms (0.3%)
Total	iast	11.327 s	143.857 ms (1.3%)
Total	profiling	11.169 s	-14.697 ms (-0.1%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (637.908 ms) : 0, 637908
BytebuddyAgent [candidate] (631.345 ms) : 0, 631345
AgentMeter [baseline] (29.833 ms) : 0, 29833
AgentMeter [candidate] (29.316 ms) : 0, 29316
GlobalTracer [baseline] (251.446 ms) : 0, 251446
GlobalTracer [candidate] (248.56 ms) : 0, 248560
AppSec [baseline] (32.406 ms) : 0, 32406
AppSec [candidate] (31.913 ms) : 0, 31913
Debugger [baseline] (60.782 ms) : 0, 60782
Debugger [candidate] (59.781 ms) : 0, 59781
Remote Config [baseline] (611.485 µs) : 0, 611
Remote Config [candidate] (596.318 µs) : 0, 596
Telemetry [baseline] (8.211 ms) : 0, 8211
Telemetry [candidate] (8.117 ms) : 0, 8117
Flare Poller [baseline] (9.869 ms) : 0, 9869
Flare Poller [candidate] (8.049 ms) : 0, 8049
section appsec
crashtracking [baseline] (1.276 ms) : 0, 1276
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (670.817 ms) : 0, 670817
BytebuddyAgent [candidate] (667.035 ms) : 0, 667035
AgentMeter [baseline] (12.183 ms) : 0, 12183
AgentMeter [candidate] (12.109 ms) : 0, 12109
GlobalTracer [baseline] (249.322 ms) : 0, 249322
GlobalTracer [candidate] (250.324 ms) : 0, 250324
AppSec [baseline] (184.628 ms) : 0, 184628
AppSec [candidate] (184.937 ms) : 0, 184937
Debugger [baseline] (66.429 ms) : 0, 66429
Debugger [candidate] (65.966 ms) : 0, 65966
Remote Config [baseline] (599.045 µs) : 0, 599
Remote Config [candidate] (604.143 µs) : 0, 604
Telemetry [baseline] (8.525 ms) : 0, 8525
Telemetry [candidate] (8.839 ms) : 0, 8839
Flare Poller [baseline] (3.546 ms) : 0, 3546
Flare Poller [candidate] (3.607 ms) : 0, 3607
IAST [baseline] (24.684 ms) : 0, 24684
IAST [candidate] (24.666 ms) : 0, 24666
section iast
crashtracking [baseline] (1.225 ms) : 0, 1225
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (802.506 ms) : 0, 802506
BytebuddyAgent [candidate] (798.199 ms) : 0, 798199
AgentMeter [baseline] (11.396 ms) : 0, 11396
AgentMeter [candidate] (11.36 ms) : 0, 11360
GlobalTracer [baseline] (239.613 ms) : 0, 239613
GlobalTracer [candidate] (238.422 ms) : 0, 238422
AppSec [baseline] (31.851 ms) : 0, 31851
AppSec [candidate] (30.183 ms) : 0, 30183
Debugger [baseline] (61.999 ms) : 0, 61999
Debugger [candidate] (60.863 ms) : 0, 60863
Remote Config [baseline] (539.832 µs) : 0, 540
Remote Config [candidate] (535.146 µs) : 0, 535
Telemetry [baseline] (10.994 ms) : 0, 10994
Telemetry [candidate] (13.823 ms) : 0, 13823
Flare Poller [baseline] (3.436 ms) : 0, 3436
Flare Poller [candidate] (3.758 ms) : 0, 3758
IAST [baseline] (25.827 ms) : 0, 25827
IAST [candidate] (26.591 ms) : 0, 26591
section profiling
ProfilingAgent [baseline] (94.561 ms) : 0, 94561
ProfilingAgent [candidate] (93.652 ms) : 0, 93652
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.178 ms) : 0, 1178
BytebuddyAgent [baseline] (693.668 ms) : 0, 693668
BytebuddyAgent [candidate] (691.053 ms) : 0, 691053
AgentMeter [baseline] (9.096 ms) : 0, 9096
AgentMeter [candidate] (9.101 ms) : 0, 9101
GlobalTracer [baseline] (207.641 ms) : 0, 207641
GlobalTracer [candidate] (206.869 ms) : 0, 206869
AppSec [baseline] (32.632 ms) : 0, 32632
AppSec [candidate] (32.492 ms) : 0, 32492
Debugger [baseline] (65.976 ms) : 0, 65976
Debugger [candidate] (65.477 ms) : 0, 65477
Remote Config [baseline] (576.894 µs) : 0, 577
Remote Config [candidate] (562.728 µs) : 0, 563
Telemetry [baseline] (7.925 ms) : 0, 7925
Telemetry [candidate] (7.847 ms) : 0, 7847
Flare Poller [baseline] (3.601 ms) : 0, 3601
Flare Poller [candidate] (3.516 ms) : 0, 3516
Profiling [baseline] (95.143 ms) : 0, 95143
Profiling [candidate] (94.219 ms) : 0, 94219

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cbeauchesne/remove-initialization-error
git_commit_date	1776096266	1776097701
git_commit_sha	`4b85865`	`eed685e`
release_version	1.62.0-SNAPSHOT~4b85865643	1.61.0-SNAPSHOT~eed685e483

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776099877	1776099877
ci_job_id	1590518345	1590518345
ci_pipeline_id	107418214	107418214
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-rykmzjfc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-rykmzjfc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	better [-196.434µs; -55.267µs] or [-10.567%; -2.973%]	unstable [-1086.495µs; -108.514µs] or [-18.966%; -1.894%]	unstable [-26.616op/s; +475.679op/s] or [-1.399%; +25.001%]	1.733ms	5.131ms	2127.188op/s	1.859ms	5.729ms	1902.656op/s
scenario:load:insecure-bank:iast:high_load	better [-210.039µs; -88.228µs] or [-7.812%; -3.281%]	unsure [-625.756µs; -121.404µs] or [-8.000%; -1.552%]	unstable [-95.304op/s; +215.679op/s] or [-7.119%; +16.112%]	2.540ms	7.448ms	1398.844op/s	2.689ms	7.822ms	1338.656op/s
scenario:load:insecure-bank:iast_FULL:high_load	worse [+263.666µs; +555.280µs] or [+5.065%; +10.666%]	unsure [+163.809µs; +839.430µs] or [+1.301%; +6.668%]	unstable [-127.387op/s; +33.824op/s] or [-16.205%; +4.303%]	5.616ms	13.091ms	739.312op/s	5.206ms	12.589ms	786.094op/s
scenario:load:petclinic:no_agent:high_load	better [-2.038ms; -0.531ms] or [-10.626%; -2.766%]	unsure [-3.394ms; -0.374ms] or [-10.647%; -1.172%]	unstable [-7.517op/s; +41.829op/s] or [-3.171%; +17.647%]	17.899ms	29.999ms	254.188op/s	19.183ms	31.883ms	237.031op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.241 ms) : 1230, 1253
.   : milestone, 1241,
iast (3.423 ms) : 3372, 3474
.   : milestone, 3423,
iast_FULL (5.88 ms) : 5821, 5940
.   : milestone, 5880,
iast_GLOBAL (3.7 ms) : 3640, 3760
.   : milestone, 3700,
profiling (2.386 ms) : 2362, 2411
.   : milestone, 2386,
tracing (1.848 ms) : 1833, 1863
.   : milestone, 1848,
section candidate
no_agent (1.332 ms) : 1317, 1347
.   : milestone, 1332,
iast (3.271 ms) : 3223, 3318
.   : milestone, 3271,
iast_FULL (6.26 ms) : 6195, 6325
.   : milestone, 6260,
iast_GLOBAL (3.741 ms) : 3681, 3800
.   : milestone, 3741,
profiling (2.125 ms) : 2107, 2143
.   : milestone, 2125,
tracing (1.948 ms) : 1930, 1967
.   : milestone, 1948,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.241 ms [1.23 ms, 1.253 ms]	-
iast	3.423 ms [3.372 ms, 3.474 ms]	2.182 ms (175.8%)
iast_FULL	5.88 ms [5.821 ms, 5.94 ms]	4.639 ms (373.7%)
iast_GLOBAL	3.7 ms [3.64 ms, 3.76 ms]	2.459 ms (198.1%)
profiling	2.386 ms [2.362 ms, 2.411 ms]	1.145 ms (92.2%)
tracing	1.848 ms [1.833 ms, 1.863 ms]	606.888 µs (48.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.332 ms [1.317 ms, 1.347 ms]	-
iast	3.271 ms [3.223 ms, 3.318 ms]	1.939 ms (145.5%)
iast_FULL	6.26 ms [6.195 ms, 6.325 ms]	4.928 ms (370.0%)
iast_GLOBAL	3.741 ms [3.681 ms, 3.8 ms]	2.409 ms (180.9%)
profiling	2.125 ms [2.107 ms, 2.143 ms]	793.003 µs (59.5%)
tracing	1.948 ms [1.93 ms, 1.967 ms]	616.497 µs (46.3%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.694 ms) : 19491, 19897
.   : milestone, 19694,
appsec (18.515 ms) : 18328, 18703
.   : milestone, 18515,
code_origins (17.887 ms) : 17708, 18065
.   : milestone, 17887,
iast (18.132 ms) : 17954, 18309
.   : milestone, 18132,
profiling (18.623 ms) : 18441, 18804
.   : milestone, 18623,
tracing (17.93 ms) : 17750, 18109
.   : milestone, 17930,
section candidate
no_agent (18.355 ms) : 18167, 18544
.   : milestone, 18355,
appsec (18.748 ms) : 18560, 18936
.   : milestone, 18748,
code_origins (18.012 ms) : 17833, 18192
.   : milestone, 18012,
iast (18.514 ms) : 18330, 18697
.   : milestone, 18514,
profiling (19.18 ms) : 18990, 19370
.   : milestone, 19180,
tracing (17.982 ms) : 17805, 18158
.   : milestone, 17982,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.694 ms [19.491 ms, 19.897 ms]	-
appsec	18.515 ms [18.328 ms, 18.703 ms]	-1.179 ms (-6.0%)
code_origins	17.887 ms [17.708 ms, 18.065 ms]	-1.807 ms (-9.2%)
iast	18.132 ms [17.954 ms, 18.309 ms]	-1.563 ms (-7.9%)
profiling	18.623 ms [18.441 ms, 18.804 ms]	-1.072 ms (-5.4%)
tracing	17.93 ms [17.75 ms, 18.109 ms]	-1.765 ms (-9.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.355 ms [18.167 ms, 18.544 ms]	-
appsec	18.748 ms [18.56 ms, 18.936 ms]	393.114 µs (2.1%)
code_origins	18.012 ms [17.833 ms, 18.192 ms]	-342.858 µs (-1.9%)
iast	18.514 ms [18.33 ms, 18.697 ms]	158.451 µs (0.9%)
profiling	19.18 ms [18.99 ms, 19.37 ms]	824.673 µs (4.5%)
tracing	17.982 ms [17.805 ms, 18.158 ms]	-373.529 µs (-2.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	cbeauchesne/remove-initialization-error
git_commit_date	1776096266	1776097701
git_commit_sha	`4b85865`	`eed685e`
release_version	1.62.0-SNAPSHOT~4b85865643	1.61.0-SNAPSHOT~eed685e483

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1776099651	1776099651
ci_job_id	1590518346	1590518346
ci_pipeline_id	107418214	107418214
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-jrsna9qc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-jrsna9qc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.006 s) : 15006000, 15006000
.   : milestone, 15006000,
appsec (14.708 s) : 14708000, 14708000
.   : milestone, 14708000,
iast (18.496 s) : 18496000, 18496000
.   : milestone, 18496000,
iast_GLOBAL (18.119 s) : 18119000, 18119000
.   : milestone, 18119000,
profiling (14.872 s) : 14872000, 14872000
.   : milestone, 14872000,
tracing (15.263 s) : 15263000, 15263000
.   : milestone, 15263000,
section candidate
no_agent (15.498 s) : 15498000, 15498000
.   : milestone, 15498000,
appsec (14.812 s) : 14812000, 14812000
.   : milestone, 14812000,
iast (17.964 s) : 17964000, 17964000
.   : milestone, 17964000,
iast_GLOBAL (18.249 s) : 18249000, 18249000
.   : milestone, 18249000,
profiling (14.782 s) : 14782000, 14782000
.   : milestone, 14782000,
tracing (14.962 s) : 14962000, 14962000
.   : milestone, 14962000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.006 s [15.006 s, 15.006 s]	-
appsec	14.708 s [14.708 s, 14.708 s]	-298.0 ms (-2.0%)
iast	18.496 s [18.496 s, 18.496 s]	3.49 s (23.3%)
iast_GLOBAL	18.119 s [18.119 s, 18.119 s]	3.113 s (20.7%)
profiling	14.872 s [14.872 s, 14.872 s]	-134.0 ms (-0.9%)
tracing	15.263 s [15.263 s, 15.263 s]	257.0 ms (1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.498 s [15.498 s, 15.498 s]	-
appsec	14.812 s [14.812 s, 14.812 s]	-686.0 ms (-4.4%)
iast	17.964 s [17.964 s, 17.964 s]	2.466 s (15.9%)
iast_GLOBAL	18.249 s [18.249 s, 18.249 s]	2.751 s (17.8%)
profiling	14.782 s [14.782 s, 14.782 s]	-716.0 ms (-4.6%)
tracing	14.962 s [14.962 s, 14.962 s]	-536.0 ms (-3.5%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~eed685e483, baseline=1.62.0-SNAPSHOT~4b85865643
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.491 ms) : 1480, 1503
.   : milestone, 1491,
appsec (3.852 ms) : 3629, 4075
.   : milestone, 3852,
iast (2.269 ms) : 2200, 2339
.   : milestone, 2269,
iast_GLOBAL (2.318 ms) : 2248, 2387
.   : milestone, 2318,
profiling (2.112 ms) : 2057, 2168
.   : milestone, 2112,
tracing (2.083 ms) : 2029, 2137
.   : milestone, 2083,
section candidate
no_agent (1.491 ms) : 1480, 1503
.   : milestone, 1491,
appsec (3.746 ms) : 3530, 3962
.   : milestone, 3746,
iast (2.273 ms) : 2204, 2343
.   : milestone, 2273,
iast_GLOBAL (2.319 ms) : 2249, 2388
.   : milestone, 2319,
profiling (2.101 ms) : 2046, 2156
.   : milestone, 2101,
tracing (2.088 ms) : 2034, 2142
.   : milestone, 2088,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.491 ms [1.48 ms, 1.503 ms]	-
appsec	3.852 ms [3.629 ms, 4.075 ms]	2.361 ms (158.3%)
iast	2.269 ms [2.2 ms, 2.339 ms]	778.054 µs (52.2%)
iast_GLOBAL	2.318 ms [2.248 ms, 2.387 ms]	826.25 µs (55.4%)
profiling	2.112 ms [2.057 ms, 2.168 ms]	621.053 µs (41.6%)
tracing	2.083 ms [2.029 ms, 2.137 ms]	592.023 µs (39.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.491 ms [1.48 ms, 1.503 ms]	-
appsec	3.746 ms [3.53 ms, 3.962 ms]	2.255 ms (151.2%)
iast	2.273 ms [2.204 ms, 2.343 ms]	782.229 µs (52.5%)
iast_GLOBAL	2.319 ms [2.249 ms, 2.388 ms]	827.47 µs (55.5%)
profiling	2.101 ms [2.046 ms, 2.156 ms]	609.61 µs (40.9%)
tracing	2.088 ms [2.034 ms, 2.142 ms]	596.842 µs (40.0%)

.gitlab/TagInitializationErrors.java

Co-authored-by: Brice Dutheil <brice.dutheil@gmail.com>

Removes Initialization error from junit XML

c42a128

cbeauchesne added the tag: ai generated Largely based on code generated by an AI or LLM label Mar 31, 2026

bric3 reviewed Mar 31, 2026

View reviewed changes

Address comments

1f3708d

cbeauchesne changed the title ~~Removes Initialization error from junit XML~~ Tag intermediate initializationError retries with test.final_status=skip in JUnit XML Mar 31, 2026

cbeauchesne added 3 commits April 1, 2026 19:18

Use java script

c044bba

apply the logic by classname

c1bbc59

Use JAVA_25_HOME

fc75f5f

cbeauchesne force-pushed the cbeauchesne/remove-initialization-error branch from eb73143 to fc75f5f Compare April 2, 2026 09:14

cbeauchesne added 4 commits April 2, 2026 14:39

Merge branch 'master' into cbeauchesne/remove-initialization-error

42fbf91

Merge branch 'master' into cbeauchesne/remove-initialization-error

492abbc

Do not tag if the property already exists

814275c

Merge branch 'master' into cbeauchesne/remove-initialization-error

4af16af

cbeauchesne marked this pull request as ready for review April 2, 2026 17:28

cbeauchesne requested a review from a team as a code owner April 2, 2026 17:28

cbeauchesne requested review from erikayasuda and removed request for a team April 2, 2026 17:28

cbeauchesne added type: enhancement Enhancements and improvements comp: tooling Build & Tooling labels Apr 3, 2026

bric3 changed the title ~~Tag intermediate initializationError retries with test.final_status=skip in JUnit XML~~ Tag intermediate initializationError retries with test.final_status=skip in JUnit XML Apr 3, 2026

PerfectSlayer reviewed Apr 7, 2026

View reviewed changes

.gitlab/TagInitializationErrors.java Outdated Show resolved Hide resolved

.gitlab/TagInitializationErrors.java Outdated Show resolved Hide resolved

Better comment

899ee14

bric3 reviewed Apr 9, 2026

View reviewed changes

cbeauchesne and others added 5 commits April 9, 2026 14:23

Update .gitlab/TagInitializationErrors.java

96b50d9

Co-authored-by: Brice Dutheil <brice.dutheil@gmail.com>

Update .gitlab/TagInitializationErrors.java

e98c700

Co-authored-by: Brice Dutheil <brice.dutheil@gmail.com>

Update .gitlab/TagInitializationErrors.java

d904031

Co-authored-by: Brice Dutheil <brice.dutheil@gmail.com>

Add before/after in comment

1b5a33e

Write output to a temp file then atomically rename it

3494f99

cbeauchesne added 2 commits April 13, 2026 18:22

Merge branch 'master' into cbeauchesne/remove-initialization-error

2cd5934

Add XML configuration

eed685e

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Tag intermediate `initializationError` retries with `test.final_status=skip` in JUnit XML#11010

Tag intermediate `initializationError` retries with `test.final_status=skip` in JUnit XML#11010
cbeauchesne wants to merge 17 commits intomasterfrom
cbeauchesne/remove-initialization-error

cbeauchesne commented Mar 31, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Apr 2, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

pr-commenter bot commented Apr 7, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

cbeauchesne commented Mar 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation

What Does This Do

Additional Notes

Contributor Checklist

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions bot commented Apr 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

pr-commenter bot commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cbeauchesne commented Mar 31, 2026 •

edited

Loading

github-actions bot commented Apr 2, 2026 •

edited

Loading

pr-commenter bot commented Apr 7, 2026 •

edited

Loading