Skip to content

CI: Fix daily benchmarks pipeline#6482

Draft
martintomazic wants to merge 2 commits intomasterfrom
martin/trivial/disable-metrics-collection
Draft

CI: Fix daily benchmarks pipeline#6482
martintomazic wants to merge 2 commits intomasterfrom
martin/trivial/disable-metrics-collection

Conversation

@martintomazic
Copy link
Copy Markdown
Contributor

@martintomazic martintomazic commented Mar 25, 2026

Closes #6486.

Daily benchmarks and and long test pipelines have been failing for a while: https://buildkite.com/oasisprotocol
as the push gateway (https://pushgateway-buildkite.ops.oasiscloud.io) doesn't exist anymore.

They weren't used for 1 year+, neither are metrics and their regression from light e2e tests representative therefore we can safely disable them if not remove.

Lets open a new issue instead for creating a new pipeline that triggers on the new oasis-core release and starts a representative load (e.g. sync from latest checkpoint or few months back in time) and check performance regression + store relevant artifacts long time.

@netlify
Copy link
Copy Markdown

netlify bot commented Mar 25, 2026

Deploy Preview for oasisprotocol-oasis-core canceled.

Name Link
🔨 Latest commit 0a5f1f6
🔍 Latest deploy log https://app.netlify.com/projects/oasisprotocol-oasis-core/deploys/69c3e3f0edb62400082024ec

@martintomazic martintomazic force-pushed the martin/trivial/disable-metrics-collection branch from 8c852e7 to 5380a5e Compare March 25, 2026 11:59
Comment on lines +136 to +138
# # Wait for all jobs defined before this point
# # to finish running in parallel before continuing.
# - wait
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We might as well clean the some other env variables etc if we are serious about deprecating this. Commenting for the start is definitely improvement.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are daily benchmarks still needed as a daily sanity? Maybe rename the pipeline if this is basically daily sanity (e.g. if no PRs happen).

This matches the parallelization and timeout of the
code.pipeline.yml that also runs all default scenarios.
@martintomazic
Copy link
Copy Markdown
Contributor Author

Long test seems to work:

Daily benchmarks seems to be stuck at reading non-existing stuff, likely a config/pipeline issue (exploring):

@martintomazic martintomazic changed the title CI: Disable pushing to non-existent push gateway during e2e test CI: Fix daily benchmarks pipeline Mar 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix failing daily benchmarks pipeline

1 participant