Skip to content

Add 1.4.3 vs 2.0.0 benchmark report - #194

Merged
ctreffs merged 5 commits into
mainfrom
benchmark-report-2.0.0
Nov 7, 2026
Merged

ctreffs merged 5 commits into
mainfrom
benchmark-report-2.0.0

Conversation

@ctreffs

@ctreffs ctreffs commented Nov 7, 2026 •

Copy link
Copy Markdown
Member

Adds the first committed benchmark report and links it from the README and the DocC Benchmarks article.

  • Documentation/Benchmarks/BenchmarkReport.html and BenchmarkReport.manifest.json: 1.4.3 (c85607bf) vs main labelled 2.0.0 (088e9173), baseline 1.4.3
  • Full selection (BENCHMARK_FILTER='.*'), 10 replicates, seed 2236095238, 1,383 benchmarks per round, Swift 6.4 (Xcode toolchain) for both refs
  • No toolchain, host or benchmark-set warnings; 0 of 1,383 cells show drift across rounds
  • README links the latest report (benchmarks/, version-agnostic); Benchmarks/README.md and Benchmarks.md (DocC) also link benchmarks/2.0.0/. Both URLs go live when the 2.0.0 tag publishes the report
  • make check-release-report RELEASE_VERSION=2.0.0 and make docs-check-links pass on this branch

Headline (wall clock, 2.0.0 vs 1.4.3): faster on every workload at larger entity counts: iteration 37–89×, system update 24–71×, component add / remove-add 3–7×, entity create 2–6×, lookup 1.4–3.4×. Only entity.create.empty at 1–4 entities is slower (+12–22%).

After merge: make check-release-report RELEASE_VERSION=2.0.0 RELEASE_TO=<merge-commit>, then tag 2.0.0. Keep main frozen until then.

@ctreffs
ctreffs marked this pull request as ready for review November 7, 2026 08:01
@ctreffs
ctreffs merged commit 0a62efe into main Nov 7, 2026
10 checks passed
@ctreffs
ctreffs deleted the benchmark-report-2.0.0 branch November 7, 2026 08:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant