Skip to content

docs(cutile): demonstrate recorded autotune dispatch - #1740

Draft
shuqi2077 wants to merge 1 commit into
NVIDIA:mainfrom
shuqi2077:docs/autotune-record-dispatch
Draft

shuqi2077 wants to merge 1 commit into
NVIDIA:mainfrom
shuqi2077:docs/autotune-record-dispatch

Conversation

@shuqi2077

Copy link
Copy Markdown

Summary

Addresses #1517 by extending the existing RMSNorm autotune example from printing a winner to actually consuming persisted winners in application dispatch.

Changes

  • Add separate tune RECORD_PATH and run RECORD_PATH modes. The run-only path never starts a tuning search.
  • Persist winners for two exact shape buckets, including measured timing/sample provenance and tagged L2 keys.
  • Build the current Workspace from source, architecture, assembler and search-space identity; reload through Record::load_verified and recompute keys using the same kernel builder used for execution.
  • Select an eligible recorded configuration by input shape, with a fixed fallback for a missing/rejected record or a missing bucket. Verification warnings are displayed and conservatively fall back as an explicit example policy.
  • Check candidate and dispatched outputs against a CPU RMSNorm reference. The no-argument demo exercises save/reload, both recorded buckets and an untuned fallback bucket, then removes its temporary record.
  • Document the complete workflow. No runtime API changes, new dependencies or imported RUDA implementation.

Review status

Draft: the required full Tile validation is still outstanding; this PR does not claim GPU validation or performance gains.

Contribution

Prepared with OpenAI Codex assistance. The commit includes DCO sign-off and a verified GitHub signature. Existing source attribution is preserved. No generated tuning records or internal development reports are included.

Connect offline RMSNorm tuning to verified record loading, per-shape dispatch and an explicit fallback.

Signed-off-by: Shuqi2077 <226209694+shuqi2077@users.noreply.github.com>
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@shuqi2077
shuqi2077 marked this pull request as ready for review November 4, 2026 10:34
@shuqi2077
shuqi2077 requested a review from elibol as a code owner November 4, 2026 10:34
@shuqi2077
shuqi2077 marked this pull request as draft November 4, 2026 10:34

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant