Skip to content

docs(roadmap): plan attested hosted inference as a model-provider backend - #66

Closed
SashaMIT wants to merge 1 commit into
feat/0.7.1-integrationfrom
docs/roadmap-attested-hosted-inference
Closed

SashaMIT wants to merge 1 commit into
feat/0.7.1-integrationfrom
docs/roadmap-attested-hosted-inference

Conversation

@SashaMIT

@SashaMIT SashaMIT commented Sep 16, 2026 •

Copy link
Copy Markdown
Contributor

One paragraph under "AI and operator surfaces", docs only, stacked on feat/0.7.1-integration @ 093b51c.

Records the direction you and Rong converged on this week (NEAR/Venice-style enclave inference) as a planned model-provider backend rather than a new provider:

  • Step 1 is configuration only: one open_ai_compatible_text offer beside the local offer, so the Assistant treats local and attested-hosted placements as the same capability.
  • Step 2 is an adapter variant that fetches and verifies the attestation inside the provider and records the verdict on the run — "verified" becomes a Runtime fact, not a UI label.
  • Hosted offers must carry the privacy/cost/limit/resolved-model facts from docs/MODEL_PROVIDER.md before publication; the external verifier is an audited dependency, not a trust root.
  • Your requirement from the thread, added verbatim in intent: when another owner's Runtime brokers the service, the prompt is encrypted to the verified execution environment itself, so the broker routes and meters without reading; a broker that can read the prompt is a hosted route and is disclosed as one.

No contract, code or schedule changes. Freeze-safe.

Made with Cursor

Part of #85.

…kend

Hosted services that run open models in hardware enclaves and sign each
response are a placement of the existing typed model capability, not a new
provider. Record the two-step path: a configuration-only OpenAI-compatible
offer beside the local one, then an adapter variant that verifies the
attestation inside model-provider and records the verdict on the run.
Hosted offers carry the privacy, cost, limit, and resolved-model facts
docs/MODEL_PROVIDER.md already requires.

Co-authored-by: Cursor <cursoragent@cursor.com>
@irzhywau irzhywau added this to the 0.7.1 milestone Sep 29, 2026
@SashaMIT

Copy link
Copy Markdown
Contributor Author

Closing for now, as agreed. The attested hosted inference plan will come back reworked on the Runtime Inbox approval path.

@SashaMIT SashaMIT closed this Sep 29, 2026
@andersalm andersalm mentioned this pull request Sep 29, 2026
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants