Skip to content

Conversation

@KOKOSde
Copy link

@KOKOSde KOKOSde commented Jan 31, 2026

Docs: add an AWS deployment + benchmarking guide for TGI.

  • Adds a tutorial page covering EC2 (Docker) and SageMaker real-time endpoints.
  • Includes a practical benchmarking section (what to measure + a warmup/load-test workflow).
  • Links the new page from the docs toctree.

Docs-only change.

- Add an AWS deployment tutorial for EC2 + SageMaker
- Fix SageMaker example indentation and link to the new guide
- Add the new guide to the docs toctree
@KOKOSde KOKOSde force-pushed the docs/aws-deployment-benchmarks branch from 8d9a09d to ae18647 Compare February 4, 2026 00:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant