Pinned Loading

1. sendnn-inference sendnn-inference Public

   Forked from torch-spyre/sendnn-inference

   Community maintained hardware plugin for vLLM on Spyre

   Python

2. spyre-inference spyre-inference Public

   Forked from torch-spyre/spyre-inference

   vLLM plugin for Spyre based on torch-spyre

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. fms-fsdp fms-fsdp Public

   Forked from foundation-model-stack/fms-fsdp

   🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

   Python

5. foundation-model-stack foundation-model-stack Public

   Forked from foundation-model-stack/foundation-model-stack

   🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

   Python