Pinned Loading

1. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python 156k 31.9k

2. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 2.4k 300

3. intel/neural-compressor intel/neural-compressor Public

   SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

   Python 2.6k 295

4. ai-dynamo/dynamo ai-dynamo/dynamo Public

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 6k 825

5. ai-dynamo/aiconfigurator ai-dynamo/aiconfigurator Public

   Offline optimization of your disaggregated Dynamo graph

   Python 176 54

6. xtalker xtalker Public

   Faster Talking Face Animation on Xeon CPU

   Python 130 9