Popular repositories Loading

1. nano-vllm nano-vllm Public

   Forked from GeeeekExplorer/nano-vllm

   Nano vLLM

   Python 2 1

2. nano-vllm-prefillonly nano-vllm-prefillonly Public

   A specialized optimization of nano-vllm for prefill-only inference tasks, designed for industrial-scale discriminative applications with multimodal large language models

   Python 2

3. FlagEmbedding-MultiModal FlagEmbedding-MultiModal Public

   Forked from FlagOpen/FlagEmbedding

   Retrieval and Retrieval-augmented LLMs

   Python

4. iqa-odps-udtf iqa-odps-udtf Public

   A **modular and extensible** Java framework for **Image Quality Assessment (IQA)** as User Defined Table Functions (UDTF) for **Alibaba Cloud MaxCompute (ODPS)**. This project provides a production…

   Java

5. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python