Skip to content

Commit 270b4ed

Browse files
mudlergithub-actions[bot]
authored andcommitted
chore(model gallery): 🤖 add new models via gallery agent
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
1 parent d3525b7 commit 270b4ed

1 file changed

Lines changed: 25 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,29 @@
11
---
2+
- name: "glm-4.7-flash"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/unsloth/GLM-4.7-Flash-GGUF
6+
description: |
7+
**GLM-4.7-Flash** is a 30B-A3B MoE (Model Organism Ensemble) model designed for efficient deployment. It outperforms competitors in benchmarks like AIME 25, GPQA, and τ²-Bench, offering strong accuracy while balancing performance and efficiency. Optimized for lightweight use cases, it supports inference via frameworks like vLLM and SGLang, with detailed deployment instructions in the official repository. Ideal for applications requiring high-quality text generation with minimal resource consumption.
8+
overrides:
9+
parameters:
10+
model: llama-cpp/models/GLM-4.7-Flash-Q4_K_M.gguf
11+
name: GLM-4.7-Flash-GGUF
12+
backend: llama-cpp
13+
template:
14+
use_tokenizer_template: true
15+
known_usecases:
16+
- chat
17+
function:
18+
grammar:
19+
disable: true
20+
description: Imported from https://huggingface.co/unsloth/GLM-4.7-Flash-GGUF
21+
options:
22+
- use_jinja:true
23+
files:
24+
- filename: llama-cpp/models/GLM-4.7-Flash-Q4_K_M.gguf
25+
sha256: c90d142243f7014ec1f8287d406cfbe87531659fb5a61e5e9503a5e493c524d2
26+
uri: https://huggingface.co/unsloth/GLM-4.7-Flash-GGUF/resolve/main/GLM-4.7-Flash-Q4_K_M.gguf
227
- name: "qwen3-vl-reranker-8b"
328
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
429
urls:

0 commit comments

Comments
 (0)