v4.1.0 #9205

mudler · 2026-04-02T22:14:49Z

mudler
Apr 2, 2026
Maintainer

🎉 LocalAI 4.1.0 Release! 🚀

LocalAI 4.1.0 is out! 🔥

Just weeks after the landmark 4.0, we're back with another massive drop. This release turns LocalAI into a production-grade AI platform: spin up a distributed cluster with smart routing and autoscaling, lock it down with built-in auth and per-user quotas, fine-tune models without leaving the UI, and much more. If 4.0 was the foundation, 4.1 is the control tower.

Feature	Summary
🌐 Distributed Mode	Run LocalAI as a cluster — smart routing, node groups, drain/resume, min/max autoscaling.
🔐 Users & Auth	Built-in user management with OIDC, invite mode, API keys, and admin impersonation.
📊 Quota System	Per-user usage quotas with predictive analytics and breakdown dashboards.
🧪 Fine-Tuning	(experimental) Fine-tune models with TRL, auto-export to GGUF, and import back — all from the UI.
⚗️ Quantization	(experimental) New backend for on-the-fly model quantization.
🔧 Pipeline Editor	Visual model pipeline editor in the React UI.
🤖 Standalone Agents	Run agents from the CLI with `local-ai agent run`.
🧠 Smart Inferencing	Auto inference defaults from Unsloth, tool parsing fallback, and `min_p` support.
🎬 Media History	Browse past generated images and media in Studio pages.

New (long version) Full setup walktrough: https://www.youtube.com/watch?v=cMVNnlqwfw4

🚀 Key Features

🌐 Distributed Mode: scaling LocalAI horizontally

Run LocalAI as a distributed cluster and let it figure out where to send your requests. No more single-node bottlenecks.

Smart Routing: Requests are routed to nodes ordered by available VRAM — the beefiest, free GPU gets the job.
Node Groups: Pin models to specific node groups for workload isolation (e.g., "gpu-heavy" vs "cpu-light").
Autoscaling: Built-in min/max autoscaler with a node reconciler that manages the lifecycle automatically.
Drain & Resume: Gracefully drain nodes for maintenance and bring them back with a single API call.
Cluster Dashboard: See your entire cluster status at a glance from the home page.
Smart Model transfer: Use S3 or transfer via peer to peer

distributed-mode.mp4

🔐 Users, Authentication & Quotas

LocalAI now ships with a complete multi-user platform — perfect for teams, classrooms, or any shared deployment.

User Management: Create, edit, and manage users from the React UI.
OIDC/OAuth: Plug in your identity provider for SSO — Google, Keycloak, Authentik, you name it.
Invite Mode: Restrict registration to invite-only with admin approval.
API Keys: Per-user API key management.
Admin Powers: Admins can impersonate users for debugging.
Quota System: Set per-user usage quotas and enforce limits.
Usage Analytics: Predictive usage dashboard with per-user breakdown statistics.

Users and quota:

usersquota-1775167475876.mp4

Usage metrics per user:

usage.mp4

🧪 Fine-Tuning & Quantization

No more juggling external tools. Fine-tune and quantize directly inside LocalAI.

Fine-Tuning with TRL (Experimental): Train LoRA adapters with Hugging Face TRL, auto-export to GGUF, and import the result straight back into LocalAI. Includes a built-in evals framework to validate your work.
Quantization Backend: Spin up the new quantization backend to create optimized model variants on-the-fly.

quantize-fine-tune.mp4

🎨 UI

The React UI keeps getting better. This release adds serious power-user features:

Model Pipeline Editor: Visually wire up model pipelines — no YAML editing required.
Per-Model Backend Logs: Drill into logs scoped to individual models for laser-focused debugging.
Media History: Studio pages now remember your past generations — images, audio, and more.
Searchable Model/Backend Selector: Quickly find models and backends with inline search and filtering.
Structured Error Toasts: Errors now link directly to traces — one click from "something broke" to "here's why."
Tracing Settings: Inline tracing config restored with a cleaner UI.

talk.mp4

🤖 Agents & Inference

Standalone Agent Mode: Run agents straight from the terminal with local-ai agent run. Supports single-turn --prompt mode and pool-based configurations from pool.json.
Streaming Tool Calls: Agent mode tool calls now stream in real-time, with interleaved thinking fixed.
Inferencing Defaults: Automatic inference parameters sourced from Unsloth and applied to all endpoints and gallery models, your models just work better out of the box.
Tool Parsing Fallback: When native tool call parsing fails, an iterative fallback parser kicks in automatically.

🛠️ Under the Hood

Repeated Log Merging: Noisy terminals? Repeated log lines are now collapsed automatically.
Jetson/Tegra GPU Detection: First-class NVIDIA Jetson/Tegra platform detection.
Intel SYCL Fix: Auto-disables mmap for SYCL backends to prevent crashes.
llama.cpp Portability: Bundled libdl, librt, libpthread for improved cross-platform support.
HF_ENDPOINT Mirror: Downloader now rewrites HuggingFace URIs with HF_ENDPOINT for corporate/mirror setups.
Transformers >5.0: Bumped to HuggingFace Transformers >5.0 with generic model loading.
API Improvements: Proper 404s for missing models, unescaped model names, unified inferencing paths with automatic retry on transient errors.

🐞 Fixes & Improvements

Embeddings: Implemented encoding_format=base64 for the embeddings endpoint.
Kokoro TTS: Fixed phonemization model not downloading during installation.
Realtime API: Fixed Opus codec backend selection alias in development mode.
Gallery Filtering: Fixed exact tag matching for model gallery filters.
Open Responses: Fixed required ORItemParam.Arguments field being omitted; ORItemParam.Summary now always populated.
Tracing: Fixed settings not loading from runtime_settings.json.
UI: Fixed watchdog field mapping, model list refresh on deletion, backend display in model config, MCP button ordering.
Downloads: Fixed directory removal during fallback attempts; improved retry logic.
Model Paths: Fixed baseDir assignment to use ModelPath correctly.

❤️ Thank You

LocalAI is a community-powered FOSS movement. Every star, every PR, every bug report matters.

If you believe in privacy-first, self-hosted AI:

⭐ Star the repo — it helps more than you think
🛠️ Contribute code, docs, or feedback
📣 Share with your team, your community, your world

Let's keep building the future of open AI — together. 💪

✅ Full Changelog

📋 Click to expand full changelog

What's Changed

New Contributors

@tv42 made their first contribution in Always populate ORItemParam.Summary #9049
@walcz-de made their first contribution in fix: implement encoding_format=base64 for embeddings endpoint #9135
@ER-EPR made their first contribution in fix: huggingface repo change the file name so Update index.yaml is needed #9163

Full Changelog: v4.0.0...v4.1.0

This discussion was created from the release v4.1.0.

SilentDirge · 2026-04-03T02:10:48Z

SilentDirge
Apr 3, 2026

Upgrade 4.0 to 4.1 using docker pull but running into trouble as the existing auth is broken. Was using API_KEY, but tried LOCALAI_API_KEY and LOCALAI_AUTH (true & false) with no luck. No way to do anything in the UI as I get this message:
Failed to load settings: An authentication key is required

Perhaps there is another auth setting to specify in the docker compose file that has not yet been documented?

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

v4.1.0 #9205

Uh oh!

{{title}}

Uh oh!

What's Changed

Bug fixes 🐛

Exciting New Features 🎉

👒 Dependencies

Other Changes

Replies: 1 comment

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

v4.1.0 #9205

Uh oh!

mudler Apr 2, 2026 Maintainer

🎉 LocalAI 4.1.0 Release! 🚀

New (long version) Full setup walktrough: https://www.youtube.com/watch?v=cMVNnlqwfw4

🚀 Key Features

🌐 Distributed Mode: scaling LocalAI horizontally

🔐 Users, Authentication & Quotas

Users and quota:

Usage metrics per user:

🧪 Fine-Tuning & Quantization

🎨 UI

🤖 Agents & Inference

🛠️ Under the Hood

🐞 Fixes & Improvements

❤️ Thank You

✅ Full Changelog

What's Changed

Bug fixes 🐛

Exciting New Features 🎉

👒 Dependencies

Other Changes

New Contributors

Replies: 1 comment

Uh oh!

SilentDirge Apr 3, 2026

mudler
Apr 2, 2026
Maintainer

SilentDirge
Apr 3, 2026