Skip to content

fix: retry when LLM returns empty messages#8704

Merged
mudler merged 2 commits intomasterfrom
debug
Mar 1, 2026
Merged

fix: retry when LLM returns empty messages#8704
mudler merged 2 commits intomasterfrom
debug

Conversation

@mudler
Copy link
Copy Markdown
Owner

@mudler mudler commented Mar 1, 2026

Description

In some cases we were re-calling without going into the full function-parse flow, and that was breaking tool calls in some edge cases with small models

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

mudler added 2 commits March 1, 2026 18:55
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@netlify
Copy link
Copy Markdown

netlify bot commented Mar 1, 2026

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 87dc9c3
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/69a48b6c508cf40008ade89d
😎 Deploy Preview https://deploy-preview-8704--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mudler mudler merged commit c7c4a20 into master Mar 1, 2026
39 of 40 checks passed
@mudler mudler deleted the debug branch March 1, 2026 20:32
localai-bot pushed a commit to localai-bot/LocalAI that referenced this pull request Mar 6, 2026
* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* retry instead of re-computing a response

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
localai-bot pushed a commit to localai-bot/LocalAI that referenced this pull request Mar 6, 2026
* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* retry instead of re-computing a response

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
localai-bot pushed a commit to localai-bot/LocalAI that referenced this pull request Mar 25, 2026
* debug

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* retry instead of re-computing a response

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant