Skip to content

Conversation

@mudler
Copy link
Owner

@mudler mudler commented Jan 29, 2026

Description

This PR adds tts streaming support. It currently enables it for voxcpm (not all backends supports it)

To enable streaming, add "stream": true to the request:

curl http://localhost:8080/tts -H "Content-Type: application/json" -d '{
  "input": "Hello world, this is a streaming test",
  "model": "voxcpm",
  "stream": true
}' | aplay

Model config:

name: voxcpm
known_usecases:
- tts
backend: voxcpm
parameters:
  model: openbmb/VoxCPM1.5

Notes for Reviewers

  • This PR also adds an e2e mocked tests suite (with a fake grpc backend) to test e2e all endpoints (http client -> http server -> grpc backend). This is particularly useful for quick tests against the routes, avoiding the full load of models
  • This PR also re-enables running e2e tests as part of the CI jobs

Signed commits

  • Yes, I signed my commits.

@netlify
Copy link

netlify bot commented Jan 29, 2026

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 236ad35
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/697c8eb1a268c800087128a7
😎 Deploy Preview https://deploy-preview-8291--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mudler mudler added the enhancement New feature or request label Jan 29, 2026
@mudler mudler force-pushed the feat/tts-stream branch 3 times, most recently from 4949ebf to 390aea6 Compare January 29, 2026 22:47
@mudler mudler force-pushed the feat/tts-stream branch 3 times, most recently from 17afab1 to e7235ab Compare January 30, 2026 10:46
@mudler mudler merged commit 68dd976 into master Jan 30, 2026
9 of 10 checks passed
@mudler mudler deleted the feat/tts-stream branch January 30, 2026 10:58
nanoandrew4 pushed a commit to nanoandrew4/LocalAI that referenced this pull request Jan 31, 2026
* feat(tts): add support for streaming mode

Signed-off-by: Ettore Di Giacinto <[email protected]>

* Send first audio, make sure it's 16

Signed-off-by: Ettore Di Giacinto <[email protected]>

---------

Signed-off-by: Ettore Di Giacinto <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant