Skip to content

Question: scenario regression testing for LiveKit voice agents #1400

@monkeyin92

Description

@monkeyin92

Hi LiveKit team! I know this repo is for the Agents JS framework itself, so please close this if Issues are not the right place for validation requests.

I’m building a small open-source Voice Agent TestOps tool for pre-launch regression testing: https://github.com/monkeyin92/voice-agent-testops

The idea is not to replace LiveKit Agents. It sends scripted customer turns to a voice-agent-compatible HTTP endpoint and checks business-level regressions that are easy to miss before launch:

  • unsafe pricing / over-promising
  • missed lead fields like phone or preferred time
  • wrong human-handoff intent
  • latency over threshold
  • JSON + HTML/PDF reports for CI or sales review

Example command:

npm run voice-test -- --suite examples/voice-testops/openclaw-suite.json --agent http --endpoint <your-test-endpoint>

I’m looking for a few real voice agents to test this week. Would any LiveKit Agents JS starter/demo maintainers be open to running one suite, or is there a better LiveKit community channel for this? I can adapt the suite to a LiveKit demo domain and share the report back.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions