Skip to content

test(providers): add model listing to live provider suite#7038

Merged
codefromthecrypt merged 1 commit intomainfrom
list-test
Feb 6, 2026
Merged

test(providers): add model listing to live provider suite#7038
codefromthecrypt merged 1 commit intomainfrom
list-test

Conversation

@codefromthecrypt
Copy link
Collaborator

@codefromthecrypt codefromthecrypt commented Feb 6, 2026

Summary

Add test_model_listing() to the live provider test suite (ProviderTester).

This calls fetch_supported_models() and verifies the configured model appears in the result.

Type of Change

  • Tests

AI Assistance

  • This PR was created or reviewed with AI assistance

Testing

OLLAMA_HOST=http://localhost:11434 cargo test --test providers test_ollama_provider

Related Issues

This would have caught the Azure 404 from #6987

@codefromthecrypt
test(providers): add model listing to live provider suite
95ab4f5 
Signed-off-by: Adrian Cole <adrian@tetrate.io>
Copilot AI review requested due to automatic review settings February 6, 2026 12:52
@codefromthecrypt codefromthecrypt mentioned this pull request Feb 6, 2026
Closed
Copilot AI reviewed Feb 6, 2026
View reviewed changes
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds model listing verification to the live provider test suite by introducing a new test_model_listing() method in the ProviderTester class. This test calls fetch_supported_models() on each provider and verifies that the configured model appears in the returned list.

Changes:

  • Added test_model_listing() method to verify provider model listing functionality
  • Integrated the new test into the run_test_suite() workflow, running before other tests
  • Added logic to handle provider-specific model naming conventions (e.g., Ollama's tag-based names like "qwen3:latest")

@codefromthecrypt codefromthecrypt added this pull request to the merge queue Feb 6, 2026
Merged via the queue into main with commit 9984285 Feb 6, 2026
23 checks passed
@codefromthecrypt codefromthecrypt deleted the list-test branch February 6, 2026 14:31
katzdave added a commit that referenced this pull request Feb 6, 2026
@katzdave
Merge remote-tracking branch 'origin/main' into dependabot/cargo/json…
32035fd 
…webtoken-10.3.0

* origin/main: (54 commits)
  Switch tetrate tool filtering back to supports_computer_use (#7024)
  feat(ui): add inline rename for chat sessions in sidebar (#6995)
  fix: handle toolnames without underscores (#7015)
  feat(claude-code): use stream-json protocol for persistent sessions (#7029)
  test(providers): add model listing to live provider suite (#7038)
  Agent added too much (#7036)
  fix(deps): bump tree-sitter to 0.26 and set sqlx default-features=false to fix RUSTSEC advisories (#7031)
  feat: add image support and improve error resilience for Codex (#7033)
  fix(providers): Azure OpenAI model listing 404 during configure (#7034)
  fix(deps): bump bat to 0.26.1 to resolve RUSTSEC-2026-0008 (#7021)
  Don't swallow Tetrate errors  (#6998)
  docs: remove hardcoded_stuff links (#7016)
  fix(ui): keep Hub chat input from overlapping SessionInsights on paste (#6719)
  Clean up css (#6944)
  docs: aws bedrock bearer token auth (#6990)
  docs: extended custom provider headers support (#7012)
  feat(cli): add type-to-search filtering to select/multiselect dialogs (#6862)
  feat(ci): add cargo-audit workflow for scanning rust vulnerabilities (#6351)
  feat: add User-Agent header to MCP HTTP requests (#6988)
  chore(deps-dev): bump webpack from 5.102.1 to 5.105.0 in /ui/desktop (#6996)
  ...

# Conflicts:
#	Cargo.lock
zanesq added a commit that referenced this pull request Feb 6, 2026
@zanesq
Merge remote-tracking branch 'origin/main' into spence/nav
d3738bc 
* origin/main:
  Remove build-dependencies section from Cargo.toml (#6946)
  add /rp-why skill blog post (#6997)
  fix: fix snake_case function names in code_execution instructions (#7035)
  Document max_turns settings for recipes and subagents (#7044)
  feat: update Groq declarative data with Preview Models (#7023)
  fix(codex): propagate extended PATH to codex subprocess (#6874)
  Switch tetrate tool filtering back to supports_computer_use (#7024)
  feat(ui): add inline rename for chat sessions in sidebar (#6995)
  fix: handle toolnames without underscores (#7015)
  feat(claude-code): use stream-json protocol for persistent sessions (#7029)
  test(providers): add model listing to live provider suite (#7038)
  Agent added too much (#7036)
  fix(deps): bump tree-sitter to 0.26 and set sqlx default-features=false to fix RUSTSEC advisories (#7031)
  feat: add image support and improve error resilience for Codex (#7033)
  fix(providers): Azure OpenAI model listing 404 during configure (#7034)
  fix(deps): bump bat to 0.26.1 to resolve RUSTSEC-2026-0008 (#7021)
  Don't swallow Tetrate errors  (#6998)
  docs: remove hardcoded_stuff links (#7016)

# Conflicts:
#	ui/desktop/src/components/GooseSidebar/AppSidebar.tsx
kuccello pushed a commit to kuccello/goose that referenced this pull request Feb 7, 2026
@codefromthecrypt
test(providers): add model listing to live provider suite (block#7038)
f204d56 
Signed-off-by: Adrian Cole <adrian@tetrate.io>
dianed-square added a commit that referenced this pull request Feb 9, 2026
@dianed-square
Merge remote-tracking branch 'origin/main' into docs/standalone-mcp-apps
9a4b415 
* origin/main: (141 commits)
  Add global config switch to disable automatic session naming (#7052)
  docs: add blog post - 8 Things You Didn't Know About Code Mode (#7059)
  fix: ensure animated elements are visible when prefers-reduced-motion is enabled (#7047)
  Show recommended model on failture (#7040)
  feat(ui): add session content search via API (#7050)
  docs: fix img url (#7053)
  Desktop UI for deleting custom providers (#7042)
  Add blog post: How I Used RPI to Build an OpenClaw Alternative (#7051)
  Remove build-dependencies section from Cargo.toml (#6946)
  add /rp-why skill blog post (#6997)
  fix: fix snake_case function names in code_execution instructions (#7035)
  Document max_turns settings for recipes and subagents (#7044)
  feat: update Groq declarative data with Preview Models (#7023)
  fix(codex): propagate extended PATH to codex subprocess (#6874)
  Switch tetrate tool filtering back to supports_computer_use (#7024)
  feat(ui): add inline rename for chat sessions in sidebar (#6995)
  fix: handle toolnames without underscores (#7015)
  feat(claude-code): use stream-json protocol for persistent sessions (#7029)
  test(providers): add model listing to live provider suite (#7038)
  Agent added too much (#7036)
  ...
@github-actions github-actions bot mentioned this pull request Feb 10, 2026
Open
@codefromthecrypt codefromthecrypt mentioned this pull request Feb 10, 2026
Merged
3 tasks
Tyler-Hardin pushed a commit to Tyler-Hardin/goose that referenced this pull request Feb 11, 2026
@codefromthecrypt @Tyler-Hardin
test(providers): add model listing to live provider suite (block#7038)
decd1d1 
Signed-off-by: Adrian Cole <adrian@tetrate.io>
Tyler-Hardin pushed a commit to Tyler-Hardin/goose that referenced this pull request Feb 11, 2026
@codefromthecrypt @Tyler-Hardin
test(providers): add model listing to live provider suite (block#7038)
a5fbae5 
Signed-off-by: Adrian Cole <adrian@tetrate.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments

@alexhancock alexhancock alexhancock approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@codefromthecrypt @alexhancock