Skip to content

DeepSeek-V3 does not support function calling API #145

@shackmann

Description

@shackmann

Describe the bug
Running a standard optimization using deepseek-ai/DeepSeek-V3 results in

^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m ERROR:evaluation:>>> Model name deepseek-ai/DeepSeek-V3 does not support function calling API.  for input: {'query': 'In the context of managing Combined Models, what is the proper procedure to modify an active deployed Combined Model and what steps are involved in this process?'}

^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m                                         ^^^^^^^^^^
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m   File "/home/alex/.local/share/uv/python/cpython-3.12.7-linux-x86_64-gnu/lib/python3.12/functools.py", line 993, in __get__
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m     val = self.func(instance)
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m           ^^^^^^^^^^^^^^^^^^^
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m   File "/tmp/ray/session_2025-06-05_07-19-04_642991_1676/runtime_resources/py_modules_files/_ray_pkg_bbe7ef2d08e06394/syftr/flows.py", line 568, in agent
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m     main_worker = FunctionCallingAgentWorker.from_tools(
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m   File "/tmp/ray/session_2025-06-05_07-19-04_642991_1676/runtime_resources/pip/42bb406fe48ce446a6ce2a9cea155757cb9174a4/virtualenv/lib/python3.12/site-packages/llama_index/core/agent/function_calling/step.py", line 164, in from_tools
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m     return cls(
^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m            ^^^^

^[[36m(<lambda> pid=2690232, ip=172.16.4.67)^[[0m   File "/tmp/ray/session_2025-06-05_07-19-04_642991_1676/runtime_resources/pip/42bb406fe48ce446a6ce2a9cea155757cb9174a4/virtualenv/lib/python3.12/site-packages/llama_index/core/agent/function_calling/step.py", line 102, in __init__

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions