Several VideoMMMU tool task YAML files contain malformed YAML because generation_kwargs is accidentally concatenated onto the process_results line.
Example of the broken format:
process_results: !function utils.videommmu_process_results_perception_comprehensiongeneration_kwargs:
max_new_tokens: 49152
This causes YAML parsing to fail with an error similar to:
ScannerError: mapping values are not allowed here
The issue appears in the VideoMMMU tool task configs under:
lmms_eval_tasks/videommmu/
Affected files:
lmms_eval_tasks/videommmu/adaptation_tool.yaml
lmms_eval_tasks/videommmu/comprehension_tool.yaml
lmms_eval_tasks/videommmu/perception_tool.yaml
Several VideoMMMU tool task YAML files contain malformed YAML because generation_kwargs is accidentally concatenated onto the process_results line.
Example of the broken format:
process_results: !function utils.videommmu_process_results_perception_comprehensiongeneration_kwargs:
max_new_tokens: 49152
This causes YAML parsing to fail with an error similar to:
ScannerError: mapping values are not allowed here
The issue appears in the VideoMMMU tool task configs under:
lmms_eval_tasks/videommmu/
Affected files:
lmms_eval_tasks/videommmu/adaptation_tool.yaml
lmms_eval_tasks/videommmu/comprehension_tool.yaml
lmms_eval_tasks/videommmu/perception_tool.yaml