Skip to content

VideoMMMU tool YAML where generation_kwargs is concatenated with process_results #22

@Xnhyacinth

Description

@Xnhyacinth

Several VideoMMMU tool task YAML files contain malformed YAML because generation_kwargs is accidentally concatenated onto the process_results line.

Example of the broken format:

process_results: !function utils.videommmu_process_results_perception_comprehensiongeneration_kwargs:
max_new_tokens: 49152

This causes YAML parsing to fail with an error similar to:

ScannerError: mapping values are not allowed here

The issue appears in the VideoMMMU tool task configs under:

lmms_eval_tasks/videommmu/

Affected files:

lmms_eval_tasks/videommmu/adaptation_tool.yaml
lmms_eval_tasks/videommmu/comprehension_tool.yaml
lmms_eval_tasks/videommmu/perception_tool.yaml

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No fields configured for Bug.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions