Skip to content

[Feature]: MI300/MI325 DeepSeekv4 Pro (Functional Support & Recipes)#45231

Description

@functionstackx

馃殌 The feature, motivation and pitch

hi @andyluo7

+viz @chunfangamd @powderluv

I am looking into running DeepSeekv4 Pro (with MTP and without MTP) but it seems from checking out AMD's DeepSeekv4 Flash PR #42893 & https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro , MI300/MI325 DeepSeekv4 Pro (and DeepSeekv4 in general) Support is still WIP. What's is the timelines on this?

In Comparison, H200 has been supported since day 0 https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro?hardware=h200

Image Image

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestNew feature or requestrocmRelated to AMD ROCm

    Type

    No type

    Projects

    Status
    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions