馃殌 The feature, motivation and pitch
hi @andyluo7
+viz @chunfangamd @powderluv
I am looking into running DeepSeekv4 Pro (with MTP and without MTP) but it seems from checking out AMD's DeepSeekv4 Flash PR #42893 & https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro , MI300/MI325 DeepSeekv4 Pro (and DeepSeekv4 in general) Support is still WIP. What's is the timelines on this?
In Comparison, H200 has been supported since day 0 https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro?hardware=h200
Alternatives
No response
Additional context
No response
Before submitting a new issue...
馃殌 The feature, motivation and pitch
hi @andyluo7
+viz @chunfangamd @powderluv
I am looking into running DeepSeekv4 Pro (with MTP and without MTP) but it seems from checking out AMD's DeepSeekv4 Flash PR #42893 & https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro , MI300/MI325 DeepSeekv4 Pro (and DeepSeekv4 in general) Support is still WIP. What's is the timelines on this?
In Comparison, H200 has been supported since day 0 https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Pro?hardware=h200
Alternatives
No response
Additional context
No response
Before submitting a new issue...