Skip to content

NVLS support for msccl++ executor#375

Merged
Binyang2014 merged 43 commits intomainfrom
binyli/nvls
Nov 20, 2024
Merged

NVLS support for msccl++ executor#375
Binyang2014 merged 43 commits intomainfrom
binyli/nvls

Conversation

@Binyang2014
Copy link
Contributor

@Binyang2014 Binyang2014 commented Oct 30, 2024

  • Support mote datatype for multicast operation
  • Add new OP MULTI_LOAD_REDUCE_STORE to support NVLS
  • Modify allocSharedPhysicalCuda, which return std::shared_ptr instead of std::shared_ptr
  • Add Python support for allocSharedPhysicalCuda

Test passed for allreduce_nvls.json

@Binyang2014 Binyang2014 marked this pull request as ready for review November 1, 2024 14:21
@Binyang2014 Binyang2014 enabled auto-merge (squash) November 20, 2024 06:17
@Binyang2014 Binyang2014 merged commit 28a57b0 into main Nov 20, 2024
@Binyang2014 Binyang2014 deleted the binyli/nvls branch November 20, 2024 06:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants