Cross GPU Reduce Operator Initial Development#1795

Open

ThomasNing wants to merge 11 commits intodevelopfrom moe_cross_reduce

+1,159

Commits on Dec 10, 2024

Finished the memory intialization, working on the merging of MSCCLPP
ThomasNing
committed

Commits on Dec 11, 2024

Solved the compiler warning issue
ThomasNing
committed

Commits on Dec 13, 2024

Finished the poc for MSCCLPP
ThomasNing
committed

Commits on Dec 14, 2024

Polish the setup Connection part from Nusrat's comment
ThomasNing
committed

Commits on Dec 17, 2024

add the mesh connection to the executable
ThomasNing
committed

Commits on Dec 18, 2024

Start to add the mscclpp to the reduce_receive_kernel
ThomasNing
committed

Commits on Dec 19, 2024

Finished the receiving kernel for the message receive coding.
ThomasNing
committed

Commits on Jan 2, 2025

finished on the receive part.
ThomasNing
committed

Commits on Jan 6, 2025

Commits on Jan 13, 2025

Start to substitute the mscclpp
ThomasNing
committed