akkart-aws/libfabric
Open Fabric Interfaces
Open Fabric Interfaces
NVIDIA Inference Xfer Library (NIXL)
This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
Optimized primitives for collective multi-GPU communication
NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process communication and coordination overheads by allowing programmers to perform one-sided communication from within CUDA kernels and on CUDA streams.