jeffhammond/pytorch-china-2026-nccl-tutorial
NCCL tutorial at PyTorch Conference China 2026
HPC software @NVIDIA in ๐ซ๐ฎ. Previously @Intel HPC, @argonne-lcf w/ Blue Gene and MPI. PhD in Chemistry from @uchicago for work on @nwchemgit. He/him/hรคn.
NCCL tutorial at PyTorch Conference China 2026
This is a set of simple programs that can be used to explore the features of a parallel platform.
My blog.
STREAM benchmark
An MPI ABI compatibility layer
My Home Page
Open MPI main development repository
An implementation of ARMCI using MPI one-sided communication (RMA)
BLAS-like Library Instantiation Software Framework
Information about many aspects of high-performance computing. Wiki content moved to ~/docs.
A standalone implementation of the MPI Fortran 2018 module
Information about AVX-512 support on recent Intel processors
SFMalloc (http://aces.snu.ac.kr/Center_for_Manycore_Programming/SFMalloc.html)
Intel Data Parallel C++ (and SYCL 2020) Tutorial.
PLUMBER: ProfiLer for Understanding of M(PI) BEhavioR
The MacPorts ports tree
Implementation of MPI that supports large counts
MPI Fortran type inference
GPU-accelerated coupled cluster with density fitting
NWChem TCE CCSD(T) loop-driven kernels for performance optimization experiments
NWChem: Open Source High-Performance Computational Chemistry
The Thing That Should Not Be
Official MPICH Repository
Spack's community package recipes
Self-optimizing Python Automatic Generator of Hierarchically blockEd Tensor Transpose librarY
MPI interposition layer to stop blocking calls from spin-waiting
The LLVM Project Blog