HydraQYH/hp_rms_norm
High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)
NV/AMD GPU Kernel Performance Analysis & Optimization. Now in Bytedance(Data => AML => Seed). Used to be in AIACC Team@Alibaba Cloud.
Repositories
HydraQYH/FlyDSL
FlyDSL is the Python front‑end of the project: Flexible LaYout DSL.
HydraQYH/cutlass
CUDA Templates for Linear Algebra Subroutines
HydraQYH/swizzled_layout_gemm
Using a swizzled hierarchical layout for GEMM
HydraQYH/sglang
SGLang is a fast serving framework for large language models and vision language models.
HydraQYH/cute_reduce
Reduce kernel based on CUTLASS CuTe and TMA.
HydraQYH/cutlass_cute_experiments
HydraQYH/bpftrace
High-level tracing language for Linux eBPF
HydraQYH/tilelang_tvm
Open deep learning compiler stack for cpu, gpu and specialized accelerators
HydraQYH/tilelang
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
HydraQYH/flashinfer
FlashInfer: Kernel Library for LLM Serving
HydraQYH/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
HydraQYH/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
HydraQYH/flash-attention
Fast and memory-efficient exact attention
HydraQYH/CUDASynchronizePrimitives
Benchmark sync primitives
HydraQYH/NVGPUMicroBenchmark
Instruction-level benchmarks for NVGPUs
HydraQYH/cuda_prefetch_experiment
Prefetch experiments codes.
HydraQYH/expert_specialization_moe
Expert Specialization MoE Solution based on CUTLASS
HydraQYH/cutedsl_experiment
Some code snippet for CuTeDSL
HydraQYH/tma_multicast_demo
Simple Code Snippet for TMA Multicast.
HydraQYH/GPU-Cache-Operator
HydraQYH/peer_access_demo
Cache operator demo code for peer access
HydraQYH/CUDA_Practice
This is a repository with some CUDA examples.
HydraQYH/OpenMP_practice
This is a repository with some OpenMP examples.
HydraQYH/MPI_practice
A repository with some MPI programming examples.
HydraQYH/Triton-Puzzles-Lite
Puzzles for learning Triton, play it with minimal environment configuration!
HydraQYH/bpftrace-nivcsw-trace
Bpftrace scripts for measuring nivcsw overhead.
HydraQYH/Understanding-Software-Dynamics
Practice codes for Understanding Software Dynamics.
HydraQYH/YuhangOS
Codes for YuhangOS
HydraQYH/mlc
Homework for mlc.ai.