LopezCastroRoberto/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Senior ML Engineer at RedHat AI
Repositories
LopezCastroRoberto/humming
Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for quantized inference.
LopezCastroRoberto/flash-attention
Fast and memory-efficient exact attention
LopezCastroRoberto/flashinfer
FlashInfer: Kernel Library for LLM Serving