valarLip/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Repositories
valarLip/rocm-trace-lite
Self-contained GPU kernel profiler for ROCm. Zero roctracer/rocprofiler-sdk dependency. HSA-only interception, SQLite trace output, Perfetto compatible.
valarLip/sglang
SGLang is a fast serving framework for large language models and vision language models.
valarLip/ByteMLPerf
AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.
valarLip/valarLip
Config files for my GitHub profile.