vnchari/compactor-vllm
(nearly) Zero-overhead KV-cache compression in a minimal vLLM-style engine. Official repo of https://arxiv.org/abs/2507.08143
ML + Biomedical Engineering @ Johns Hopkins
(nearly) Zero-overhead KV-cache compression in a minimal vLLM-style engine. Official repo of https://arxiv.org/abs/2507.08143
Yet Another FFT Library – Some experiments with SIMD Fast Fourier Transforms
Rust implementation of a post-quantum supersingular-isogeny elliptic curve signature scheme (with a new blinding algorithm for constant time execution).
Computer Integrated Surgery Project
Trainable Compression For LLMs
LLM KV cache compression made easy