Chief Scientist & cofounder @ Tensormesh, Inc.
Repositories
KuntaiDu/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
KuntaiDu/dds
Server-driven Video Streaming for Deep Learning Inference
KuntaiDu/vllm_prefill
Research for vLLM prefill-only.
KuntaiDu/AccMPEG
KuntaiDu/Video-Aalytic-Overview
KuntaiDu/claude-code
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.
KuntaiDu/KuntaiDu
KuntaiDu/cartridges
Storing long contexts in tiny caches with self-study
KuntaiDu/lmcache.github.io
LMCache official blog
KuntaiDu/LMIgnite
KuntaiDu/gitignore
A collection of useful .gitignore templates
KuntaiDu/production-stack
Scale from single vLLM instance to distributed vLLM deployment without changing any application code.
KuntaiDu/production-stack-router
KuntaiDu/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
KuntaiDu/KuntaiDu.github.io
KuntaiDu/demo
KuntaiDu/lmcache-vllm
The driver for LMCache core to run in vLLM
KuntaiDu/vllm-community-dashboard
KuntaiDu/buildkite-ci
KuntaiDu/tensorrt-demo
KuntaiDu/OneAdapt
KuntaiDu/glymur
Python interface to OpenJPEG library for reading and writing JPEG 2000 images.
KuntaiDu/h264-roi
H.264 video Region of Interest encoding tool, using x264
KuntaiDu/books
KuntaiDu/check_disk_usage
KuntaiDu/AccMPEG-ffmpeg-binary
KuntaiDu/pytorch-ssd
KuntaiDu/mega.pytorch
Memory Enhanced Global-Local Aggregation for Video Object Detection, CVPR2020