KevinLee1110/dynamic-batching
The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"
Repositories
KevinLee1110/claude-code-source-code
Claude Code v2.1.88 Source Code
The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"
Claude Code v2.1.88 Source Code