toslali-ibm/inference-sim
Inference Platform Simulation
Inference Platform Simulation
AI-Driven Scientific and Algorithmic Discovery
A framework for generating realistic LLM serving workloads
Optimize prompts, code, and more with AI-powered Reflective Text Evolution
Open-source implementation of AlphaEvolve
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
llm-d benchmark scripts and tooling
A high-throughput and memory-efficient inference and serving engine for LLMs
Train transformer language models with reinforcement learning.
Fully open reproduction of DeepSeek-R1