alexm-redhat/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
@vllm-project
Repositories
alexm-redhat/OpenShell
OpenShell is the safe, private runtime for autonomous AI agents.
alexm-redhat/openclaw
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
alexm-redhat/vllm_bench_scripts
alexm-redhat/trtllm_vs_vllm_bench
Scripts for automatic trtllm vs vllm benchmarks
alexm-redhat/recipes
Common recipes to run vLLM
alexm-redhat/sparsify
Easy-to-use autoML interface to optimize deep neural networks for better inference performance and a smaller footprint.
alexm-redhat/glow
Compiler for Neural Network hardware accelerators
alexm-redhat/sparseml
Libraries and state-of-the-art automatic sparsification algorithms to simplify and accelerate performance
alexm-redhat/deepsparse
CPU inference engine that delivers unprecedented performance for sparse models
alexm-redhat/sparsezoo
Neural network model repository for highly sparse models and optimization recipes