GOavi101/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
I am a Software Engineer and have knowledge of Linux, Kubernetes, Docker, and Go.
Repositories
GOavi101/spyre-inference
vLLM plugin for Spyre based on torch-spyre
GOavi101/torch-spyre
GOavi101/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
GOavi101/RFCs
GOavi101/vllm-spyre
Community maintained hardware plugin for vLLM on Spyre
GOavi101/semantic-router
System Level Intelligent Router for Mixture-of-Models
GOavi101/GOavi101
GOavi101/konflux-central
Central repository for managing Konflux resource files. This streamlines maintenance by consolidating configurations and leveraging GitHub Actions for automated syncing.
GOavi101/Own-vllm
GOavi101/model-registry
Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. It fills a gap between model experimentation and production activities. It provides a central interface for all stakeholders in the MLOps lifecycle to collaborate on ML models.
GOavi101/cli
A CLI for building container images on Kubernetes!
GOavi101/online_ofline_indicator
GOavi101/kserve
Standardized Serverless ML Inference Platform on Kubernetes