slin1237/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
As imagine the future
Repositories
slin1237/smg
Shepherd Model Gateway
slin1237/codex
Lightweight coding agent that runs in your terminal
slin1237/dotfiles
/home/tpounds
slin1237/ome
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
slin1237/mlx-lm
Run LLMs with MLX
slin1237/iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
slin1237/tensorrt-llm
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
slin1237/sglang
SGLang is a fast serving framework for large language models and vision language models.
slin1237/melody
Templating rendering and generation parsing for Cohere models.
slin1237/transformer-rs
HF transformer in rust
slin1237/kubebrain
A High Performance Metadata System for Kubernetes
slin1237/oh-my-zsh
🙃 A delightful community-driven (with 1,300+ contributors) framework for managing your zsh configuration. Includes 200+ optional plugins (rails, git, OSX, hub, capistrano, brew, ant, php, python, etc), over 140 themes to spice up your morning, and an auto-update tool so that makes it easy to keep up with the latest updates from the community.
slin1237/jobset
JobSet: a k8s native API for distributed ML training and HPC workloads
slin1237/kubernetes
Production-Grade Container Scheduling and Management
slin1237/kickstart
slin1237/kickstart-frontend
repo for PRC hackathon - kickstart frontend
slin1237/lc-practices
my own practices of leetcode
slin1237/lc-all-solutions
My own leetcode solutions by python