KenForever

@KenForever1 Β· User

GitHub profile β†— Β· Compare

πŸ’ͺ It's what you do right now that makes a difference.

World TravelingSingapore35 followers76 repositories

Repositories

KenForever1/vLLM-Kunlun

vLLM Kunlun (vllm-kunlun) is a community-maintained hardware plugin designed to seamlessly run vLLM on the Kunlun XPU.

β˜… 0PythonForks 0

KenForever1/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

β˜… 1C++Forks 0

KenForever1/Keyonica

A polyphonic harmonica simulator developed based on Rust, supporting real-time keyboard playing, chord playing, tone shifting functions, and built-in automatic demonstration of tracks.

β˜… 2RustForks 0

KenForever1/mini-sglang

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

β˜… 0PythonForks 0

KenForever1/gen_stream

RTSP Stream Tool is an RTSP video streaming tool that provides an intuitive web interface.

β˜… 0RustForks 0

KenForever1/nvim-rotate-chars

a neovim plugin base on nvim-oxi, rotate the selected character according to the direction and number.

β˜… 2RustForks 0

KenForever1/cpp_idioms

With the increase in the idioms a programmer understands, the language becomes friendlier to them.

β˜… 3C++Forks 0

KenForever1/deepclaude

A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

β˜… 0Forks 0

KenForever1/qps_client

A service request benchmark tool used to test the QPS and delay of services.

β˜… 1RustForks 0

KenForever1/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

β˜… 1Forks 0