Li Wang

@Potabk · User

GitHub profile ↗ · Compare

21 followers41 repositories

Repositories

Potabk/naked_llama

build llama inference compute from scrath, only using torch/numpy base ops

★ 0Forks 0

Potabk/vllm-ascend

Community maintained hardware plugin for vLLM on Ascend

★ 1PythonForks 0

Potabk/speculators

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

★ 0Forks 0

Potabk/LMCache

Supercharge Your LLM with the Fastest KV Cache Layer

★ 0Forks 0

Potabk/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0PythonForks 0

Potabk/modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

★ 0Forks 0

Potabk/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

★ 0Forks 0

Potabk/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

★ 0Forks 0

Potabk/Mos

一个用于在 macOS 上平滑你的鼠标滚动效果或单独设置滚动方向的小工具, 让你的滚轮爽如触控板 | A lightweight tool used to smooth scrolling and set scroll direction independently for your mouse on macOS

★ 0Forks 0