wxsIcey/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Repositories
wxsIcey/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
wxsIcey/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
wxsIcey/personal_notebook
wxsIcey/cann-container-image
Dockerfiles for Ascend CANN