leo-pony/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
Repositories
leo-pony/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
leo-pony/vllm-ascend-bisect
PR-level bisect tool for vllm-ascend regression detection
leo-pony/verl
verl: Volcano Engine Reinforcement Learning for LLMs
leo-pony/grammaTest
githubGramaTest
leo-pony/model-runner
Docker Model Runner
leo-pony/ci-infra
This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
leo-pony/bash-example
An example pipeline that runs a simple Bash script with artifacts and inline output.
leo-pony/ollama
Get up and running with Llama 3, Mistral, Gemma 2, and other large language models.
leo-pony/llama.cpp
LLM inference in C/C++
leo-pony/docs
The repository provides docs & api & tutorials & FAQ and all things like that.
leo-pony/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
leo-pony/ramalama
The goal of RamaLama is to make working with AI boring.
leo-pony/LLaMA-Factory-Doc
LLaMA Factory Document
leo-pony/shortnames
Shortnames project is collecting registry alias names for shortnames to fully specified container image names.
leo-pony/onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
leo-pony/cosdt.github.io
https://cosdt.github.io
leo-pony/uNVMe
KV and LBA SSD userspace NVMe driver