ENg-122/Megatron-LM
Ongoing research training transformer models at scale
Repositories
ENg-122/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
ENg-122/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
ENg-122/LMCache
Supercharge Your LLM with the Fastest KV Cache Layer
ENg-122/gpustack
Simple, scalable AI model deployment on GPU clusters
ENg-122/trl
Train transformer language models with reinforcement learning.
ENg-122/OpenManus
No fortress, purely open ground. OpenManus is Coming.
ENg-122/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
ENg-122/one-api
LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI.
ENg-122/FastGPT
FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.