ErvinXie

@ErvinXie · User

GitHub profile ↗ · Compare

44 followers33 repositories

Repositories

ErvinXie/ramsey55

AI-assisted research and formal verification work on R(5,5)

★ 0LeanForks 0

ErvinXie/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

★ 0Forks 0

ErvinXie/llm-compressor

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

★ 0PythonForks 0

ErvinXie/fastllm

fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型,任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型,单并发20tps;INT4量化模型单并发30tps,多并发可达60+。

★ 0Forks 0

ErvinXie/ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

★ 0Forks 0