zyzshishui/torch_memory_saver
Allow torch tensor memory to be released and resumed later
Repositories
zyzshishui/miles
zyzshishui/sglang
SGLang is a fast serving framework for large language models and vision language models.
zyzshishui/flash-attention
Fast and memory-efficient exact attention
zyzshishui/rocm-systems
super repo for rocm systems projects
zyzshishui/zyzshishui.github.io
zyzshishui/humanize
From Automated Idea Factory to Realization
zyzshishui/rccl
[DEPRECATED] Moved to ROCm/rocm-systems repo
zyzshishui/sgl-router-for-miles
The sglang router for miles only.
zyzshishui/aiter
AI Tensor Engine for ROCm
zyzshishui/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
zyzshishui/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
zyzshishui/clr
zyzshishui/kineto
A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
zyzshishui/slime
slime is a LLM post-training framework aiming at scaling RL.
zyzshishui/verl
verl: Volcano Engine Reinforcement Learning for LLMs
zyzshishui/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
zyzshishui/Megatron-LM
Ongoing research training transformer models at scale