CalvinXKY/InfraTech
分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等
share code and happiness
Repositories
CalvinXKY/BasicCUDA
A tutorial for CUDA&PyTorch
CalvinXKY/nano-vllm
Nano vLLM
CalvinXKY/EPLB_visualization
Visualize the Expert Parallelism Load Balancer
CalvinXKY/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
CalvinXKY/vime
An LLM post-training framework with vLLM for RL Scaling
CalvinXKY/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
CalvinXKY/calvinxky.github.io
CalvinXKY/vime_doc
CalvinXKY/slime
slime is an LLM post-training framework for RL Scaling.
CalvinXKY/mfu_calculation
A simple calculation for LLM MFU.
CalvinXKY/transformer_one_page
Coding the transformer model architecture in one page for tutorial.
CalvinXKY/demo
CalvinXKY/helloworld
this is a practice project, which is used for testing only.
CalvinXKY/cuda_by_example
The CMake version of cuda_by_example
CalvinXKY/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
CalvinXKY/modelarts-optimization-guide
CalvinXKY/stride-visualizer
Stride visualizations
CalvinXKY/advisor
Open-source implementation of Google Vizier for hyper parameters tuning
CalvinXKY/README
README文件语法解读，即Github Flavored Markdown语法介绍
CalvinXKY/modelarts-example
CalvinXKY/dls-example
Introduction of usage deep learning service of huawei cloud