Vincent-syr/CUDA-Learn-Notes
📚150+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).
Repositories
Vincent-syr/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
Vincent-syr/sglang
SGLang is a fast serving framework for large language models and vision language models.
Vincent-syr/ppl.llm.kernel.cuda
Vincent-syr/qserve
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
Vincent-syr/Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
Vincent-syr/ppl.llm.serving
Vincent-syr/lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Vincent-syr/cpufp
A CPU tool for benchmarking the peak of floating points
Vincent-syr/ppl.pmx
Vincent-syr/cuda_code
easy cuda code
Vincent-syr/fp_diff
This is a tool for comparing two float-point arrays.
Vincent-syr/ppl.common
Common libraries for PPL projects
Vincent-syr/sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
Vincent-syr/ppl.nn.llm
Vincent-syr/ppl.nn
A primitive library for neural network
Vincent-syr/TechCPP
【C++面试&C++学习指南】 这里整理了C++后端研发工程师面试和工作必备的知识点 。
Vincent-syr/llm-action
本项目旨在分享大模型相关技术原理以及实战经验。
Vincent-syr/AI-System
System for AI Education Resource.
Vincent-syr/coder-kung-fu
开发内功修炼
Vincent-syr/awesome-lm-system
Summary of system papers/frameworks/codes/tools on training or serving large model
Vincent-syr/CS-Books
超过1000本的计算机经典书籍、个人笔记资料以及本人在各平台发表文章中所涉及的资源等。书籍资源包括C/C++、Java、Python、Go语言、数据结构与算法、操作系统、后端架构、计算机系统知识、数据库、计算机网络、设计模式、前端、汇编以及校招社招各种面经~
Vincent-syr/hello-algorithm
🌍「算法面试+算法知识」针对小白的算法训练 | 还包括：1、阿里、字节、滴滴 百篇大厂面经汇总 2、千本开源电子书 3、百张思维导图 （右侧来个 star 吧 🌹，English version supported）
Vincent-syr/Cpp_Primer_Practice
搞定C++:punch:。C++ Primer 中文版第5版学习仓库，包括笔记和课后练习答案。
Vincent-syr/leetcode-master
LeetCode 刷题攻略：配思维导图，100+经典算法题目刷题顺序、经典算法模板、共40w字的详细图解，以及难点视频题解。按照刷题攻略上的顺序来刷题，让你在算法学习上不再迷茫！🔥🔥给个star支持一下吧！🚀
Vincent-syr/fucking-algorithm
刷算法全靠套路，认准 labuladong 就够了！English version supported! Crack LeetCode, not only how, but also why.
Vincent-syr/Learn-Algorithms
算法学习笔记