ztqJon/InfraTech
分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等
fresh to programming, DOTA2 players, GOT fans
Repositories
ztqJon/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
ztqJon/nano-vllm-ZYC
Nano vLLM with chinese comments
ztqJon/bayesian-optimization-in-action
Source code for Bayesian Optimization in Action, published by Manning
ztqJon/LLMForEverybody
每个人都能看懂的大模型知识分享，LLMs春/秋招大模型面试前必看，让你和面试官侃侃而谈
ztqJon/happy-llm
📚 从零开始的大语言模型原理与实践教程
ztqJon/PassiveDOA-ISAC-RIS
The passive sensing method for the ISAC system with RIS
ztqJon/SNR-CRB-constrained-beamforming-for-RIS-ISAC
ztqJon/stars-enabled-integrated-sensing-and-communications
The code for the paper "STARS Enabled Integrated Sensing and Communications" in IEEE Transactions on Wireless Communications
ztqJon/DI-engine
OpenDILab Decision AI Engine
ztqJon/ElegantRL
Cloud-native Deep Reinforcement Learning. 🔥