limingshu

JamesLim-sy/tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

JamesLim-sy/gpu_issues

JamesLim-sy/hack-SysML

The road to hack SysML and become an system expert

JamesLim-sy/sglang

SGLang is a fast serving framework for large language models and vision language models.

JamesLim-sy/shallowsim

DeepSeek-V3/R1 inference performance simulator

JamesLim-sy/DeepEP

DeepEP: an efficient expert-parallel communication library

JamesLim-sy/turbomind

JamesLim-sy/flashinfer

FlashInfer: Kernel Library for LLM Serving

JamesLim-sy/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

JamesLim-sy/PaddleHelix

Bio-Computing Platform Featuring Large-Scale Representation Learning and Multi-Task Deep Learning “螺旋桨”生物计算工具集

JamesLim-sy/transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

JamesLim-sy/TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

JamesLim-sy/TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

JamesLim-sy/TensorRT

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

JamesLim-sy/CINN

Compiler Infrastructure for Neural Networks

JamesLim-sy/LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models

JamesLim-sy/Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

JamesLim-sy/tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

JamesLim-sy/oneflow

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

JamesLim-sy/flash-attention

Fast and memory-efficient exact attention

JamesLim-sy/PaddleOCR

Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provide data annotation and synthesis tools, support training and deployment among server, mobile, embedded and IoT devices)

JamesLim-sy/benchmark

JamesLim-sy/nccl

Optimized primitives for collective multi-GPU communication

JamesLim-sy/docs

Documentations for PaddlePaddle

JamesLim-sy/community

PaddlePaddle Developer Community

JamesLim-sy/PaddleDetection

Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.

JamesLim-sy/PaddleSpeech

Easy-to-use Speech Toolkit including SOTA ASR pipeline, influential TTS with text frontend and End-to-End Speech Simultaneous Translation.

JamesLim-sy/Parakeet

PAddle PARAllel text-to-speech toolKIT (supporting Tacotron2, Transformer TTS, FastSpeech2/FastPitch, SpeedySpeech, WaveFlow and Parallel WaveGAN)

JamesLim-sy/PaddleSeg

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks from research to industrial applications.

JamesLim-sy/PaddleGAN

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, Wav2Lip, picture repair, image editing, photo2cartoon, image style transfer, GPEN, and so on.