FeixLiu/PaddleFleet
Core Functional Library for Distributed Training
Core Functional Library for Distributed Training
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis and 🖼 Diffusion AICG system etc.
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
A fast communication-overlapping library for tensor parallelism on GPUs.
Ongoing research training transformer language models at scale, including: BERT & GPT-2
Documentations for PaddlePaddle
PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.
Paddle Automatically Diff Precision Toolkits.
Config files for my GitHub profile.
A 3D computer vision development toolkit based on PaddlePaddle. It supports point-cloud object detection, segmentation, and monocular 3D object detection models.
Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep
A treasure chest for visual recognition powered by PaddlePaddle
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
程序员在家做饭方法指南。Programmer's guide about how to cook at home (Chinese only).
Elastic Deep Learning for deep learning framework on Kubernetes
Code for NeurIPS2020 "Incorporating BERT into Parallel Sequence Decoding with Adapters"
Transformer related optimization, including BERT, GPT