Researcher @IBM
Repositories
cyang49/spyre-inference
vLLM plugin for Spyre based on torch-spyre
cyang49/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
cyang49/sbd
cyang49/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
cyang49/vllm-triton-backend
A Triton-only attention backend for vLLM
cyang49/DeepSpeedExamples
Example models using DeepSpeed
cyang49/fms-extras
cyang49/ao
Custom data types and layouts for training and inference
cyang49/float8_experimental
This repository contains the experimental PyTorch native float8 training UX
cyang49/foundation-model-stack
cyang49/text-generation-inference
IBM development fork of https://github.com/huggingface/text-generation-inference
cyang49/cutlass_fpA_intB_gemm
A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
cyang49/base-images
cyang49/FasterTransformer
Transformer related optimization, including BERT, GPT
cyang49/kcp-kubernetes
This repository is Kubernetes plus minimal modifications to add logical clusters. Rebased regularly.
cyang49/kcp
kcp is a prototype of a multi-tenant Kubernetes control plane for workloads on many clusters
cyang49/enhancements
Enhancements tracking repo for Kubernetes
cyang49/nodejs-ex
node.js example
cyang49/examples
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
cyang49/rnn-benchmarks
Benchmarks for several RNN variations with different deep-learning frameworks
cyang49/continuation
Experimental continuation implementation