tdoublep/torch-spyre
PyTorch backend for IBM's Spyre AIU
Principal Research Scientist @IBM | Committer @vllm-project
PyTorch backend for IBM's Spyre AIU
Tests/Scripts for use with foundation-model-stack models running on AIU
Can AI Agents Build Bespoke LLM Serving Systems?
vLLM plugin for Spyre based on torch-spyre
A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Fast and memory-efficient exact attention
FM Benchmarking Framework
🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
vLLM adapter for a TGIS-compatible gRPC server.
Demonstrate throughput of PyTorch FSDP
IBM development fork of https://github.com/huggingface/text-generation-inference
LLM training code for MosaicML foundation models
Library for Semi-Automated Data Science
The source code that powers readthedocs.org
This repo contains ancillary information used to assist users of IBM Watson Machine Learning Community Edition. This repo will contain How To's, Readme's, Dockerfiles, etc. that can be consumed by users looking to get started.
A template Sphinx repo
OpenML AutoML Benchmarking Framework