rajveerb Goto Github PK

amdprofilecontrol

code to take AMDProfileControl's APIs for a spin

amdprofilecontrol-python

Python wrapper/binding for AMDuProf's AMDProfileControl APIs

cpython

The Python programming language

cuda-samples

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

dants.github.io

Dan Tsafrir's Home page

eva

Exploratory Video Analytics System

fiddler

Fast Inference of MoE Models with CPU-GPU Orchestration

gt-systems.github.io

Website for systems group at Georgia Tech

habitat

🔮 Execution time predictions for deep neural network training iterations across different GPUs.

itt-python

Includes Python bindings to instrumentation and tracing technology (ITT) APIs for VTune

llm-numbers

Numbers every LLM developer should know

lotus

numpy

The fundamental package for scientific computing with Python.

perfmon

pillow

Python Imaging Library (Fork)

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

tensorflow

An Open Source Machine Learning Framework for Everyone

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

training

Reference implementations of MLPerf™ training benchmarks

vision

Datasets, Transforms and Models specific to Computer Vision

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs