mlnexus Goto Github PK

bark.cpp

Suno AI's Bark model in C/C++ for fast text-to-speech

dl-in-iot-course

driver-state-detection

A real time, webcam based, driver attention state detection/monitoring system in Python3 using OpenCV and Mediapipe

frugally-deep

A lightweight header-only library for using Keras (TensorFlow) models in C++.

geneticalgorithmpython

Source code of PyGAD, a Python 3 library for building the genetic algorithm and training machine learning algorithms (Keras & PyTorch).

hardware-aware-transformers

[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing

lite-transformer

[ICLR 2020] Lite Transformer with Long-Short Range Attention

llama.cpp

LLM inference in C/C++

llama2.c

Inference Llama 2 in one file of pure C

llamafile

Distribute and run LLMs with a single file.

llm.c

LLM training in simple, raw C/CUDA

matmulfreellm

Implementation for MatMul-free LM.

micrograd

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

mlonmcu

Tool for the deployment and analysis of TinyML applications on TFLM and MicroTVM backends

modulus

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

multibax-sklearn

Design space subset estimation using Bayesian algorithm execution with sklearn GP models

once-for-all

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

onnxstream

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

storm

An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

whisper.cpp

Port of OpenAI's Whisper model in C/C++