ashisghosh / nanollm Goto Github PK
View Code? Open in Web Editor NEWThis project forked from dusty-nv/nanollm
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
Home Page: https://dusty-nv.github.io/NanoLLM/
License: MIT License