jllllll Goto Github PK
Type: User
Type: User
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
8-bit CUDA functions for PyTorch
Windows compile of bitsandbytes for use in text-generation-webui.
Python bindings for the Transformer models implemented in C/C++ using GGML library.
ctransformers wheels with pre-built CUDA binaries for additional CUDA and AVX versions.
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
A fast inference library for running LLMs locally on modern consumer-class GPUs
Fast and memory-efficient exact attention - Windows wheels
4 bits quantization of LLMs using GPTQ
A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
Precompiled Wheels for GPTQ-for-LLaMa
Private Q&A and summarization of documents+images or chat with local GPT, 100% private, no data leaks, Apache 2.0. Demo: https://gpt.h2o.ai/
Wheels for llama-cpp-python compiled with cuBLAS support
Simplified installers for oobabooga/text-generation-webui.
Simple, safe way to store and distribute tensors
A next generation Python CMake adaptor and Python API for plugins
LLM Frontend for Power Users.
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
Standalone, dependency-less scripts for automatically setting up a virtual environment for easy project installation on Windows.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.