QingruZhang/AdaLoRA
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
ML Ph.D. Student @ Georgia Tech
Repositories
QingruZhang/PASTA
PASTA: Post-hoc Attention Steering for LLMs
QingruZhang/PLATON
This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
QingruZhang/SoftwareConfiguration
QingruZhang/Data-Mining-LianJia-HousePrice-Prediction-Project
Data Mining Project: extract raw data from LianJia; data proprocess and feather engineering; build model with MLP and BiLSTM.
QingruZhang/AdaShift_Release
The original implementation of the experiments in the paper of AdaShift (See https://arxiv.org/abs/1810.00143)
QingruZhang/alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
QingruZhang/lm-evaluation-harness
A framework for few-shot evaluation of language models.
QingruZhang/OptiMUS
Optimization Modeling Using mip Solvers and large language models
QingruZhang/OpenRLHF
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)
QingruZhang/trl
Train transformer language models with reinforcement learning.
QingruZhang/summarize-from-feedback
Code for "Learning to summarize from human feedback"
QingruZhang/alignment-handbook
Robust recipes to align language models with human and AI preferences
QingruZhang/demonstrated-feedback
QingruZhang/MAmmoTH
Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" (ICLR 2024)
QingruZhang/ReAlign
Reformatted Alignment
QingruZhang/TrustLLM
TrustLLM: Trustworthiness in Large Language Models
QingruZhang/chain-of-thought-hub
Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
QingruZhang/math
The MATH Dataset (NeurIPS 2021)
QingruZhang/LoftQ
QingruZhang/Sophia
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
QingruZhang/lost-in-the-middle
Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
QingruZhang/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
QingruZhang/text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, llama.cpp (GGUF), Llama models.
QingruZhang/exllama
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
QingruZhang/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
QingruZhang/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
QingruZhang/peft
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
QingruZhang/Thanos
A Biased Graph Neural Network Sampler with Near-Optimal Regret.
QingruZhang/unify-parameter-efficient-tuning
Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)