Hengyi Wang's Projects
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Awesome-LLM: a curated list of Large Language Model
Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models
Probabilistic time series modeling in Python
Inference code for LLaMA models
llmux is an experimental operating system that heps software development on Large Language Models
A Platform for Many-agent Reinforcement Learning
Code for our paper Non-Autoregressive Electron Redistribution Modeling for Reaction Prediction (ICML 2021)
official code for "Large Language Models as Optimizers"
The pivot analysis algorithm for lexical analysis of text attribute transfer
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP
A library for mechanistic interpretability of GPT-style language models
Google ML Camp 2020, By Turiss