Ph.D. student at UC San Diego; B.S. in Computer Science at Peking University
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
Reasoning with Language Model is Planning with World Model
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)
Official implementation of "Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thought" (NeurIPS 2025)
Official Implementation of "Emergence of Superposition: Unveiling the Training Dynamics of Chain of Continuous Thought"
Training codebase for K2-V2
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
Sentiment analysis on IMDB dataset, based on LSTM and word attention, implemented with PyTorch
The official Meta Llama 3 GitHub site
Website for DSC 204a, Winter 2024
List of language agents based on paper "Cognitive Architectures for Language Agents"
Repository for the ACL2023 paper "Reasoning with Language Model Prompting: A Survey".
My notes for research/courses
A trend starts from "Chain of Thought Prompting Elicits Reasoning in Large Language Models".
A spreadsheet script for automatically paper meta-data completion
This repository contains a collection of papers and resources on Reasoning in Large Language Models.
A simple but effective approach for joint entity and relation extraction on ACE 05 dataset
A collection of information for 2018 fall CS master programs.
Assignments for Berkeley CS 285: Deep Reinforcement Learning (Fall 2021)
Software Engineering Course Project of Peking University Fall Semester 2021
A bert-based model implemented in PyTorch, for distinguishing texts generated by machine with human-written text.