chenweihua91 Goto Github PK

adaptive-knn-mt

awesome-transformer-nlp

A curated list of NLP resources focused on Transformer networks, attention mechanism, GPT, BERT, ChatGPT, LLMs, and transfer learning.

belle

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

bertsum

Code for paper Fine-tune BERT for Extractive Summarization

chatglm-finetune-lora

Code for fintune ChatGLM-6b using low-rank adaptation (LoRA)

chenweihua.github.io

chinese-llama-alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU部署 (Chinese LLaMA & Alpaca LLMs)

comet

A Neural Framework for MT Evaluation

data

中文语料库-每日自动更新版 ── 语料文件

domainwordsdict

DomainWordsDict, Chinese words dict that contains more than 68 domains, which can be used as text classification、knowledge enhance task。涵盖68个领域、共计916万词的专业词典知识库，可用于文本分类、知识增强、领域词汇库扩充等自然语言处理应用。

efficient_knn_mt

espnet

End-to-End Speech Processing Toolkit

fastertransformer_backend

flagembedding

Dense Retrieval and Retrieval-augmented LLMs

glm-130b

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

graformer

The repository for the paper: Multilingual Translation via Grafting Pre-trained Language Models

harvesttext

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法

imagen-pytorch

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

kster

code and data for paper "Learning Kernel-Smoothed Machine Translation with Retrieved Examples"

llama.cpp

Port of Facebook's LLaMA model in C/C++

megatron-lm

Ongoing research training transformer models at scale

merlin

This is now the official location of the Merlin project.

openchatkit

palm-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

pandallm

Panda: 海外中文开源大语言模型，基于 Llama-7B, -13B, -33B, -65B 进行中文领域上的持续预训练。

pandalm

pretrained-language-model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

rrhf

RRHF & Wombat

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

self-instruct

Aligning pretrained language models with instruction data generated by themselves.