Record my learning journey to be LLM developer, hope I can succeed
- Get familiar with hugging face: https://huggingface.co/docs/hub/index
- Try https://github.com/huggingface/
- Try use google collab
- Try to implement LLM from scratch, there is some in https://github.com/kyaiooiayk/Awesome-LLM-Large-Language-Models-Notes at the end of the page
- A Survey of Large Language Models https://arxiv.org/abs/2303.18223 https://github.com/RUCAIBox/LLMSurvey
- Generative Agents: Interactive Simulacra of Human Behavior
- From ChatGPT Wiki: https://en.wikipedia.org/wiki/Sama_(company) one training data company
- LoRA: low rank adaptation
- TensorFlow
- PyTorch
- https://github.com/kyaiooiayk/Awesome-LLM-Large-Language-Models-Notes
- https://github.com/thunlp/PLMpapers
- https://github.com/horseee/Awesome-Efficient-LLM
- https://github.com/onejune2018/Awesome-LLM-Eval
- https://github.com/zjukg/KG-LLM-Papers
- https://github.com/WLiK/LLM4Rec-Awesome-Papers
- https://github.com/luban-agi/Awesome-Domain-LLM
- https://github.com/ikaijua/Awesome-AITools
- https://github.com/HqWu-HITCS/Awesome-Chinese-LLM
- https://github.com/Hannibal046/Awesome-LLM
- https://github.com/datawhalechina/prompt-engineering-for-developers
- https://github.com/GoogleCloudPlatform/generative-ai
- https://github.com/AprilNEA/ChatGPT-Admin-Web
- https://github.com/mudler/LocalAI
- https://github.com/ConnectAI-E/AutoGPT-Next-Web
- https://github.com/ymcui/Chinese-LLaMA-Alpaca
- https://github.com/mlabonne/llm-course
- https://github.com/labring/FastGPT
- https://github.com/huggingface/peft
- https://github.com/openai/evals
- https://github.com/langgenius/dify
- https://github.com/zhayujie/chatgpt-on-wechat
- https://github.com/chatchat-space/Langchain-Chatchat
- Stop a while to start one project
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent