Comments (1)
@kwonmha - I thought it's just a not important choice, like someone perfer loguru
, and another one perfer native logging
. And if using peft package from HF, there're some trouble, like peft need a regex to match module name with less readable code or list the all full name that lose the universality. The second trouble is the gradient checkpoint, cause peft will warp the module which make the model lose the function like gradient_checkout_enable
, then you must enable it once the base transformer model init that makes transformer model and v_head separated. DS team may perfer a model without any warpper, Just like it said in the comments of deepspeed initialize.
from deepspeedexamples.
Related Issues (20)
- 不同机器上python环境变量路径不同,deepspeed启动后发现找不到其他机器的python环境,如何解决
- Deepspeed support finetune extra model with lora ? HOT 1
- Does Zero-Inference support TP? HOT 11
- How to use deepspeed for multi-node and multi-card task in slurm cluster
- [Error] AutoTune: `connect to host localhost port 22: Connection refused`
- run-example.sh fails with urllib3.exceptions.ProtocolError: Response ended prematurely HOT 11
- 请问fastgen 是否支持长文本和序列并行推理
- can not run the test-gpt.sh because of assertionError
- cannot pickle 'Stream' object
- CPU OOM when inferencing Llama3-70B-Chinese-Chat
- DeepSpeed-Chat step-1 hanging for a long time
- 单机多卡进行RLHF在第三步中使用Qwen模型作Actor Model报错 HOT 1
- an error with gradient checkpointing in DeepspeedChat step 3
- Consult the first phase. HOT 2
- How to start deepspeed automatically? HOT 1
- nvcc fatal : Unsupported gpu architecture 'compute_86' and nvcc fatal : Value 'c++17' is not defined for option 'std' HOT 1
- Different zero stage the training memory compute
- step2 without any response for a long time
- [++Xem CLip++] Kha Nữ Viral Lộ Clip 4 Phút video bị cáo buộc bị rò rỉ trên Reddit
- ((√)) Clip Kha Nữ lộ 4 Phút Xong Rồi Và Cái Kết Video
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from deepspeedexamples.