Comments (6)
shibing624
commented on July 27, 2024
最好是人工标注，格式参考示例jsonl
from medicalgpt.
ZTurboX
commented on July 27, 2024
最好是人工标注，格式参考示例jsonl
60亿参数全量训练，一台8卡的a100/a800够用吗
from medicalgpt.
shibing624
commented on July 27, 2024
够
from medicalgpt.
cxjtju
commented on July 27, 2024
奖励模型数据需要怎样构造呢
请问增量训练增加了垂直领域的数据，奖励模型的数据是否只需要领域相关即可
from medicalgpt.
cxjtju
commented on July 27, 2024
response_chosen 和 response_reject是sft之后的模型生成两个response，然后人工选择吗？
from medicalgpt.
shibing624
commented on July 27, 2024
是
from medicalgpt.
Related Issues (20)
- ValueError: operands could not be broadcast together with remapped shapes [original->remapped]: (3,2) and requested shape (1,2) HOT 1
- 使用deepspeed 全参数sft后，inference 回答的都为空，有解决办法吗 HOT 2
- Regarding RLHF and DPO training data HOT 2
- UserWarning: None of the inputs have requires_grad=True. Gradients will be None HOT 2
- reward_modeling咨询 HOT 1
- orpo脚本NoneType问题 HOT 6
- 训练reward_modeling.py HOT 1
- 几步的训练怎么都是独立的，rm都没用sft的adapter HOT 1
- 对chat模型进行二次预训练后，自问自答 HOT 1
- 关于提前结束训练 HOT 4
- dpo_training.py eal存在空的情况 HOT 2
- AMD 执行 run_pt.sh失败 HOT 1
- 有没有人能分享下自己微调后的模型id，我懒得弄，只想吃现成的 HOT 1
- vocab扩展后的模型合并问题 HOT 1
- ppo训练时出现问题：UserWarning: KL divergence is starting to become negative: -233.50 HOT 2
- DPO训练，报错：“IndexError: Invalid key: 0 is out of bounds for size 0” HOT 2
- 运行pretraining.py时报错：RuntimeError: CUDA error: device-side assert triggered HOT 4
- 医学大模型全流程体验 HOT 2
- 关于llama3的权重转换 HOT 1
- ValueError: Please specify target_modules in peft_config HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from medicalgpt.