Comments (1)
instruction 和 input有什么区别?
在大型模型的SFT(Supervised Fine-Tuning)数据集中,"instruction"(指导)和"input"(输入)之间存在以下区别:
-
Instruction(指导):指导是针对模型的指令或提示,用于指导模型生成正确的输出。它可以是一段自然语言文本,描述所需的操作、结果或行为。指导的目的是帮助模型理解任务要求并生成相应的输出。
-
Input(输入):输入是指模型接收的原始数据,通常是一个或多个自然语言句子。输入可能包含与指导相关的信息,但它不直接指示模型要执行的操作。相反,模型需要从输入中提取信息并结合指导生成适当的输出。
总的来说,指导是一种指示模型所需操作或结果的指令,而输入是模型用于生成输出的原始数据。指导提供任务的上下文和目标,而输入则提供了需要处理的具体信息。
Answered by chatgpt
from llms_tool.
Related Issues (18)
- 可不可以提供一下生成json的脚本,我这边生成的会报错,是编码格式的问题吗? HOT 4
- Pls support RWKV world model
- 关于权重合并
- 关于权重合并 HOT 1
- dpo训练异常 HOT 16
- 使用prefix-tuning微调Qwen模型时报错 HOT 1
- 期待預訓練代碼 HOT 1
- sft时不输出eval loss HOT 3
- 大神能建个微信群或者留个联系方式吗? HOT 1
- baichuan2-13b-chat的deepspeed训练报错,是dpo训练
- 扩展词表代码需优化
- 关于模型预训练 HOT 2
- 大佬,能尝试做训练用的WebUI吗? HOT 1
- deepspeed报错
- QLora似乎不能和deepspeed zero3一起使用? HOT 1
- AttributeError: 'DataManager' object has no attribute 'generating_args_preprocess' HOT 1
- sft train报错
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llms_tool.