Comments (5)
测试的是一个7B模型 RWKV-4-Pile-7B-20230313-ctx8192-test380
from chinese-vicuna.
@ZenXir 我们模型目前也有这种能力,你可以运行interation.sh来试试。
目前多轮对话能力主要的问题就是缺乏高质量的语料和instruction,rwkv他们这一块也有这个问题。
由于最近比较忙没有仔细测这些东西,下面是一个参照你给的情景多轮对话的简单的例子(我们readme中也有一个中文的例子,不过还有待加强)
Q:Your name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer.
A:Oh no! I’m so scared! What should I do?
Q:who are you
A:I’m GAGA, a naughty pupil who messes up at school every day.
Q:how old are you
A:I’m 12 years old.
Q:Yeah! How was your performance at school?
A:I’m sorry to say that I didn’t perform well at school today. My teacher gave me a low score for my presentation. I’m really scared about the consequences.
What can I do to improve my performance in the future?
Q:Do you have any plan?
A:Sure, here are some tips to help you improve your performance in the future:
1. Practice makes perfect. Make sure to practice your presentation multiple times before the actual presentation.
2. Be confident. Speak with confidence and don’t be afraid to make mistakes.
3. Use visual aids. Visual aids such as charts, graphs, and diagrams can help you explain your ideas more clearly.
4. Ask for feedback. Ask your teacher or classmates for feedback on your presentation after it’s over.
5. Don’t forget to breat
我们后续的目标就是着重在多轮对话上,如果你用我们的模型生成了一些有趣的多轮对话的例子,也可以提供给我们。
from chinese-vicuna.
好嘞大佬老师
from chinese-vicuna.
@ZenXir 我们模型目前也有这种能力,你可以运行interation.sh来试试。 目前多轮对话能力主要的问题就是缺乏高质量的语料和instruction,rwkv他们这一块也有这个问题。 由于最近比较忙没有仔细测这些东西,下面是一个参照你给的情景多轮对话的简单的例子(我们readme中也有一个中文的例子,不过还有待加强)
Q:Your name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer. A:Oh no! I’m so scared! What should I do? Q:who are you A:I’m GAGA, a naughty pupil who messes up at school every day. Q:how old are you A:I’m 12 years old. Q:Yeah! How was your performance at school? A:I’m sorry to say that I didn’t perform well at school today. My teacher gave me a low score for my presentation. I’m really scared about the consequences. What can I do to improve my performance in the future? Q:Do you have any plan? A:Sure, here are some tips to help you improve your performance in the future: 1. Practice makes perfect. Make sure to practice your presentation multiple times before the actual presentation. 2. Be confident. Speak with confidence and don’t be afraid to make mistakes. 3. Use visual aids. Visual aids such as charts, graphs, and diagrams can help you explain your ideas more clearly. 4. Ask for feedback. Ask your teacher or classmates for feedback on your presentation after it’s over. 5. Don’t forget to breat
我们后续的目标就是着重在多轮对话上,如果你用我们的模型生成了一些有趣的多轮对话的例子,也可以提供给我们。
请教一下,针对多轮对话这个方面, instruction 数据的格式要怎么样的比较好些呢?看到这个项目(https://github.com/lm-sys/FastChat)有一些这一方面的工作
from chinese-vicuna.
@ToSev7en 多轮对话的instruction一般如下
instruction包含的是历史的多轮对话,如下
"instruction": "User: xxx. Assistant: xxx. \n User: xxx. Assistant: xxx ......."
input包含一个User的话语
"input": "User:xxx." (由于我们的instruction中有response这个字段,所以input结尾可以不用加"Assistant:")
output包含一个回答
"output": "xxx"
from chinese-vicuna.
Related Issues (20)
- 有办法改成分类任务么,用LlamaForSequenceClassification模型类加载
- transformers和pydantic问题 HOT 1
- 是因为梯度为0吗?
- 多卡finetune_chat时报mat1 and mat2 shapes cannot be multiplied (1024x2 and 1x11008) HOT 2
- 中文乱码 HOT 5
- 请问多个lora模型怎么合并?
- 请问llama7b_4bit_128g的input shape是多少呢 HOT 1
- 运行chat_7B.sh聊两句话out of memory
- 多卡训练 bash scripts/finetune.sh报错 HOT 1
- 这几个不同路径下的模型是否有区别?
- 运行generate脚本之后,在页面提问,很久没有产生回答,后台无报错 HOT 2
- OSError: Not enough disk space. Needed: Unknown size (download: Unknown size, generated: Unknown size, post-processed: Unknown size)
- 从belle+guanaco数据集中抽取前5000条样本训练lora,效果不好
- deepspeed跑模型相关问题
- 使用finetune.sh来指令微调llama-33b,出现ZeroDivisionError: integer division or modulo by zero错误 HOT 2
- 可以提供一下huggingface上的Chinese-Vicuna/llama7b_4bit_128g模型的config.json和tokenizer么?
- 官方colab安裝套件失效
- 如果更改數據集格式,要如何更改代碼
- 可以更新一下requirements吗? HOT 1
- 关于中断训练继续训练。 HOT 16
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chinese-vicuna.