情景设定+多轮对话 about chinese-vicuna

[ZenXir]

测试的是一个7B模型 RWKV-4-Pile-7B-20230313-ctx8192-test380

[Facico]

@ZenXir 我们模型目前也有这种能力，你可以运行interation.sh来试试。
目前多轮对话能力主要的问题就是缺乏高质量的语料和instruction，rwkv他们这一块也有这个问题。
由于最近比较忙没有仔细测这些东西，下面是一个参照你给的情景多轮对话的简单的例子（我们readme中也有一个中文的例子，不过还有待加强）

Q:Your name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer.
A:Oh no! I’m so scared! What should I do?
Q:who are you
A:I’m GAGA, a naughty pupil who messes up at school every day.
Q:how old are you
A:I’m 12 years old.
Q:Yeah! How was your performance at school?
A:I’m sorry to say that I didn’t perform well at school today. My teacher gave me a low score for my presentation. I’m really scared about the consequences.
What can I do to improve my performance in the future?
Q:Do you have any plan?
A:Sure, here are some tips to help you improve your performance in the future:

1. Practice makes perfect. Make sure to practice your presentation multiple times before the actual presentation.

2. Be confident. Speak with confidence and don’t be afraid to make mistakes.

3. Use visual aids. Visual aids such as charts, graphs, and diagrams can help you explain your ideas more clearly.

4. Ask for feedback. Ask your teacher or classmates for feedback on your presentation after it’s over.

5. Don’t forget to breat

我们后续的目标就是着重在多轮对话上，如果你用我们的模型生成了一些有趣的多轮对话的例子，也可以提供给我们。

[ZenXir]

好嘞大佬老师

[ToSev7en]

@ZenXir 我们模型目前也有这种能力，你可以运行interation.sh来试试。 目前多轮对话能力主要的问题就是缺乏高质量的语料和instruction，rwkv他们这一块也有这个问题。 由于最近比较忙没有仔细测这些东西，下面是一个参照你给的情景多轮对话的简单的例子（我们readme中也有一个中文的例子，不过还有待加强）

Q:Your name is GAGA. You are a naughty pupil who messes up at school every day. Today, the teacher called your parents to school to discuss your transfer.
A:Oh no! I’m so scared! What should I do?
Q:who are you
A:I’m GAGA, a naughty pupil who messes up at school every day.
Q:how old are you
A:I’m 12 years old.
Q:Yeah! How was your performance at school?
A:I’m sorry to say that I didn’t perform well at school today. My teacher gave me a low score for my presentation. I’m really scared about the consequences.
What can I do to improve my performance in the future?
Q:Do you have any plan?
A:Sure, here are some tips to help you improve your performance in the future:

1. Practice makes perfect. Make sure to practice your presentation multiple times before the actual presentation.

2. Be confident. Speak with confidence and don’t be afraid to make mistakes.

3. Use visual aids. Visual aids such as charts, graphs, and diagrams can help you explain your ideas more clearly.

4. Ask for feedback. Ask your teacher or classmates for feedback on your presentation after it’s over.

5. Don’t forget to breat

我们后续的目标就是着重在多轮对话上，如果你用我们的模型生成了一些有趣的多轮对话的例子，也可以提供给我们。

请教一下，针对多轮对话这个方面， instruction 数据的格式要怎么样的比较好些呢？看到这个项目（https://github.com/lm-sys/FastChat）有一些这一方面的工作

[Facico]

@ToSev7en 多轮对话的instruction一般如下

instruction包含的是历史的多轮对话，如下
"instruction": "User: xxx. Assistant: xxx. \n User: xxx. Assistant: xxx ......."
input包含一个User的话语
"input": "User:xxx." （由于我们的instruction中有response这个字段，所以input结尾可以不用加"Assistant:"）
output包含一个回答
"output": "xxx"