Any way to get regular response as well as actions? about extended_openai_conversation

[jekalmin]

1. I just tried this with two models, and the result is following.

   gpt-3.5-turbo-1106	gpt-4-1106-preview

   For example, in order for gpt-3.5-turbo-1106 model to answer general questions, you can modify prompt by adding a sentence like below:

   You are not only limited to answer about smart home, but also general knowledge.

   If your model repeats what you asked, tell model not to repeat using a prompt. The default prompt is made like this:

   1. change prompt
   2. ask question
   3. check behavior
   4. repeat i-iii

   Although it is not ideal, it works in general. Better prompt should be contributed here since the quality depends not only on model but also on prompt.

2. This can also be fixed by changing the prompt I guess. You can try removing the last two sentences of the default prompt. These two sentences worked when using gpt-3.5-turbo before, but it seems not effective in recent models.

   I put Do not execute service without user's confirmation sentence because I wanted the model to ask me again before taking into action.

   I put Do not restate or appreciate what user says, rather make a quick inquiry. sentence for case like following:

   user: "I'm done using restroom"
   assistant: "Do you want to turn off the light of restroom?"
   user: "Yes"
   assistant: "Turned the light off"

   Tweak with prompt and please share it by contributing to example for better use for everyone.

[Someguitarist]

Hmmm, so I think my issue might be related to running out of memory, or something similar. I'm running LocalAI and if I remove the template prompts entirely I get a response, but also if I increase the context size to something like ~4-5k it will actually answer the question once, and on asking the same question a second time it will just repeat the question back, at least on a 1660Ti.

You can close this issue, as I don't think it's related to your plug in at all. I think it's a setting somewhere in LocalAI to increase either VRAM or RAM allocations. If I can get it working I'll post back with what I've changed!

[jekalmin]

Oh, I have not tested with LocalAI yet :(
Hope to find a way to resolve it!
Thanks :D