Comments (5)
Thank you for reporting this. I'm happy to review chat-copilot's interaction with custom-plug-ins for result handling and if additional logging might be helpful.
I'm wondering if the model is cosolidating test
, Test
, and Test5
as a single logical item: Test
. Is it possible to provide the prompt metrics (click the "information" icon in the chat bubble) and the short/long term memory values from the persona tab. This may help determine if actual values are provided and if the model then consolidates.
Another test might be to add distinct items such as Cheese
, Celery
, Catfood
, etc...
I look forward to hearing back from you and will also investigate on this end.
from chat-copilot.
@crickman - Thank you for your prompt response. I appreciate your suggestion to explore whether the model is consolidating similar terms and to examine the prompt metrics and memory values.
I have conducted the tests as you've suggested. I created distinct items such as 'Cheese,' 'Celery,' and other 'Test' to ensure the items are unique. Despite this, the issue persists, and the plugin still fetches outdated data when interacting with Chat-Copilot.
I have attached the screenshots showing the error. The first screenshot demonstrates the outdated results from Chat-Copilot, while the second screenshot displays the prompt metrics and expected up-to-date results from Swagger for comparison. The third and fourth screenshots showcases the additional tests.
In addition, I've captured the short/long term memory values from the persona tab. I hope these details will be helpful in your investigation.
Please let me know if there's any other information or steps you'd like me to take to assist in resolving this issue. Your expertise is greatly valued, and I'm looking forward to your insights.
Thank you once again for your assistance.
from chat-copilot.
Wonderful, thank you for these additional data-points. I aim to complete my analysis today.
from chat-copilot.
I was able to reproduce your report with a function that adds a new guid to the list upon each invocation:
In my case, the "cached" value is being derived from the chat history. I suspect something similiar is occuring for you while the function result is being captured as expected. I am a little uncertain as to which prompt details you've shared...is that the planner prompt? I'd expect the prompt related to the plan/function/plug-in execution to contain the function results.
In anycase, let me raise this to the team for ideas.
from chat-copilot.
I think we may have a work-around to try...unclear how effective it may be.
from chat-copilot.
Related Issues (20)
- [Help Required] Moving to Managed Identity for Azure Resource Authentication HOT 1
- Chat extension log output is not as informative as it used to be HOT 1
- Docker-compose up not working HOT 2
- How do I add support for csv, ppt, and support for other document types? HOT 2
- Unable to generate bot response. Details: Error: 500: Internal Server Error HOT 1
- Unable to access the web app HOT 7
- Conflict between appsettings and code HOT 1
- Infinite questions in copilot HOT 1
- Chat memories are not deleted when chat session is deleted HOT 7
- ChatPlugin crashes on Azure OpenAI gpt-35-turbo 1106 HOT 4
- What's the default queue name for AzureQueue? HOT 5
- Power Platform Chatbot Copilot Studio: Issue with publishing Copilots HOT 1
- User Feedback content violation
- After running the memory pipeline, it keeps throwing an error: 'File not found: chatmemory/{GUID}/__pipeline_status.json HOT 3
- Can't retrieve document memory in chat HOT 6
- Cannot read properties of undefined (reading 'getLogger') HOT 6
- Definition of quality health care HOT 1
- Definition of quality health care HOT 1
- Getting 404 - Ressource not found HOT 2
- 我如何在本地部署
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chat-copilot.