Comments (2)
ysymyth
commented on April 28, 2024
Thanks @serotoninpm !
- Success and failure are simply defined as whether the LLM is able to reach correct answers after the ReAct procedure (measured by the final response).
- Therefore, the LM can reach correct answers for the wrong ReAct trajectory. We would like to distinguish such cases from those successful cases where the trajectories are also correct, therefore report "false positive" in the table.
- Hallucination can happen anytime, both in success and failure cases (even the model hallucinates at some point, it may still be able to reach the correct answer for the wrong reason). Therefore in both modes we report the hallucination traces.
from react.
serotoninpm
commented on April 28, 2024
Thank you for your detailed and kind explanation!
from react.
Related Issues (20)
- Alfworld GPT-3 Results HOT 3
- I got zero score running Webshop.ipython HOT 8
- Question about webshopEnv HOT 6
- Could you please tell me how to access the url in the WebShop.ipynb: http://3.83.245.205:3000 ? HOT 4
- Have you ever considered to apply ReAct prompting to numerical reasoning task? HOT 1
- Could you provide text-davinci-002 log on HotpotQA 500 (30.8EM)? HOT 1
- Potential Implementation error on Webshop
- Questions on Table 3 (AlfWorld) HOT 1
- Webshop experiment details for numbers in paper HOT 1
- Get low accuracy with GPT-3.5. HOT 12
- Question for the code HOT 1
- WEBSHOP_URL = "http://3.83.245.205:3000" 遇到一些问题 HOT 4
- Davinci-002 HOT 1
- Old or New openai version HOT 2
- [Reproducing Results] on Alfworld HOT 3
- How can I install ReAct? HOT 2
- How to finetune the small REACT model
- cot->react & react->cot HOT 2
- Jupyter output on HotpotQA HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from react.