Comments (2)
I had a look and saw that all trials have a much higher count for particle reinvigoration at the last time step compared to others
Having high particle reinvigoration could be totally normal. It's a different issue from particle deprivation. If the number keeps growing, the suggests somehow the true observation is less predictable from the current particles. That might be a property of the problem itself.
Since trials are independent (i.e., I am creating a new instance of the problem for every trial and resetting the belief), I wonder if it makes sense to update the belief when the trial ends at all.
Since trials are independent, you only need to make sure the belief is correct at the start of a trial.
from pomdp-py.
That might be a property of the problem itself
If that were the case, what can I do to avoid this occasional particle deprivation? I can circunvent it by just avoiding the final update, but I am curious about potential solutions
Since trials are independent, you only need to make sure the belief is correct at the start of a trial.
Great, I will do that then, thank you!
from pomdp-py.
Related Issues (20)
- Using POMCP to solve a time-dependent problem HOT 4
- Benchmark w.r.t the original Silver's code? HOT 2
- SARSOP choose same action everytime. HOT 6
- Can't find module named 'pomdp_py.algorithms.po_uct' HOT 8
- Call for Contributions HOT 5
- Cannot convert type to pomdp_py.framework.basics.Action HOT 13
- Moving a problem from SARSOP to POMCP HOT 16
- Sarsop won't compute policy after changing observation model HOT 9
- Changing max_depth and planning_time for POMCP HOT 10
- Making a greedy rollout policy for POMCP HOT 8
- How to correctly modify a planner object HOT 9
- General question about goal and failure states? HOT 3
- Does this library support continuous pomdp problems? HOT 1
- How to correctly implement a goal/terminal state HOT 8
- Enable random seeding in POUCT / POMCP for deterministic behavior
- Transition and probability in Update belief of Multi Object Search HOT 2
- Multi object search history and tree construction HOT 3
- Modernize repo HOT 1
- Random.choice behavior change in python 3.9 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pomdp-py.