Comments (4)
Hi @cyrilmyself -- thanks for reaching out! Could you provide a bit more context and detail about your usecase, goals, parameters, and objective/constraints?
from ax.
I use botorch to run Bandit Optimization as https://ax.dev/tutorials/factorial.html,what i want to know is when should i
stop the optimization。if i did not stop,the experiment will run forever。So how to set the condition of stopping the bandit optimization
from ax.
Hi @cyrilmyself, usually folks have a few different ways that they assess when to stop the optimization, but the underlying thought process is the same: run trials, typically in batches, and then assess if there is convergence/plateauing. Eventually, there are diminishing returns for running additional trials, and this is usually a good place to stop the experiment. Also, typically folks are constrained on the number of trials they can feasibly run, so that is another consideration. Leveraging visualizations is a great and intuitive tool for deciding when to complete the experiment.
In the case of the Bandit Optimization tutorial, you can see the rollout process visualization shows that as more trials are ran, there are only 4 arms that are still being considered, down from over 20 arms in the first trial. We choose to run 4 trials in this code block. For a learning experience, it could be interesting to play around with running more or less trials by modifying that code block to see how number of trials effects how many arms are still being considered. In practice, using some balancing between the number of trials you are able to run, and the output after running x number of trials to determine if you should continue the optimization is a good way to go about it.
In other setups, such as Hyperparmaeter Optimization for Pytorch, you can plot the optimization trace to identify when there is a plateau in model improvement given more iterations. And we also offer more advanced global stopping strategies that you can implement to more "smartly" stop your experiment early if additional trials are unlikely to be beneficial.
Is this helpful?
from ax.
Closing the issue, please feel free to re-reach out if something remains unclear. Have a great weekend @cyrilmyself :)
from ax.
Related Issues (20)
- cannot import name 'TrainingData' HOT 2
- applying complex constrains HOT 2
- Ax is not not starting as many workers as I'd like to; sometimes, get_next_trials returns 0 new trials HOT 4
- Evaluating custom candidates HOT 2
- Input Feature Selection - Does the relevant code exist? HOT 6
- [Feature Request] support constraints on `ChoiceParameters` HOT 4
- Extending Models.THOMPSON with an extra parameter HOT 1
- There are some questions when i use the Ax HOT 7
- Space characters in the objective name AND specifying a threshold leads to an error message: "AssertionError: Outcome constraint should be of form `metric_name >= x" HOT 1
- Pandas deprecation warning when deserializing AxClient JSON HOT 2
- AX seems to get stuck with Ray
- `StandardizeY` transform requires non-empty data." when using SAASBO
- Plotting outside of a notebook HOT 1
- Setting search space step size in Ax Service API HOT 10
- Problem when Sobol falls back to HitAndRunPolytopeSampler HOT 3
- Arms from previous batch keep appearing in new batches HOT 5
- EHVI & NEHVI break with more than 7 objectives HOT 4
- Multi-objective experiments generate duplicated data HOT 5
- Question: Transforming objective when passing `best_f` to `ProbabilityOfImprovement`, etc. HOT 3
- [Question] Multiobjective optimization where one target has no optimization direction (but required range)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ax.