Comments (8)
@riyadparvez, in the short run you can get trials as ax_client.experiment.trials
, and you can get parameters from each one of the trials as trial.arm.parameters
. Will add this functionality to the service API, too, but that should get you unblocked for now.
from ax.
AxClient
class hasget_best_parameters()
method. I don't see any methods inAxClient
class that returns all the trials with their parameters and evaluation results. Is there any plans to add such API?
I think you can get the full results using the experiment object inside the client
ax = AxClient()
result = ax.experiment.fetch_data()
from ax.
This is what I see if I do print(result.df)
arm_name metric_name mean sem trial_index
0 0_0 hartmann6 -0.016126 0.0 0
1 0_0 l2norm 1.384382 0.0 0
2 1_0 hartmann6 -0.114288 0.0 1
3 1_0 l2norm 0.663507 0.0 1
4 2_0 hartmann6 -0.009832 0.0 2
5 2_0 l2norm 1.874537 0.0 2
Still no easy way to get the parameters and the metrics.
from ax.
@lena-kashtelyan thanks, it worked.
Is it also possible to expose which trial yielded the best results?
from ax.
Hello again, @riyadparvez –– currently get_best_parameters
outputs a tuple of parameterization and metric values; you can use the former as a workaround for now, to find which trial output the results.
get_best_parameters
is still somewhat under development; thank you for the good idea of adding the trial index to its output!
from ax.
This is now on master! You can do ax_client.get_trials_data_frame()
: )
from ax.
This functionality is now available in the latest stable version, 0.1.6!
from ax.
Thanks a lot! Will give it a try.
from ax.
Related Issues (20)
- [Question] 'RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn' HOT 1
- Implementing `qGIBBON` (`qLowerBoundMaxValueEntropy`) with Ax HOT 4
- Help! Can't get started with BoTorch models HOT 6
- Can't run REMBO in a standard env HOT 6
- Runtimes, parallelism, and 'identical observations' HOT 7
- [Question] Changing parameter constraints before generating a new trial HOT 11
- Can BO sample only on the complex feasible region? HOT 1
- [Question] GPEI when function values are very non gaussian, extreme values HOT 10
- how to set Empirical Bayes in Bandit Optimization HOT 4
- [QUESTION] MAB with Thompson Sampling not converging HOT 2
- [Feature Request] Support fixing parameter values in `get_next_trial()` in ServiceAPI HOT 1
- [Question] Migrate hyperparameter optimization from SimpleExperiment to Experiment HOT 4
- how to set train_yvar with A/B testing data, if i want the FixedNoiseGP model HOT 3
- Adding / Obtaining the slice_values for contour and slice plots HOT 1
- ValueError: Raw data must be data for a single arm for non batched trials. for the below code which is part of the tutorial. for v0.2.6 HOT 4
- [Question] Is it possible that AX to work with other external programs? HOT 2
- [CODING QUESTION] Data to attach is empty HOT 2
- [CODING QUESTION] 'Data' object has no attribute 'is_ok' HOT 3
- how to use Banit Optimization of AX if i want to set multiple objects? HOT 4
- SyntheticRunner: @property decorator missing for def run_metadata_report_keys() HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ax.