Comments (3)
Never mind my comment above - found those codes in the repository.
https://github.com/google-research/nasbench/blob/master/nasbench/lib/evaluate.py
https://github.com/google-research/nasbench/blob/master/nasbench/lib/model_builder.py
from nasbench.
Hi goodboyanush,
Originally we wanted to release all trained model weights but the total file size is well over a petabyte and we haven't found an effective way to serve this data to researchers.
Is there some specific use-case you are looking for? It may be possible to regenerate the checkpoints by retraining a single model using the open-sourced code.
from nasbench.
Hi Chris,
Thanks for open-sourcing the interesting code base!
Maybe more realistic request is to open source at least the training code because that is already non-trivial. That code would consist of two parts, (1) going from ModelSpec(matrix, ops)
to full tensorflow code for building the corresponding graph and (2) running optimization steps with pre-defined hyperparameters. Writing those codes and trying to be 100% identical to your implementation would be quite a bit of work, if not impossible. Since you already have code for this, can you open source it? (Or is it already there and I missed it?)
from nasbench.
Related Issues (20)
- y-axis in Fig 7(left) HOT 4
- Reproduce Figure 8 in the NASBench paper
- Are there any api of turning the 01 spec_matrix into model_architecture? HOT 1
- Generating a dataset (tfrecord files) HOT 1
- Not compatible with tensorflow 2.0 HOT 3
- how to create model instance using matrix?
- RMSProp epsilon=1.0, why?
- How to get the FLOPs of a model HOT 2
- Lower than expected final test accuracies for some models? HOT 1
- Data Query is non-deterministic HOT 1
- hdf5 file format
- tensorflow 2.3.1 incompatibility HOT 1
- How to extract all the architectures and metrics from the records? HOT 1
- source code for calculating the graph edit distance HOT 1
- what is "total_time" in the tfrecord file?
- is_valid is true, query function report errors HOT 1
- how to get the model spec by accuracy?
- How much mean test accuracy can the best architecure achieve? HOT 1
- Have you compare the execution time of various algorithms? HOT 4
- Query neighbors of an architecture HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nasbench.