Comments (5)
In my opinion, you can select the best one. The author chose the model from last epoch because they wanted to have a fair comparison with NAS.
from enas.
I see @nott0
from enas.
Hey, I have a problem understanding the final discovered architecture. I can see there is a directory called output and some meta, data, and index files are saved in there. However, none of them is not the discovered architecture. does anybody have any idea where this optimum architecture is saved?
from enas.
I can answer for the macro search. In the output directory as you say, all what you want is in the stdout
file. At each epoch, ENAS gives 10 architectures with the corresponding valid accuracy
(computed on the valid data set). What I do, is just search for the best valid accuracy
and take the corresponding architecture.
To remind you, an architecture looks like that :
[1]
[4 0]
[2 0 0]
[0 0 0 0]
[4 0 0 0 0]
[2 1 0 1 1 0]
[0 0 1 1 0 0 1]
[2 0 0 1 0 1 0 0]
[4 0 0 0 0 1 1 1 0]
[0 0 0 0 0 0 0 0 0 1]
[5 1 0 0 0 1 1 0 1 1 0]
[0 0 1 0 0 0 0 1 1 0 0 0]
val_acc=0.9062
If it can be of any help, I made a script for analyzing the result of ENAS: https://gitlab.com/ElieKadoche/enas_game_of_go/blob/master/outputs_saved/graph_maker_script.py. It will create a picture like that one.
from enas.
I can answer for the macro search. In the output directory as you say, all what you want is in the
stdout
file. At each epoch, ENAS gives 10 architectures with the correspondingvalid accuracy
(computed on the valid data set). What I do, is just search for the bestvalid accuracy
and take the corresponding architecture.To remind you, an architecture looks like that :
[1] [4 0] [2 0 0] [0 0 0 0] [4 0 0 0 0] [2 1 0 1 1 0] [0 0 1 1 0 0 1] [2 0 0 1 0 1 0 0] [4 0 0 0 0 1 1 1 0] [0 0 0 0 0 0 0 0 0 1] [5 1 0 0 0 1 1 0 1 1 0] [0 0 1 0 0 0 0 1 1 0 0 0] val_acc=0.9062
If it can be of any help, I made a script for analyzing the result of ENAS: https://gitlab.com/ElieKadoche/enas_game_of_go/blob/master/outputs_saved/graph_maker_script.py. It will create a picture like that one.
Hey, your answer was quite helpful. I have one more question. The macro-search script is discovering the best architecture. The discovered architectures have 12 layers, but while they are running the macro-final script to train their model, their architecture has 24 layers. why they have changed the number of layers and how they find the best operation and connections for layers 13 to 24? Also, they are not using pooling( neither max nor average) when they are training. This is contradicting to their discovered architecture.
from enas.
Related Issues (20)
- Adapting ENAS for chess
- potential change of NHCW to NHWC in micro_child.py
- Do you have plans to update this project to Tensorflow2.0?
- Reproducibility of the results from the paper (RNN) on new repository
- what is the batch size for the sampling? HOT 2
- enas_PTB child model
- Which version of tensorflow should I use? HOT 2
- How to restore final trained model??
- CNN architechure search run error on tensorflow1.13
- How much memory to run the cifar10 example HOT 4
- Not able to run on GPU HOT 1
- The output of micro search HOT 1
- How to cumpute the gradients of controller variables? HOT 1
- Enas
- About the architecture
- Library requirements
- Unknown data_format
- output ENAS
- Process finished with exit code -1073741571 (0xC00000FD)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from enas.