vlimant / mpi_opt Goto Github PK
View Code? Open in Web Editor NEWHyperparameter optimization with MPI
Hyperparameter optimization with MPI
@thongonary @duanders can you please put here a recipe to run the "option 3"
something like vlimant/mpi_learn@a188dc7 needs to get in hyperparameter_search_option3.py
might be easier to have a block of options that can be imported (easier with a merge of repo maybe)
with maybe a bit of details this time @vloncar . What we would need is to run
mpirun -n 11 --tag-output python3 hyperparameter_search_option3.py --block-size 5 --verbose --example mnist --epochs 100 --num-iterations 20
kill it half way through (which slurm might do on hpc) and be able to do
mpirun -n 11 --tag-output python3 hyperparameter_search_option3.py --block-size 5 --verbose --example mnist --epochs 100 --num-iterations 20 --resume <some identifier>
which would restart the master optimizer (with previously fitted values, there is a coordinator*.pkl existing) and resume all masters on the model they were at (so that we loose not too much of what has been done for that parameterset).
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.