velythyl / gym-duckietown Goto Github PK
View Code? Open in Web Editor NEWThis project forked from cbschaff/gym-duckietown
Self-driving car simulator for the Duckietown universe
Home Page: http://duckietown.org
License: Other
This project forked from cbschaff/gym-duckietown
Self-driving car simulator for the Duckietown universe
Home Page: http://duckietown.org
License: Other
the model's predictions were in tensor form. This corrupted the env once the mixing started using the model: the self.cur_pos became an np.array of 1d, 1-element tensor.
as-is, the tensorboard calls plotted the loss on each epoch, and also all the epoch losses on one graph. We'd instead like to have one single big curve for each run, showing how the loss evolves per episode. This will allow us to compare the different curves, and thus optimise the HPs better.
Simply plotting the losses doesn't work, though. It produces incomparable graphs: as time goes on, we collect more and more data samples, meaning the running loss of the last epoch of each episode it strictly bigger, simply because it acts on more observations and actions. This leads to the appearance that the loss is increasing over time. This is an illusion: it is the dataset that increases over time.
We can convince ourselves of this by taking the mean of the losses w.r.t. to the size of the dataset. With that trick, we find the familiar curves normally associated with loss curves.
But that's also kind of bad: the numbers are so small that we're bound to have floating point errors. Instead, I planned on using the number of batches per dataset instead of the size of the dataset in the mean. But that would also be bad, as it would lose meaning if we change the batch size. So we're going to use a magic number instead, just so it doesn't vary with the HPs.
The magic number can be editted.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.