isaiahnields / machine-learning-from-scratch

A collection of machine learning models made from scratch

Machine Learning From Scratch

A collection of machine learning models implemented from scratch

Motivation

The models implemented here are for my own learning purposes and that of others.

Blog Posts

1. Linear Regression from Scratch - published in Towards Data Science
2. Neural Networks: why do they work so well? Part I - published in Towards Data Science

Demos

Neural Network Graph

A graph of a 7 layer neural netwok.

Two Spiral Neural Network

A 4 layer neural network trained to separate two spirals.

Three Spiral Neural Network

A 5 layer neural network trained to separate three spirals.

Linear Regression

A linear regression model fitting a line.

Logistic Classification

A logistic classifier separates two clusters.

Unit Norms

A visualization of all vectors with unit p-norm.

Inspiration

The implementation of these models is inspired by Deep Learning, an outstanding textbook from Bengio and Goodfellow.