View Code? Open in Web Editor NEW

Machine Learning Algorithms

Jupyter Notebook 22.96% Python 73.94% HTML 0.03% PowerShell 0.01% Shell 0.01% CSS 0.42% Cython 1.53% C 0.46% C++ 0.16% Batchfile 0.01% TeX 0.18% JavaScript 0.22% Lua 0.01% Makefile 0.01% Meson 0.01% Fortran 0.02% Forth 0.01% Smarty 0.01% Jinja 0.06% Dockerfile 0.01%

daily-ml's Introduction

My general machine learning best practices

Jason Brownlee on Variance

Modelling Non-Linear Features-Target Relationship

Linear regression with non-linear link between data and target
The deployment of scikit-learn in linear models in this case, Linear Regression
Machine learning modelling alogorithms: - Linear Regression - Decision Tree Regressor
Dealing with non-linearity; i) choose a model that can natively deal with non-linearity, ii) engineer a richer set of features by including expert knowledge which can be directly used by a simple linear model, or iii) use a "kernel" to have a locally-based decision function instead of a global linear decision function.

CC: inria Machine learning in Python with scikit-learn (https://www.inria.fr/en/mooc-scikit-learn)

Orinary Least Squares (OLS) algorithm

This case we take a closer look at the OLS model from the statsmodels library

Titanic

Of course it can't be complete without the "hello world" of machine learning. Here we look at Random Classifiers and Logistic Regression

Linear Regression

linear regression was developed in the field of statistics and is studied as a model for understanding the relationship between input and output numerical variables, but has been borrowed by machine learning. It is both a statistical algorithm and a machine learning algorithm.
Linear regression is a linear model, e.g. a model that assumes a linear relationship between the input variables (x) and the single output variable (y). More specifically, that y can be calculated from a linear combination of the input variables (x).
When there is a single input variable (x), the method is referred to as simple linear regression. When there are multiple input variables, literature from statistics often refers to the method as multiple linear regression.
Different techniques can be used to prepare or train the linear regression equation from data, the most common of which is called Ordinary Least Squares. It is common to therefore refer to a model prepared this way as Ordinary Least Squares Linear Regression or just Least Squares Regression.