mars-wei / knowledge-distillation

Insight and Implementation of "Distilling the Knowledge in a Neural Network" (Hinton, et al. 2015)

Knowledge-Distillation

This respository is for the final project of Harvard AM207 "Stochastic Methods for Data Analysis, Inference and Optimization". The single juypter notebook file contains my insights and implementations (tensorflow) of the paper "Distilling the Knowledge in a Neural Network".