This is a tutorial on KL-divergence and Cross Entropy. The full tutorial is available on medium article.
- Python >= 3.7
- Numpy
The full tutorial is available on medium.
https://azad-wolf.medium.com/why-is-cross-entropy-equal-to-kl-divergence-d4d2ec413864