This repository contains the code for these blog posts
- Understanding entropy,
- Information entropy, and
- Mutual information and its relationship to information entropy.
For further details, please refer to these posts.
For reproducibility:
conda create -n entropy -y python=3.9
conda activate entropy
conda install -y mamba
mamba install -y ipykernel numpy matplotlib scipy scikit-learn