Permalink
Branch: master
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
37 lines (22 sloc) 1.09 KB

Information Measures

dit supports many information measures, ranging from as standard as the Shannon entropy to as exotic as Gács-Körner common information (with even more esoteric measure coming soon!). We organize these quantities into the following groups.

We first have the Shannon-like measures. These quantities are based on sums and differences of entropies, conditional entropies, or mutual informations of random variables:

.. toctree::
   :maxdepth: 2

   shannon
   multivariate/multivariate

This next group of measures can not be represented on information diagrams, and can not really be directly compared to the measures above:

.. toctree::
   :maxdepth: 2

   other/other

There are also measures of "distance" or divergence between two (and im some cases, more) distribution:

.. toctree::
   :maxdepth: 2

   divergences/divergences

Several measures of shared information are related to the ability of two (or more) agents to agree upon a secret key in the face of an eavesdropper:

.. toctree::
   :maxdepth: 2

   secret_keys