Entropy Calculator

Calculates entropy for data (probability of events) in an array.
763 download
Aggiornato 14 mar 2012

Visualizza la licenza

In information theory, entropy is a measure of the uncertainty associated
with a random variable. In this context, the term usually refers to the
Shannon entropy, which quantifies the expected value of the information
% contained in a message, usually in units such as bits. In this context, a
'message' means a specific realization of the random variable.
Shannon denoted the entropy H of a discrete random variable X with possible
values {x1, ..., xn} as,

H(X) = E(I(X)).

E is the expected value,
I is the information content of X

Example usage
-------------
in = [.25 .25 .25 .25];
b = 'bit';
Entropy = info_entropy (in, b)

Cita come

Vallabha Hampiholi (2024). Entropy Calculator (https://www.mathworks.com/matlabcentral/fileexchange/35611-entropy-calculator), MATLAB Central File Exchange. Recuperato .

Compatibilità della release di MATLAB
Creato con R2008a
Compatibile con qualsiasi release
Compatibilità della piattaforma
Windows macOS Linux
Categorie
Scopri di più su Error Detection and Correction in Help Center e MATLAB Answers

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Versione Pubblicato Note della release
1.1.0.0

It now handles 0 as entry in the probability array.

1.0.0.0