| entropy.plugin {entropy} | R Documentation |
entropy.plugin computes the Shannon entropy H
of a discrete random variable from the specified bin frequencies.
entropy.plugin(freqs, unit=c("log", "log2", "log10"))
freqs |
bin frequencies. |
unit |
the unit in which entropy is measured.
The default is "nats" (natural units). For
computing entropy in "bits" set |
The Shannon entropy of a discrete random variable is defined as H = -∑ p(x_i) \log( p(x_i) ), where p(x_i) are the bin probabilities.
entropy.plugin returns the Shannon entropy.
Korbinian Strimmer (http://strimmerlab.org).
entropy, entropy.empirical, entropy.shrink,
mi.plugin, KL.plugin, discretize.
# load entropy library
library("entropy")
# some frequencies
freqs = c(0.2, 0.1, 0.15, 0.05, 0, 0.3, 0.2)
# and corresponding entropy
entropy.plugin(freqs)