R: The entropy Package

entropy-package {entropy} | R Documentation

## The entropy Package

### Description

This package implements various estimators of the Shannon entropy. Most estimators in this package can be applied in “small n, large p” situations, i.e. when there are many more bins than counts.

The main function of this package is `entropy`, which provides a unified interface to various entropy estimators. Other functions included in this package are estimators of Kullback-Leibler divergence (`KL.plugin`) and of mutual information (`mi.plugin`).

If you use this package please cite: Jean Hausser and Korbinian Strimmer. 2009. Entropy inference and the James-Stein estimator, with application to nonlinear gene association networks. J. Mach. Learn. Res. 10: 1469-1484. Available online from http://jmlr.csail.mit.edu/papers/v10/hausser09a.html.

This paper contains a detailed statistical comparison of the estimators available in this package. It also describes the shrinkage entropy estimator `entropy.shrink`.

### Author(s)

Jean Hausser and Korbinian Strimmer (http://strimmerlab.org/)

### References

See website: http://strimmerlab.org/software/entropy/

### See Also

`entropy`

[Package entropy version 1.2.1 Index]