R: interaction information computation

interinformation {infotheo} | R Documentation

## interaction information computation

### Description

`interinformation` takes a dataset as input and computes the the interaction information among the random variables in the dataset using the entropy estimator `method`. This measure is also called synergy or complementarity.

### Usage

    interinformation(X, method="emp")

### Arguments

`X` | data.frame denoting a random vector where columns contain variables/features and rows contain outcomes/samples.
`method` | The name of the entropy estimator. The package implements four estimators : "emp", "mm", "shrink", "sg" (default:"emp") - see details. These estimators require discrete data values - see `discretize`.

### Details

- "emp" : This estimator computes the entropy of the empirical probability distribution.

- "mm" : This is the Miller-Madow asymptotic bias corrected empirical estimator.

- "shrink" : This is a shrinkage estimate of the entropy of a Dirichlet probability distribution.

- "sg" : This is the Schurmann-Grassberger estimate of the entropy of a Dirichlet probability distribution.

### Value

`interinformation` returns the interaction information (also called synergy or complementarity), in nats, among the random variables (columns of the data.frame).

### Author(s)

Patrick E. Meyer

### References

Meyer, P. E. (2008). Information-Theoretic Variable Selection and Network Inference from Microarray Data. PhD thesis of the Universite Libre de Bruxelles.

Jakulin, A. and Bratko, I. (2004). Testing the significance of attribute interactions. In Proc. of 21st International Conference on Machine Learning (ICML).

McGill, W. J. (1954). Multivariate information transmission. Psychometrika, 19.

### See Also

`condinformation`, `multiinformation`, `mutinformation`, `natstobits`

### Examples

      data(USArrests)
      dat<-discretize(USArrests)
      ii <- interinformation(dat, method = "sg")

[Package infotheo version 1.2.0 Index]