R: Expected Rewards for a markovchain

expectedRewards {markovchain} | R Documentation

## Expected Rewards for a markovchain

### Description

Given a markovchain object and reward values for every state, function calculates expected reward value after n steps.

### Usage

    expectedRewards(markovchain,n,rewards)

### Arguments

`markovchain` | the markovchain-class object
`n` | no of steps of the process
`rewards` | vector depicting rewards coressponding to states

### Details

the function uses a dynamic programming approach to solve a recursive equation described in reference.

### Value

returns a vector of expected rewards for different initial states

### Author(s)

Vandit Jain

### References

Stochastic Processes: Theory for Applications, Robert G. Gallager, Cambridge University Press

### Examples

    transMatr<-matrix(c(0.99,0.01,0.01,0.99),nrow=2,byrow=TRUE)
    simpleMc<-new("markovchain", states=c("a","b"),
                 transitionMatrix=transMatr)
    expectedRewards(simpleMc,1,c(0,1))

[Package markovchain version 0.8.6 Index]