1. Math
  2. Statistics And Probability
  3. a markov chain xnn 2 0 with state space s...

Question: a markov chain xnn 2 0 with state space s...

Question details

A Markov chain {Xn,n 2 0) with state space S 10, 1, 2,3, 4,5) has transition proba- bility matrix 0 1/32/3-ββ/2 01-α 0 β/2 0 0 0 0 0 0 β/2 β/21/2 0 1. Y (a) Determine the equivalence classes of communicating states for any possible choice of the three parameters α, β and γ; (b) In all cases, determine if the states in each class are recurrent or transient and find their period (or determine that they are aperiodic)

Solution by an expert tutor
Blurred Solution
This question has been solved
Subscribe to see this solution