Exercise 7.11 Consider the three-state Markov process below; the number given on edge (i,j) is epi, the transition rate from i to j. Assume that the process is in steady state.
1
(a) Is this process reversible? (b) Find pi, the time-average fraction of time spent in state i for each i. (c) Given that the process is in state i at time t, find the mean delay from t until the process leaves state i. (d) Find ir i, the time-average fraction of all transitions that go into state i for each i. (e) Suppose the process is in steady state at time t. Find the steady-state probability that the next state to be entered is state 1. (I) Given that the process is in state 1 at time t, find the mean delay until the process first returns to state 1. (g) Consider an arbitrary irreducible finite-state Markov process in which qii = qji for all i,j. Either show that such a process is reversible or find a counter example.
Needs help with similar assignment?
We are available 24x7 to deliver the best services and assignment ready within 3-4 hours? Order a custom-written, plagiarism-free paper
Order Over WhatsApp
Place an Order Online