the transition matrix can be written down, without calculation, from the information in the question. exactly where are you stuck?

Apr 3rd 2012, 10:35 AM

legendoulis

Re: help in markov chain

in the Markov chain transition matrix can you help i cant make it .

Apr 4th 2012, 10:02 AM

SpringFan25

Re: help in markov chain

suppose the states are (in order): rain, sun, cloud, snow.

The first row of the transition matrix gives the probability of transitioning from RAIN to each of the other states, which is given in the question as (0.6,0.4,0,0)
The first row of the transition matrix gives the probability of transitioning from SUN to each of the other states, which is given in the question as (0,0.6,0.4,0)

can you finish?

Apr 4th 2012, 11:11 AM

legendoulis

Re: help in markov chain

i see yeah i can finish it now one more thing it says also in the exercise that we have to make the situation diagram it's a diagram that takes us from one situation to another . can u help with that?

And something else :

We have to simulate the Markov chain that we created i will explain:

You can start the chain from whichever situation you want.
1. In every step of the simulation we must create a random number .
2. So when we finish we use the transition matrix to go to the next situation
and so on
The simulation must have time equal to 1080 steps of the previous (1. and 2.)