Problem 4: Maze A mouse travels in a maze (shown in figure). At each discrete time-step, the mouse chooses one of the doors from the room it is curently in (uniformly at random), and moves to the cho...

Problem 4: Maze A mouse travels in a maze (shown in figure). At each discrete time-step, the mouse chooses one of the doors from the room it is curently in (uniformly at random), and moves to the chosen neighboring room. Room three has a block of cheese in it (reward for the mouse (a) Model the location of mouse as a DTMC. Ist irreducible and aperiodic? Justify your answers b) Write the one-step probability transition matrix (c) Find the steady state distribution π for this DTMC. 3 4 cheese 5 Figure 1: The maze. (The steady state distribution is defined as a row vector π of probabilities such that π πΡ and Σηι π(i) 1 where P is the one-step transition matrix and n is the nurnber of states.)