Learn with Amar
Teaching video
A teaching recording for this chapter has not been published yet. Start with the worked example below and explore the related animations where available.
Undergraduate chapters and video availability01 · Read and understand
What you will learn
- Solve and check a stationary distribution of a two-state Markov chain.
- Justify the conclusion "πP=π=(0.6,0.4)" using the stated assumptions.
Before you start
Transition matrices and probability vectors.
Keep paper nearby. Read the question once for the context, then again to identify what is known and what you need to find.
Start with a question
For row-stochastic P=[[0.8,0.2],[0.3,0.7]], find stationary π.
Why this math matters
Solve and check a stationary distribution of a two-state Markov chain. This worked micro-lesson connects a precise mathematical condition to a conclusion you can check. The transfer task asks you to change the setting and decide which parts of the reasoning still apply.
Set up the model
A useful answer starts with clear assumptions:
- P uses rows for starting states.
- The same transition law applies each step.
02 · Work through the example
Follow the reasoning, one step at a time.
Try to predict the next step before reading it. After each calculation, explain why the operation makes sense and how it helps answer the original question.
Work through it with Amar
See this example unfold.
The complete worked example, one idea at a time.
Verify stationarity through balanced transitions
PausedQuestion: Start with the question. Paused.
Question
Start with the question
For row-stochastic P=[[0.8,0.2],[0.3,0.7]], find stationary π.
Before you calculate
Read what is known and what you need to find. Make a prediction before moving to the first calculation.
Starts paused. Play advances through the full text at a reading pace; pause whenever you need more time. Previous, Next, and the phase buttons let you set your own pace. Playback pauses when this walkthrough leaves the screen or you switch tabs.
Your device’s reduced-motion setting keeps each phase still. Manual controls remain available. The full written solution stays below.
Build the model
π₁+π₂=1 and 0.2π₁=0.3π₂
In two states, stationary cross-flow must balance.
Work through the mathematics
π₁=0.6, π₂=0.4
Solving the balance and normalization equations gives a probability vector.
Check the conclusion
πP=π=(0.6,0.4)
Direct multiplication verifies stationarity; positive entries also make this finite chain irreducible and aperiodic.
The result
πP=π=(0.6,0.4)
Direct multiplication verifies stationarity; positive entries also make this finite chain irreducible and aperiodic.
Common mistakes to catch
- Do not switch row and column conventions mid-calculation.
- Stationary distribution and the current state are different objects.
03 · Practice independently
Try it before revealing the answer.
Use paper or a calculator as needed. Write your units and reasoning, then open the hint or explanation to check your approach.
Practice 1
Starting at state one, what is the probability of state two after one step?
Show a hint
Read row one.
Reveal answer and explanation
0.2
Row-stochastic matrices store outgoing probabilities by starting state.
Practice 2
Does stationarity mean the chain stops moving?
Show a hint
Compare state distribution with individual transitions.
Reveal answer and explanation
No
Probability mass flows between states while the overall distribution stays unchanged.
Take the idea with you
Interpret a stable population proportion even when individual units continue switching states.
04 · Reflect and continue
Can you explain it in your own words?
Before moving on, explain the main idea without looking at the worked example. Try both practice questions, check your reasoning, and name one mistake you now know how to avoid. Return to a step if you still need support.
Up next: Turn a limit claim into an explicit error guarantee
Completion is your own study record, not a test score. It stays in this browser, does not sync to another device, and can be removed by clearing browser data.