You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: lectures/finite_markov.md
-3Lines changed: 0 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -376,7 +376,6 @@ all ways this can happen and sum their probabilities.
376
376
377
377
Rewriting this statement in terms of marginal and conditional probabilities gives
378
378
379
-
(mc_fdd)=
380
379
$$
381
380
\psi_{t+1}(y) = \sum_{x \in S} P(x,y) \psi_t(x)
382
381
$$
@@ -385,7 +384,6 @@ There are $n$ such equations, one for each $y \in S$.
385
384
386
385
If we think of $\psi_{t+1}$ and $\psi_t$ as *row vectors* (as is traditional in this literature), these $n$ equations are summarized by the matrix expression
387
386
388
-
(mc_fddv)=
389
387
```{math}
390
388
:label: fin_mc_fr
391
389
@@ -398,7 +396,6 @@ By repeating this $m$ times we move forward $m$ steps into the future.
398
396
399
397
Hence, iterating on {eq}`fin_mc_fr`, the expression $\psi_{t+m} = \psi_t P^m$ is also valid --- here $P^m$ is the $m$-th power of $P$.
400
398
401
-
(mc_exfmar)=
402
399
As a special case, we see that if $\psi_0$ is the initial distribution from
403
400
which $X_0$ is drawn, then $\psi_0 P^m$ is the distribution of
0 commit comments