About Exploring various Markov models for Self-Adaptive Systems Discrete Markov Chains Continuous Time Markov Chains Hidden Markov Models Semi-Markov Models Content Lecture slides and project specifications