A tutorial on interactive Markov chains

TitleA tutorial on interactive Markov chains
Publication TypeConference Paper
Year of Publication2014
AuthorsArnold F., Gebler D., Guck D., Hatefi H.
EditorRemke A.KI, Stoelinga M.IA
Conference NameStochastic Model Checking. Rigorous Dependability Analysis Using Model Checking Techniques for Stochastic Systems, Vahrn, Italy
PublisherSpringer Verlag
Conference LocationBerlin
Keywordsabstraction, Interactive Markov chains, logic, model checking, stochastic

Interactive Markov chains (IMCs) constitute a powerful sto- chastic model that extends both continuous-time Markov chains and labelled transition systems. IMCs enable a wide range of modelling and analysis techniques and serve as a semantic model for many industrial and scientific formalisms, such as AADL, GSPNs and many more. Applications cover various engineering contexts ranging from industrial system-on-chip manufacturing to satellite designs. We present a survey of the state-of-the-art in modelling and analysis of IMCs. We cover a set of techniques that can be utilised for compositional modelling, state space generation and reduction, and model checking. The significance of the presented material and corresponding tools is highlighted through multiple case studies.