Markov Modelling for Pharmaceuticals

How do you create a Markov Model for the effectiveness of pharmaceuticals?   Below is an example from Briggs, Claxton and Sculpher’s book titled “Decision Modelling for Health Economic Evaluation.” Example The main characteristic of a Markov Model is that it defines different states and then defines transition probabilties between each state.  Let us examine the case…