The accuracy of a model was determined by the similarity between the model's predicted action and the actual action of the subject in each round on average.
the idea of selecting actions that maximize the total expected reward transforms the model from one based on HMMs (previous section) to a Partially Observable Markov Decision Process (POMDP) [19].