Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task

Abstract

The purpose of the popular Iowa gambling task is to study decision making deficits in clinical populations by mimicking real-life decision making in an experimental context. Busemeyer and Stout [Busemeyer, J. R., & Stout, J. C. (2002). A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. Psychological Assessment, 14, 253-262] proposed an "Expectancy Valence" reinforcement learning model that estimates three latent components which are assumed to jointly determine choice behavior in the Iowa gambling task: weighing of wins versus losses, memory for past payoffs, and response consistency. In this article we explore the statistical properties of the Expectancy Valence model. We first demonstrate the difficulty of applying the model on the level of a single participant, we then propose and implement a Bayesian hierarchical estimation procedure to coherently combine information from different participants, and we finally apply the Bayesian estimation procedure to data from an experiment designed to provide a test of specific influence.

Citation

Wetzels, R., Vandekerckhove, J., Tuerlinckx, F., & Wagenmakers, E. (2010). Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task. Journal of Mathematical Psychology, 54, 14–27.

Bibtex

@article{wetzels_etal:2010:estimation,
    title   = {{B}ayesian parameter estimation in the {E}xpectancy {V}alence model of the {I}owa gambling task},
    author  = {Wetzels, Ruud and Vandekerckhove, Joachim and Tuerlinckx, Francis and Wagenmakers, Eric-Jan},
    year    = {2010},
    journal = {Journal of Mathematical Psychology},
    volume  = {54},
    pages   = {14--27}
}