• Home
  • Search
  • JOINT MODELING FOR LEARNING DECISION-MAKING DYNAMICS IN BEHAVIORAL EXPERIMENTS.
  • https://doi.org/10.1214/25-aoas2112Copy DOI Icon

JOINT MODELING FOR LEARNING DECISION-MAKING DYNAMICS IN BEHAVIORAL EXPERIMENTS.

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Major depressive disorder (MDD), a leading cause of disability and mortality, is associated with reward-processing abnormalities and concentration issues. Motivated by the probabilistic reward task from the Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care (EMBARC) study, we propose a novel framework that integrates the reinforcement learning (RL) model and drift-diffusion model (DDM) to jointly analyze reward-based decision-making with response times. To account for emerging evidence suggesting that decision-making may alternate between multiple interleaved strategies, we model latent state switching using a hidden Markov model (HMM). In the engaged state, decisions follow an RL-DDM, simultaneously capturing reward processing, decision dynamics, and temporal structure. In contrast, in the lapsed state, decision-making is modeled using a simplified DDM, where specific parameters are fixed to approximate random guessing with equal probability. The proposed method is implemented using a computationally efficient generalized expectation-maximization (EM) algorithm with forward-backward procedures. Through extensive numerical studies, we demonstrate that our proposed method outperforms competing approaches across various reward-generating distributions, under both strategy-switching and non-switching scenarios, as well as in the presence of input perturbations. When applied to the EMBARC study, our framework reveals that MDD patients exhibit lower overall engagement than healthy controls and experience longer responses when they do engage. Additionally, we show that neuroimaging measures of brain activities are associated with decision-making characteristics in the engaged state but not in the lapsed state, providing evidence of brain-behavior association specific to the engaged state.

Similar Papers
  • Research Article
  • Citations38

Anxiety and anhedonia in depression: Associations with neuroticism and cognitive control

  • Nov 14, 2018
  • Journal of Affective Disorders
  • Allen Liao +18
  • Research Article
  • Citations48

Association between irritability and suicidal ideation in three clinical trials of adults with major depressive disorder.

  • Jul 14, 2020
  • Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology
  • Manish K Jha +6
  • Research Article
  • Citations2

A brain-enriched circRNA blood biomarker can predict response to SSRI antidepressants.

  • Feb 17, 2026
  • Molecular psychiatry
  • Grigorios Papageorgiou +15
  • Research Article
  • Citations303

Establishing moderators and biosignatures of antidepressant response in clinical care (EMBARC): Rationale and design

  • Mar 15, 2016
  • Journal of Psychiatric Research
  • Madhukar H Trivedi +21
  • PDF
  • Research Article
  • Citations36

Reward Learning, Neurocognition, Social Cognition, and Symptomatology in Psychosis

  • Jun 14, 2016
  • Frontiers in Psychiatry
  • Kathryn E Lewandowski +5
  • Research Article
  • Citations26

Statistical Analysis Plan for Stage 1 EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care) Study

  • Feb 24, 2017
  • Contemporary clinical trials communications
  • Eva Petkova +15
  • Research Article
  • Citations4

Reward Processing in Mood Disorders and Schizophrenia: A Neurodevelopmental Framework.

  • May 07, 2025
  • Annual review of clinical psychology
  • Robin Nusslock +2
  • Research Article
  • Citations7

Lifetime history of major depressive disorder is associated with decreased reward learning: Evidence from a novel online version of the probabilistic reward task

  • Jan 24, 2024
  • Journal of Affective Disorders
  • Shiba M Esfand +4
  • Research Article
  • Citations31

Reward Responsiveness Varies by Smoking Status in Women with a History of Major Depressive Disorder.

  • Feb 09, 2015
  • Neuropsychopharmacology
  • Amy C Janes +9
  • Research Article
  • Citations42

Sex differences in the association of baseline c-reactive protein (CRP) and acute-phase treatment outcomes in major depressive disorder: Findings from the EMBARC study

  • Mar 20, 2019
  • Journal of Psychiatric Research
  • Manish K Jha +5
  • Dissertation

Fronto-striatal brain circuits involved in the pathophysiology of schizophrenia and affective disorders: FMRI studies of the effects of urbanicity and fearful faces on neural mechanisms of reward processing and self-control

  • Jan 01, 2017
  • Bernd Krämer
  • Research Article
  • Citations6

Stressful Life Events and Reward Processing in Adults: Moderation by Depression and Anhedonia.

  • Feb 03, 2024
  • Depression and anxiety
  • Sung Min +7
  • Research Article
  • Citations79

Effects of the KCNQ channel opener ezogabine on functional connectivity of the ventral striatum and clinical symptoms in patients with major depressive disorder.

  • Nov 01, 2018
  • Molecular Psychiatry
  • Aaron Tan +15
  • Research Article
  • Citations62

Attenuation of Frontostriatal Connectivity During Reward Processing Predicts Response to Psychotherapy in Major Depressive Disorder.

  • Sep 02, 2016
  • Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology
  • Erin Walsh +10
  • Book Chapter
  • Citations4

Specifying the Connection Between Reward Processing and Antisocial Psychopathology Across Development

  • Oct 04, 2019
  • Suzanne Estrada +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.