• Home
  • Search
  • A Psychological Strategy Annotation Method Using Multiple LLMs with a Chain of Thought Based on Deductive Reasoning
  • https://doi.org/10.1109/apsipaasc65261.2025.11249074Copy DOI Icon

A Psychological Strategy Annotation Method Using Multiple LLMs with a Chain of Thought Based on Deductive Reasoning

  • Oct 22, 2025
  • Jinran Wang +7 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Using appropriate psychological counseling strategies is critical for improving the quality of large language modeldriven mental health dialogues, yet a single large language model (LLM) often produces unreliable results due to ambiguous strategy definitions and degradation of thought in reasoning. Multi-LLM voting-based strategy annotation methods are often hampered in their overall decision-making performance due to the low accuracy of some individual models. To address this, we propose a multi-LLM system with a deductive-reasoning chain of thought. We built a dataset that comprises psychologist-client dialogue segments, each annotated with nine strategies by four professional psychologists. The system uses three LLMs as experts to generate initial strategy candidates, and then an LLM as a judge applies deductive reasoning-aligning dialogue evidence with strategy definitions-to annotate the optimal strategy. Experiments show that this approach outperforms single models, voting, and conventional chain-of-thought methods in F1 score and accuracy. This work advances LLM-based psychological strategy annotation, offering a reliable tool for mental health dialogue systems.

Similar Papers
  • PDF
  • Supplementary Content
  • Citations20

Behavioral Interventions on Periodontitis Patients to Improve Oral Hygiene: A Systematic Review

  • Mar 15, 2023
  • Journal of Clinical Medicine
  • Maria Vilar Doceda +2
  • Research Article
  • Citations7

Procedural pain reduction strategies in paediatric nuclear medicine.

  • Jul 17, 2019
  • Pediatric radiology
  • Mandy L Kohli +6
  • Research Article
  • Citations2

Reductionism in the Comments and Autobiographical Accounts of Prominent Psychologists

  • Jan 01, 2002
  • The Journal of Psychology
  • Jack Martin +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.