Language Features for Automated Evaluation of Cognitive Behavior Psychotherapy Sessions

Nikolaos Flemotomos, Victor Martinez, James Gibson, David Atkins, Torrey Creed and Shrikanth Narayanan

Abstract:

Cognitive Behavior Therapy (CBT) is a psychotherapy treatment that uses cognitive change strategies to address mental health problems. Quality assessment of a CBT session is traditionally addressed by human raters who evaluate recorded sessions along specific behavioral codes, a cost prohibitive and time consuming method. In this work we examine how linguistic features can be effectively used to develop an automatic competency rating tool for CBT. We explore both standard, widely-used lexical features and domain-specific ones, adapting methods which have been successfully used in similar psychotherapy session coding tasks. Experiments are conducted on manual transcripts of CBT sessions and on automatically derived ones, thus introducing an end-to-end approach. Our results suggest that a real-world system could be developed to automatically evaluate CBT sessions to assist training, supervision, or quality assurance of services.

---

Cite as: Flemotomos, N., Martinez, V., Gibson, J., Atkins, D., Creed, T., Narayanan, S. (2018) Language Features for Automated Evaluation of Cognitive Behavior Psychotherapy Sessions. Proc. Interspeech 2018, 1908-1912, DOI: 10.21437/Interspeech.2018-1518.

---

BiBTeX Entry:

@inproceedings{Flemotomos2018,
author={Nikolaos Flemotomos and Victor Martinez and James Gibson and David Atkins and Torrey Creed and Shrikanth Narayanan},
title={Language Features for Automated Evaluation of Cognitive Behavior Psychotherapy Sessions},
year=2018,
booktitle={Proc. Interspeech 2018},
pages={1908--1912},
doi={10.21437/Interspeech.2018-1518},
url={http://dx.doi.org/10.21437/Interspeech.2018-1518} }