Towards text mining therapeutic change: A systematic review of text-based methods for Therapeutic Change Process Research

• Published in: PloS one Vol. 14; no. 12; p. e0225703
• Main Authors: Smink, Wouter, Sools, Anneke M, van der Zwaan, Janneke M, Wiegersma, Sytske, Veldkamp, Bernard P, Westerhof, Gerben J
• Format: Journal Article
• Language: English
• Published: United States Public Library of Science 05-12-2019; Public Library of Science (PLoS)
• Subjects: Automatic text analysis; Automation; Biology and Life Sciences; Coding; Computer and Information Sciences; Data analysis; Data mining; Data Mining - methods; Engineering and Technology; Evaluation; Handbooks; Humans; Identification methods; Language; Linguistics; Medicine and Health Sciences; Mental disorders; Mental health; Methods; Natural language; Psychology; Psychotherapy; Qualitative analysis; Records; Reliability analysis; Research and Analysis Methods; Research methodology; Social Sciences; Systematic review; Therapeutics; Toronto Ontario Canada; Canada; Netherlands
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0225703

Therapeutic Change Process Research (TCPR) connects within-therapeutic change processes to outcomes. The labour intensity of qualitative methods limit their use to small scale studies. Automated text-analyses (e.g. text mining) provide means for analysing large scale text patterns. We aimed to provide an overview of the frequently used qualitative text-based TCPR methods and assess the extent to which these methods are reliable and valid, and have potential for automation. We systematically reviewed PsycINFO, Scopus, and Web of Science to identify articles concerning change processes and text or language. We evaluated the reliability and validity based on replicability, the availability of code books, training data and inter-rater reliability, and evaluated the potential for automation based on the example- and rule-based approach. From 318 articles we identified four often used methods: Innovative Moments Coding Scheme, the Narrative Process Coding Scheme, Assimilation of Problematic Experiences Scale, and Conversation Analysis. The reliability and validity of the first three is sufficient to hold promise for automation. While some text features (content, grammar) lend themselves for automation through a rule-based approach, it should be possible to automate higher order constructs (e.g. schemas) when sufficient annotated data for an example-based approach are available.