Integrating AI language models in qualitative research: Replicating interview data analysis with ChatGPT

• Published in: System dynamics review Vol. 40; no. 3
• Main Authors: Jalali, Mohammad S., Akhavan, Ali
• Format: Journal Article
• Language: English
• Published: Chichester, UK John Wiley & Sons, Ltd 01-07-2024; Wiley Periodicals Inc
• Subjects: Artificial intelligence; Chatbots; Data analysis; Data processing; Qualitative analysis; System dynamics
• ISSN: 0883-7066; 1099-1727
• DOI: 10.1002/sdr.1772

The recent advent of artificial intelligence (AI) language tools like ChatGPT has opened up new opportunities in qualitative research. We revisited a previous project on obesity prevention interventions, where we developed a causal loop diagram through in‐depth interview data analysis. Utilizing ChatGPT in our replication process, we compared its results against our original approach. We discuss that ChatGPT contributes to improved efficiency and unbiased data processing; however, it also reveals limitations in context understanding. Our findings suggest that AI language tools currently have great potential to serve as an augmentative tool rather than a replacement for the intricate analytical tasks performed by humans. With ongoing advancements, AI technologies may soon offer more substantial support in enhancing qualitative research capabilities, an area that deserves more investigation. © 2024 The Authors. System Dynamics Review published by John Wiley & Sons Ltd on behalf of System Dynamics Society.