Actionable health app evaluation: translating expert frameworks into objective metrics

• Published in: NPJ digital medicine Vol. 3; no. 1; p. 100
• Main Authors: Lagan, Sarah, Aquino, Patrick, Emerson, Margaret R., Fortuna, Karen, Walker, Robert, Torous, John
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 30-07-2020; Nature Publishing Group; Nature Portfolio
• Subjects: 692/308/575; 692/700/565/2194; Biomedicine; Biotechnology; Digital technology; Health informatics; Medicine; Medicine & Public Health; Perspective; Smartphones; Software; Telemedicine; Translational research; Adverse effects
• ISSN: 2398-6352; 2398-6352
• DOI: 10.1038/s41746-020-00312-4

As use and availability of mobile health apps have increased, so too has the need for a thorough, accessible framework for app evaluation. The American Psychiatric Association’s app evaluation model has emerged as a way to critically assess an app by considering accessibility, privacy and security, clinical foundation, engagement, and interoperability; however, there is no centralized database where users can view how various health apps perform when assessed via the APA model. In this perspective, we propose and outline our effort to translate the APA’s model for the evaluation of health apps into a set of objective metrics that can be published online, making the framework actionable and accessible to a broad audience. The questions from the APA model were operationalized into 105 objective questions that are either binary or numeric. These questions serve as the foundation of an online database, where app evaluation consists of answering these 105 questions and can be crowdsourced. While the database has yet to be published and crowdsourced, initial internal testing demonstrated excellent interrater reliability. The database proposed here introduces a public and interactive approach to data collection that is guided by the APA model. The published product enables users to sort through the many mobile health apps and filter them according to individual preferences and priorities, making the ever-growing health app market more navigable.