Mobile toolbox (MTB) remote measures of executive function and processing speed: development and validation

• Published in: Journal of the International Neuropsychological Society Vol. 30; no. 7; p. 680
• Main Authors: Novack, Miriam A, Young, Stephanie Ruth, Dworak, Elizabeth M, Kaat, Aaron J, Slotkin, Jerry, Nowinski, Cindy, Yao, Lihua, Adam, Hubert, Stoeger, Jordan, Hosseinian, Zahra, Amagai, Saki, Pila, Sarah, Varela Diaz, Maria, Almonte Correa, Anyelo, Alperin, Keith, Carlson, Sonia, Kellen, Michael, Omberg, Larsson, Camacho, Monica R, Landavazo, Bernard, Nosheny, Rachel L, Weiner, Michael W, Gershon, Richard C
• Format: Journal Article
• Language: English
• Published: England 01-08-2024
• Subjects: Adolescent; Adult; Aged; Aged, 80 and over; Executive Function - physiology; Female; Humans; Male; Middle Aged; Mobile Applications - standards; Neuropsychological Tests - standards; Processing Speed; Psychometrics - standards; Reproducibility of Results; Smartphone; Young Adult; NIH Toolbox; Cognition; validation; executive function; mobile assessment; processing speed
• ISSN: 1469-7661
• DOI: 10.1017/S1355617724000225

The ability to remotely monitor cognitive skills is increasing with the ubiquity of smartphones. The Mobile Toolbox (MTB) is a new measurement system that includes measures assessing Executive Functioning (EF) and Processing Speed (PS): Arrow Matching, Shape-Color Sorting, and Number-Symbol Match. The purpose of this study was to assess their psychometric properties.
MTB measures were developed for smartphone administration based on constructs measured in the NIH Toolbox® (NIHTB). Psychometric properties of the resulting measures were evaluated in three studies with participants ages 18 to 90. In Study 1 (
= 92), participants completed MTB measures in the lab and were administered both equivalent NIH TB measures and other external measures of similar cognitive constructs. In Study 2 (
= 1,021), participants completed the equivalent NIHTB measures in the lab and then took the MTB measures on their own, remotely. In Study 3 (
= 168), participants completed MTB measures twice remotely, two weeks apart.
All three measures exhibited very high internal consistency and strong test-retest reliability, as well as moderately high correlations with comparable NIHTB tests and moderate correlations with external measures of similar constructs. Phone operating system (iOS vs. Android) had a significant impact on performance for Arrow Matching and Shape-Color Sorting, but no impact on either validity or reliability.
Results support the reliability and convergent validity of MTB EF and PS measures for use across the adult lifespan in remote, self-administered designs.