Using learning analytics to evaluate a video-based lecture series

• Published in: Medical teacher Vol. 40; no. 1; pp. 91 - 98
• Main Authors: Lau, K. H. Vincent, Farooque, Pue, Leydon, Gary, Schwartz, Michael L., Sadler, R. Mark, Moeller, Jeremy J.
• Format: Journal Article
• Language: English
• Published: England Taylor & Francis 01-01-2018; Taylor & Francis Ltd
• Subjects: Audiences; Classrooms; Electroencephalography; Learning Analytics; Medical education; MOOCs; Self report; Video Technology; Viewers
• ISSN: 0142-159X; 1466-187X
• DOI: 10.1080/0142159X.2017.1395001

Background: The video-based lecture (VBL), an important component of the flipped classroom (FC) and massive open online course (MOOC) approaches to medical education, has primarily been evaluated through direct learner feedback. Evaluation may be enhanced through learner analytics (LA) - analysis of quantitative audience usage data generated by video-sharing platforms.
Methods and results: We applied LA to an experimental series of ten VBLs on electroencephalography (EEG) interpretation, uploaded to YouTube in the model of a publicly accessible MOOC. Trends in view count; total percentage of video viewed and audience retention (AR) (percentage of viewers watching at a time point compared to the initial total) were examined. The pattern of average AR decline was characterized using regression analysis, revealing a uniform linear decline in viewership for each video, with no evidence of an optimal VBL length. Segments with transient increases in AR corresponded to those focused on core concepts, indicative of content requiring more detailed evaluation. We propose a model for applying LA at four levels: global, series, video, and feedback.
Discussion and conclusions: LA may be a useful tool in evaluating a VBL series. Our proposed model combines analytics data and learner self-report for comprehensive evaluation.