Simulation-Based Medical Education: Development of an Assessment Tool for Novice Use

• Published in: Wisconsin medical journal (Madison, Wis.) Vol. 121; no. 4; pp. 316 - 322
• Main Authors: Ulrich, Sasha M, L'Huillier, Joseph C, Jung, Sarah A, Krecko, Laura K, Rosser, Alexandra A, Schulze, Amy K, Liepert, Amy E, O'Rourke, Ann P
• Format: Journal Article
• Language: English
• Published: United States 01-12-2022
• Subjects: Clinical Competence; Education, Medical; Humans; Students, Medical
• ISSN: 2379-3961

Simulation-based medical education, an educational model in which students engage in simulated patient scenarios, improves performance. However, assessment tools including the Oxford Non-Technical Skills (NOTECHS) scale require expert assessors. We modified this tool for novice use.
Medical students participated in 5 nontechnical simulations. The NOTECHS scale was modified to allow for novice evaluation. Three novices and 2 experts assessed performance, with intraclass correlation used to assess validity.
Twenty-two learners participated in the simulations. Novice reviewers had moderate to excellent correlation among evaluations (0.66 < intraclass correlation coefficients [ICC] < 0.95). Novice and expert reviewers had moderate to good correlation among evaluations (0.51 < ICC < 0.88).
The modified NOTECHS scales can be utilized by novices to evaluate simulation performance. Novice assessment correlates with expert review. These tools may encourage the use of simulation-based medical education.