Development and validation of the Skills Assessment in Microsurgery for Brain Aneurysms (SAMBA) instrument for predicting proficiency in aneurysm surgery

Development and validation of the Skills Assessment in Microsurgery for Brain Aneurysms (SAMBA) instrument for predicting proficiency in aneurysm surgery

Surgical performance evaluation was first described with the OSATS (Objective Structured Assessment of Technical Skills) and modified for aneurysm microsurgery simulation with the OSAACS (Objective Structured Assessment of Aneurysm Clipping Skills). These methods rely on the subjective opinions of e...

Full description

Saved in:
Bibliographic Details
Published in:Journal of neurosurgery Vol. 133; no. 1; pp. 190 - 196
Main Authors: Ribeiro de Oliveira, Marcelo Magaldi, Ramos, Taise Mosso, Ferrarez, Carlos Eduardo, Machado, Carla Jorge, Vieira Costa, Pollyana Helena, Alvarenga, Daniel L, Soares, Carolina K, Mainart, Luiza M, Aguilar-Salinas, Pedro, Gusmão, Sebastião, Sauvageau, Eric, Hanel, Ricardo A, Lanzino, Giuseppe
Format: Journal Article
Language:English
Published: United States 01-07-2020
Subjects:
neurosurgical simulation
neurosurgical education
sylvian fissure
aneurysm clipping
objective surgical assessment
middle cerebral artery aneurysm
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Surgical performance evaluation was first described with the OSATS (Objective Structured Assessment of Technical Skills) and modified for aneurysm microsurgery simulation with the OSAACS (Objective Structured Assessment of Aneurysm Clipping Skills). These methods rely on the subjective opinions of evaluators, however, and there is a lack of objective evaluation for proficiency in the microsurgical treatment of brain aneurysms. The authors present a new instrument, the Skill Assessment in Microsurgery for Brain Aneurysms (SAMBA) scale, which can be used similarly in a simulation model and in the treatment of unruptured middle cerebral artery (MCA) aneurysms to predict surgical performance; the authors also report on its validation. The SAMBA scale was created by consensus among 5 vascular neurosurgeons from 2 different neurosurgical departments. SAMBA results were analyzed using descriptive statistics, Cronbach's alpha indexes, and multivariate ANOVA analyses (p < 0.05). Expert, intermediate-level, and novice surgeons scored, respectively, an average of 33.9, 27.1, and 16.4 points in the real surgery and 33.3, 27.3, and 19.4 points in the simulation. The SAMBA interrater reliability index was 0.995 for the real surgery and 0.996 for the simulated surgery; the intrarater reliability was 0.983 (Cronbach's alpha). In both the simulation and the real surgery settings, the average scores achieved by members of each group (expert, intermediate level, and novice) were significantly different (p < 0.001). Scores among novice surgeons were more diverse (coefficient of variation = 12.4). Predictive validation of the placenta brain aneurysm model has been previously reported, but the SAMBA scale adds an objective scoring system to verify microsurgical ability in this complex operation, stratifying proficiency by points. The SAMBA scale can be used as an interface between learning and practicing, as it can be applied in a safe and controlled environment, such as is provided by a placenta model, with similar results obtained in real surgery, predicting real surgical performance.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0022-3085
1933-0693
1933-0693
DOI:10.3171/2018.7.JNS173007