Collocated AAR Augmenting After Action Review with Mixed Reality

• Published in: 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality pp. 107 - 116
• Main Authors: Quarles, John, Lampotang, Samsun, Fischler, Ira, Fishwick, Paul, Lok, Benjamin
• Format: Conference Proceeding
• Language: English
• Published: Washington, DC, USA IEEE Computer Society 15-09-2008; IEEE
• Series: ACM Other Conferences
• Subjects: After Action Review; Anesthesia; Anesthesia Machine; Computing methodologies > Artificial intelligence > Computer vision > Image and video acquisition > 3D imaging; Computing methodologies > Computer graphics > Animation; Computing methodologies > Computer graphics > Graphics systems and interfaces; Computing methodologies > Computer graphics > Graphics systems and interfaces > Virtual reality; Computing methodologies > Modeling and simulation > Model development and analysis; Computing methodologies > Modeling and simulation > Model development and analysis > Model verification and validation; Computing methodologies > Modeling and simulation > Model development and analysis > Modeling methodologies; Data visualization; Human-centered computing > Human computer interaction (HCI) > Interaction devices > Graphics input devices; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Mixed > augmented reality; Human-centered computing > Human computer interaction (HCI) > Interaction paradigms > Virtual reality; J.3 [Computer Applications]: Life and Medical Sciences - Health; Lenses; Mixed Reality; Training; User Studies; Virtual reality; Visualization
• ISBN: 9781424428403; 1424428408
• DOI: 10.1109/ISMAR.2008.4637335

This paper proposes collocated After Action Review (AAR) of training experiences. Through Mixed Reality (MR), collocated AAR allows users to review past training experiences in situ with the user’s current, real-world experience. MR enables a user-controlled egocentric viewpoint, a visual overlay of virtual information, and playback of recorded training experiences collocated with the user’s current experience. Collocated AAR presents novel challenges for MR, such as collocating time, interactions, and visualizations of previous and current experiences. We created a collocated AAR system for anesthesia education, the Augmented Anesthesia Machine Visualization and Interactive Debriefing system (AAMVID). The system was evaluated in two studies by students (n=19) and educators (n=3). The results demonstrate how collocated AAR systems such as AAMVID can: (1) effectively direct student attention and interaction during AAR and (2) provide novel visualizations of aggregate student performance and insight into student understanding for educators.