Demo: Robotics meets Augmented Reality: Real-Time Mapping with Boston Dynamics Spot and Microsoft HoloLens 2

• Published in: 2023 IEEE 24th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM) pp. 358 - 360
• Main Authors: Hofe, Nico Vom, Sossalla, Peter, Hofer, Johannes, Vielhaus, Christian L., Rischke, Justus, Steinke, Jannek, Fitzek, Frank H. P.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-06-2023
• Subjects: Dogs; Performance evaluation; Real-time systems; Robot vision systems; Simultaneous localization and mapping; Three-dimensional displays; Wireless communication
• ISSN: 2770-0542
• DOI: 10.1109/WoWMoM57956.2023.00062

In recent years, Simultaneous Localization and Mapping (SLAM) algorithms have gained popularity in the field of robotics for generating maps of environments. This paper presents a novel approach for generating 3D maps of environments visited by a Boston Dynamics robot dog named Spot. Five stereo cameras mounted on the robot dog capture images that are transmitted to a remote machine that generates 3D maps of the environment in real-time. The human operator wears an Augmented Reality (AR) device that embeds the 3D maps into his field of view. Tasks in human demanding environments, where the operator actively intervenes in the performed processes, can be performed remotely. The intention of this application is to stay in a safe place and at the same time take the robot's perspective.