Shared Control of Bimanual Robotic Limbs With a Brain-Machine Interface for Self-Feeding

• Published in: Frontiers in neurorobotics Vol. 16; p. 918001
• Main Authors: Handelman, David A., Osborn, Luke E., Thomas, Tessy M., Badger, Andrew R., Thompson, Margaret, Nickl, Robert W., Anaya, Manuel A., Wormley, Jared M., Cantarero, Gabriela L., McMullen, David, Crone, Nathan E., Wester, Brock, Celnik, Pablo A., Fifer, Matthew S., Tenore, Francesco V.
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 28-06-2022; Frontiers Media S.A
• Subjects: Ability tests; activities of daily living (ADL); Arrays; bimanual control; brain computer interface (BCI); Collaboration; Coordination; Electrodes; FDA approval; Feeding; human machine teaming; Interfaces; Limbs; Neuroscience; Prostheses; robotic shared control; Robotics; Robots; Sensorimotor system; Spinal cord injuries
• ISSN: 1662-5218; 1662-5218
• DOI: 10.3389/fnbot.2022.918001

Advances in intelligent robotic systems and brain-machine interfaces (BMI) have helped restore functionality and independence to individuals living with sensorimotor deficits; however, tasks requiring bimanual coordination and fine manipulation continue to remain unsolved given the technical complexity of controlling multiple degrees of freedom (DOF) across multiple limbs in a coordinated way through a user input. To address this challenge, we implemented a collaborative shared control strategy to manipulate and coordinate two Modular Prosthetic Limbs (MPL) for performing a bimanual self-feeding task. A human participant with microelectrode arrays in sensorimotor brain regions provided commands to both MPLs to perform the self-feeding task, which included bimanual cutting. Motor commands were decoded from bilateral neural signals to control up to two DOFs on each MPL at a time. The shared control strategy enabled the participant to map his four-DOF control inputs, two per hand, to as many as 12 DOFs for specifying robot end effector position and orientation. Using neurally-driven shared control, the participant successfully and simultaneously controlled movements of both robotic limbs to cut and eat food in a complex bimanual self-feeding task. This demonstration of bimanual robotic system control
via
a BMI in collaboration with intelligent robot behavior has major implications for restoring complex movement behaviors for those living with sensorimotor deficits.