A Wheelchair Control System Using Human-Machine Interaction: Single-Modal and Multimodal Approaches

• Published in: Journal of intelligent systems Vol. 28; no. 1; pp. 115 - 132
• Main Authors: Shahin Mohamed K., Tharwat Alaa, Gaber Tarek, Hassanien Aboul Ella
• Format: Journal Article
• Language: English
• Published: De Gruyter 01-01-2019
• Subjects: brain-computer interface (bci); control; eeg signals; facial expressions; head movements; multimodal; single modal; wheelchair
• ISSN: 0334-1860; 2191-026X
• DOI: 10.1515/jisys-2017-0085

Recent research studies showed that brain-controlled systems/devices are breakthrough technology. Such devices can provide disabled people with the power to control the movement of the wheelchair using different signals (e.g. EEG signals, head movements, and facial expressions). With this technology, disabled people can remotely steer a wheelchair, a computer, or a tablet. This paper introduces a simple, low-cost human-machine interface system to help chaired people to control their wheelchair using several control sources. To achieve this paper’s aim, a laptop was installed on a wheelchair in front of the sitting person, and the 14-electrode Emotiv EPOC headset was used to collect the person’s head impressions from the skull surface. The superficially picked-up signals, containing the brain thoughts, head gestures, and facial emotions, were electrically encoded and then wirelessly sent to a personal computer to be interpreted and then translated into useful control instructions. Using these signals, two wheelchair control modes were proposed: automatic (using single-modal and multimodal approaches) and manual control. The automatic mode controller was accomplished using a software controller (Arduino), whereas a simple hardware controller was used for the manual mode. The proposed solution was designed using wheelchair, Emotiv EPOC EEG headset, Arduino microcontroller, and Processing language. It was then tested by totally chaired volunteers under different levels of trajectories. The results showed that the person’s thoughts can be used to seamlessly control his/her wheelchair and the proposed system can be configured to suit many levels and degrees of disability.