Visually Impaired People Navigation System using Sensors and Neural Network

• Published in: 2022 IEEE 3rd International Conference on Human-Machine Systems (ICHMS) pp. 1 - 7
• Main Authors: Saber, Hakar Mohsin, Al-Salihi, Nawzad Kameran, Omer, Rebaz Mohammed Dler
• Format: Conference Proceeding
• Language: English
• Published: IEEE 17-11-2022
• Subjects: Acoustics; Arduino; Deep learning; GPS; Navigation; neural network; Neural networks; Performance evaluation; Prototypes; Sensor systems; sensors; visually impaired
• DOI: 10.1109/ICHMS56717.2022.9980818

Without a personal assistant or a trained dog, it is difficult and somehow risky for visually impaired individuals to navigate indoors and outdoors. Navigation for individuals with visual impairment is now an active area of research, and numerous systems have been created. Developing a reliable and robust system will give the visually impaired more awareness about their surroundings, provides more independence in their lives, and reduces the risks they might face. This paper proposes the design and implementation of a prototype for a wearable system that enables blind and visually impaired individuals to navigate easily and safely by using computer vision and deep learning to identify objects and sensors to detect obstacles. Using an attached camera, the system uses image processing to recognize objects around the user. It identifies the objects based on a trained deep learning dataset and audibly communicates the object names to the user. Ultrasonic sensors detect nearby obstructions and alert the user by vibrating. Upon request, a Global Positioning System (GPS) receiver transmits the user's location via Short Message Service (SMS) to a caregiver. All the sensors and devices are connected to and controlled by an Arduino Mega microcontroller that has been programmed with efficient and dependable algorithms to perform tasks precisely and rapidly. Object recognition and reading are performed using a computer equipped with the necessary MATLAB software and libraries.