Assisting the visually impaired: obstacle detection and warning system by acoustic feedback

• Published in: Sensors (Basel, Switzerland) Vol. 12; no. 12; pp. 17476 - 17496
• Main Authors: Rodríguez, Alberto, Yebes, J Javier, Alcantarilla, Pablo F, Bergasa, Luis M, Almazán, Javier, Cela, Andrés
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 17-12-2012; Molecular Diversity Preservation International (MDPI)
• Subjects: Accuracy; Acoustics; Acoustics - instrumentation; Algorithms; audio warning; Blindness; Bones; Design engineering; Equipment Design; Feedback; Female; Filtering; Global positioning systems; GPS; ground plane estimation; Humans; Localization; obstacle detection; Obstacles; Receivers & amplifiers; Sensors; Sensory Aids; Software; stereo camera; Three dimensional; User-Computer Interface; Visual impairment; visually impaired; Visually Impaired Persons - rehabilitation
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s121217476

The aim of this article is focused on the design of an obstacle detection system for assisting visually impaired people. A dense disparity map is computed from the images of a stereo camera carried by the user. By using the dense disparity map, potential obstacles can be detected in 3D in indoor and outdoor scenarios. A ground plane estimation algorithm based on RANSAC plus filtering techniques allows the robust detection of the ground in every frame. A polar grid representation is proposed to account for the potential obstacles in the scene. The design is completed with acoustic feedback to assist visually impaired users while approaching obstacles. Beep sounds with different frequencies and repetitions inform the user about the presence of obstacles. Audio bone conducting technology is employed to play these sounds without interrupting the visually impaired user from hearing other important sounds from its local environment. A user study participated by four visually impaired volunteers supports the proposed system.