Neuromorphic Tactile Edge Orientation Classification in an Unsupervised Spiking Neural Network

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 18; p. 6998
• Main Authors: Macdonald, Fraser L. A, Lepora, Nathan F, Conradt, Jörg, Ward-Cherrier, Benjamin
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01-09-2022; MDPI
• Subjects: Algorithms; Analysis; Cameras; Data collection; Embedded systems; End effectors; Form factors; Implants, Artificial; Nervous system; Neural networks; neuromorphic; Orientation; Prostheses; Prosthesis; Robotics; Robots; Sensors; spiking neural network; tactile robotics; Tactile sensors (robotics); Touch; Vision systems
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22186998

Dexterous manipulation in robotic hands relies on an accurate sense of artificial touch. Here we investigate neuromorphic tactile sensation with an event-based optical tactile sensor combined with spiking neural networks for edge orientation detection. The sensor incorporates an event-based vision system (mini-eDVS) into a low-form factor artificial fingertip (the NeuroTac). The processing of tactile information is performed through a Spiking Neural Network with unsupervised Spike-Timing-Dependent Plasticity (STDP) learning, and the resultant output is classified with a 3-nearest neighbours classifier. Edge orientations were classified in 10-degree increments while tapping vertically downward and sliding horizontally across the edge. In both cases, we demonstrate that the sensor is able to reliably detect edge orientation, and could lead to accurate, bio-inspired, tactile processing in robotics and prosthetics applications.