Anomaly Detection Techniques in the Gaia Space Mission Data

• Published in: Journal of signal processing systems Vol. 93; no. 11; pp. 1339 - 1357
• Main Authors: Roberti, Marco, Druetto, Alessandro, Busonero, Deborah, Cancelliere, Rossella, Cavagnino, Davide, Gai, Mario
• Format: Journal Article
• Language: English
• Published: New York Springer US 01-11-2021; Springer Nature B.V
• Subjects: Anomalies; Artificial neural networks; Circuits and Systems; Classification; Computer Imaging; Data reduction; Electrical Engineering; Engineering; Hough transformation; Image Processing and Computer Vision; Machine learning; Pattern Recognition; Pattern Recognition and Graphics; Signal processing; Signal,Image and Speech Processing; Space missions; Support vector machines; Vision; Anomaly Detection; Deep learning; Big Data; Astrometry
• ISSN: 1939-8018; 1939-8115
• DOI: 10.1007/s11265-021-01688-6

In this paper we deal with classification of anomalous data detected by the data reduction system of the Gaia space mission, in operation since 2013. Given the size and complexity of intermediate data and plots for diagnostics, beyond practical possibility of full human evaluation, the need for automated signal processing tools is becoming more and more relevant. Our classification task consists in discriminating among “normal” data and data affected by anomalies, which at present are grouped into four different classes. We investigate the use of some clever pre-processing approaches that allow the application of a tailored technique based on the Hough transform, and of some machine learning tools, evidencing that the task can be exactly solved in the former case. In the latter case, random forests and support vector machine provide less than satisfactory performance, while convolutional neural networks achieve very good classification accuracy, up to 91.22%. Statistics show satisfactory results also in terms of precision and recall of each class.