Transformer and CNN Comparison for Time Series Classification Model

• Published in: 2023 15th International Congress on Advanced Applied Informatics Winter (IIAI-AAI-Winter) pp. 160 - 164
• Main Authors: Sonata, Ilvico, Heryadi, Yaya
• Format: Conference Proceeding
• Language: English
• Published: IEEE 11-12-2023
• Subjects: CNN; Data models; Deep learning; Feature extraction; Production; Time series; Time series analysis; Training; Transformer; Transformers
• DOI: 10.1109/IIAI-AAI-Winter61682.2023.00038

In real life, many activities are performed sequentially. These activities must be carried out sequentially, such as the assembly process in the manufacturing production process. This series of activities cannot be reduced or added so that the main goal of the series of activities is achieved. Apart from that, there are also time series events that occur naturally, such as rainy and hot conditions in a certain area. The classification process of time series activities is very important to see the possibility of anomalies occurring. The significant development of machine learning models in recent years has made the process of classifying time series data increasingly researched. Several previous studies stated that deep learning models were more accurate in classifying time series data. In this paper, we will compare Convolutional Neural Network (CNN) and Transformer deep learning models in classifying time series data. Experimental results using the same public datasets for CNN and Transformer model show that the CNN model is more accurate than the Transformer model. The results of measuring accuracy using confusion matrix show that CNN has an accuracy of 92% and Transformer has an accuracy of 80%.