Emotion recognition based on group phase locking value using convolutional neural network

• Published in: Scientific reports Vol. 13; no. 1; p. 3769
• Main Authors: Cui, Gaochao, Li, Xueyuan, Touyama, Hideaki
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 07-03-2023; Nature Publishing Group; Nature Portfolio
• Subjects: 631/378/1457; 631/378/2649/1310; 639/166; Accuracy; Data processing; EEG; Electroencephalography; Emotions; Frequency dependence; Humanities and Social Sciences; Humans; multidisciplinary; Neural networks; Neural Networks, Computer; Recognition, Psychology; Records; Science; Science (multidisciplinary)
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-023-30458-6

Electroencephalography (EEG)-based emotion recognition is an important technology for human–computer interactions. In the field of neuromarketing, emotion recognition based on group EEG can be used to analyze the emotional states of multiple users. Previous emotion recognition experiments have been based on individual EEGs; therefore, it is difficult to use them for estimating the emotional states of multiple users. The purpose of this study is to find a data processing method that can improve the efficiency of emotion recognition. In this study, the DEAP dataset was used, which comprises EEG signals of 32 participants that were recorded as they watched 40 videos with different emotional themes. This study compared emotion recognition accuracy based on individual and group EEGs using the proposed convolutional neural network model. Based on this study, we can see that the differences of phase locking value (PLV) exist in different EEG frequency bands when subjects are in different emotional states. The results showed that an emotion recognition accuracy of up to 85% can be obtained for group EEG data by using the proposed model. It means that using group EEG data can effectively improve the efficiency of emotion recognition. Moreover, the significant emotion recognition accuracy for multiple users achieved in this study can contribute to research on handling group human emotional states.