A new method of audio-visual environment emotion assessment based on range fusion decision

• Published in: Multimedia tools and applications Vol. 83; no. 13; pp. 40003 - 40019
• Main Authors: Li, Yinsheng, Guo, Shaoshuai, Fu, Maixia
• Format: Journal Article
• Language: English
• Published: New York Springer US 01-04-2024; Springer Nature B.V
• Subjects: Brain research; Computer Communication Networks; Computer Science; Data Structures and Information Theory; Design; Emotions; Hilbert transformation; Information processing; Multimedia; Multimedia Information Systems; Physiology; Portable equipment; Questionnaires; Special Purpose and Application-Based Systems; Track 2: Medical Applications of Multimedia; Vision; Visual aspects; Response-related time; Audio-visual; Adaptive range fusion decision; Emotion; EEG
• ISSN: 1573-7721; 1380-7501; 1573-7721
• DOI: 10.1007/s11042-023-17182-z

Regarding the effect of vision and auditory on emotion, only one factor of vision or auditory is often focused on, while the synergistic influence among different factors is ignored. Besides, the effect of various factors on emotion is not studied quantitatively. Therefore, this paper proposes a range fusion decision model in a normal environment. First, the orthogonal table is used to design the experimental plan between different visual and auditory factors, and the corresponding EEG is collected through the portable EEG device. Then, EMD and Hilbert transform are used to calculate the response-related time, combined with the range fusion decision model to obtain the adaptive weight of each environmental factor, and the influence mechanism of different visual and auditory factors on EEG can be established to realize the brain emotion assessment in the different audio-visual environment. The experimental results show that the model effectively reveals the mechanism of the synergistic influence of various visual and auditory environmental factors on human emotion and provides essential practical guidance for ecological design.