Trials and tribulations when attempting to decode semantic representations from MEG responses to written text

• Published in: Language, cognition and neuroscience Vol. 39; no. 9; pp. 1149 - 1160
• Main Authors: Ghazaryan, Gayane, van Vliet, Marijn, Saranpää, Aino, Lammi, Lotta, Lindh-Knuutila, Tiina, Hultén, Annika, Kivisaari, Sasa, Salmelin, Riitta
• Format: Journal Article
• Language: English
• Published: Abingdon Routledge 20-10-2024; Taylor & Francis Ltd
• Subjects: Brain; decoding; language; Magnetoencephalography; Neuroimaging; Semantic processing; Semantics; written words
• ISSN: 2327-3798; 2327-3801
• DOI: 10.1080/23273798.2023.2219353

Several studies have been published which show that it is possible to decode semantic representations directly from brain responses. This has been repeatedly successful when the stimuli used were pictures of objects. However, there is a distinct scarcity of studies decoding responses to orthographic stimuli, particularly those employing time-sensitive imaging methods. We use examples from our own research to highlight the challenges we have faced when attempting to decode semantic representations from MEG responses to written words. We discuss differences in brain responses to pictures and orthographic stimuli to determine the characteristics of the brain responses that allow for successful decoding of semantics. We suspect the limited number of published studies on this topic indicates that these challenges are not unique to our experience. By bringing attention to these issues, we hope to stimulate a new wave of discussion leading to eventual progress.