Annotating Norwegian Language Varieties on Twitter for Part-of-Speech

• Main Authors: Mæhlum, Petter, Kåsen, Andre, Touileb, Samia, Barnes, Jeremy
• Format: Journal Article
• Language: English
• Published: 12-10-2022
• Subjects: Computer Science - Computation and Language
• DOI: 10.48550/arxiv.2210.06150

Norwegian Twitter data poses an interesting challenge for Natural Language
Processing (NLP) tasks. These texts are difficult for models trained on
standardized text in one of the two Norwegian written forms (Bokm{\aa}l and
Nynorsk), as they contain both the typical variation of social media text, as
well as a large amount of dialectal variety. In this paper we present a novel
Norwegian Twitter dataset annotated with POS-tags. We show that models trained
on Universal Dependency (UD) data perform worse when evaluated against this
dataset, and that models trained on Bokm{\aa}l generally perform better than
those trained on Nynorsk. We also see that performance on dialectal tweets is
comparable to the written standards for some models. Finally we perform a
detailed analysis of the errors that models commonly make on this data.