A wikification prediction model based on the combination of latent, dyadic, and monadic features

• Published in: Journal of the Association for Information Science and Technology Vol. 69; no. 3; pp. 380 - 394
• Main Authors: Ferreira, Raoni S., Pimentel, Maria da Graça, Cristo, Marco
• Format: Journal Article
• Language: English
• Published: 01-03-2018
• ISSN: 2330-1635; 2330-1643
• DOI: 10.1002/asi.23922

Considering repositories of web documents that are semantically linked and created in a collaborative fashion, as in the case of Wikipedia, a key problem faced by content providers is the placement of links in the articles. These links must support user navigation and provide a deeper semantic interpretation of the content. Current wikification methods exploit machine learning techniques to capture characteristics of the concepts and its associations. In previous work, we proposed a preliminary prediction model combining traditional predictors with a latent component which captures the concept graph topology by means of matrix factorization. In this work, we provide a detailed description of our method and a deeper comparison with a state‐of‐the‐art wikification method using a sample of Wikipedia and report a gain up to 13% in F1 score. We also provide a comprehensive analysis of the model performance showing the importance of the latent predictor component and the attributes derived from the associations between the concepts. Moreover, we include an analysis that allows us to conclude that the model is resilient to ambiguity without including a disambiguation phase. We finally report the positive impact of selecting training samples from specific content quality classes.