A local semi-supervised Sammon algorithm for textual data visualization

• Published in: Journal of intelligent information systems Vol. 33; no. 1; pp. 23 - 40
• Main Authors: Martin-Merino, Manuel, Blanco, Angela
• Format: Journal Article
• Language: English
• Published: Boston Springer US 01-08-2009; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Computer Science; Data analysis; Data Structures and Information Theory; Information Storage and Retrieval; Information technology; IT in Business; Mapping; Natural Language Processing (NLP); Nonlinear systems; Power; Semantic relations; Semantics; Standard deviation; Visualization; Zipf's Law; Textual data analysis; Sammon mapping; Non-linear projection; Visualization algorithms
• ISSN: 0925-9902; 1573-7675
• DOI: 10.1007/s10844-008-0056-5

Sammon’s mapping is a powerful non-linear technique that allow us to visualize high dimensional object relationships. It has been applied to a broad range of practical problems and particularly to the visualization of the semantic relations among terms in textual databases. The word maps generated by the Sammon mapping suffer from a low discriminant power due to the well known “curse of dimensionality” and to the unsupervised nature of the algorithm. Fortunately the textual databases provide frequently a manually created classification for a subset of documents that may help to overcome this problem. In this paper we first introduce a modification of the Sammon mapping (SSammon) that enhances the local topology reducing the sensibility to the ’curse of dimensionality’. Next a semi-supervised version is proposed that takes advantage of the a priori categorization of a subset of documents to improve the discriminant power of the word maps generated. The new algorithm has been applied to the challenging problem of word map generation. The experimental results suggest that the new model improves significantly well known unsupervised alternatives.