Lagrangian Duality with ELM for Word Sense Multiprototype Discovery

• Published in: Applied artificial intelligence Vol. 32; no. 9-10; pp. 979 - 990
• Main Authors: Liang, Ping, Wongthanavasu, Sartra
• Format: Journal Article
• Language: English
• Published: Philadelphia Taylor & Francis 26-11-2018; Taylor & Francis Ltd; Taylor & Francis Group
• Subjects: Clustering; Covariance; Machine learning; Mathematical analysis; Multilayers; Neural networks; Parameter estimation; Weight; Word sense disambiguation
• ISSN: 0883-9514; 1087-6545
• DOI: 10.1080/08839514.2018.1530833

Homonymy and polysemy are major issues in word sense disambiguation. Combining with multilayer neural network, word sense multiprototyping tackles the issues by defining multiple feature embedding representations for each word which are based on the average feature weight of the word's different context windows called prototypes. The complexity of parameter estimation of neural network regression as well as the fixed context window size are the restrictions on the implementation of word sense multiprototyping. We propose approximating the least absolute deviation (LAD) between pair-wise word frequency covariance and pair-wise word semantic relatedness by Extreme Machine Learning (ELM) with less-constraint parameter estimation. Lagrangian duality proves the method's feasibility. An in-cluster closeness calculation is performed to extract a variable context window to contextually identify multiprototypes of word senses based on Kmeans clustering. The higher accuracy of the discovered multiprototypes is verified by our experiments.