Antonym-Synonym Classification Based on New Sub-Space Embeddings

Distinguishing antonyms from synonyms is a key challenge for many NLP applications focused on the lexical-semantic relation extraction. Existing solutions relying on large-scale corpora yield low performance because of huge contextual overlap of antonym and synonym pairs. We propose a novel approach entirely based on pre-trained embeddings. We hypothesize that the pre-trained embeddings comprehend a blend of lexical-semantic information and we may distill the task-specific information using Distiller, a model proposed in this paper. Later, a classifier is trained based on features constructed from the distilled sub-spaces along with some word level features to distinguish antonyms from synonyms. Experimental results show that the proposed model outperforms existing research on antonym synonym distinction in both speed and performance.

Authors

• Muhammad Asif Ali
• Yifang Sun
• Xiaoling Zhou Peking University Tianjin University
• Wei Wang
• Xiang Zhao National University of Defense Technology

Keywords

No keywords are indexed for this paper.