Li, Minglei and Lu, Qin and Xiong, Dan and Long, Yunfei (2018) Phrase embedding learning based on external and internal context with compositionality constraint. Knowledge-Based Systems, 152. pp. 107-116. DOI https://doi.org/10.1016/j.knosys.2018.04.009
Li, Minglei and Lu, Qin and Xiong, Dan and Long, Yunfei (2018) Phrase embedding learning based on external and internal context with compositionality constraint. Knowledge-Based Systems, 152. pp. 107-116. DOI https://doi.org/10.1016/j.knosys.2018.04.009
Li, Minglei and Lu, Qin and Xiong, Dan and Long, Yunfei (2018) Phrase embedding learning based on external and internal context with compositionality constraint. Knowledge-Based Systems, 152. pp. 107-116. DOI https://doi.org/10.1016/j.knosys.2018.04.009
Abstract
Different methods are proposed to learn phrase embedding, which can be mainly divided into two strands. The first strand is based on the distributional hypothesis to treat a phrase as one non-divisible unit and to learn phrase embedding based on its external context similar to learn word embedding. However, distributional methods cannot make use of the information embedded in component words and they also face data spareness problem. The second strand is based on the principle of compositionality to infer phrase embedding based on the embedding of its component words. Compositional methods would give erroneous result if a phrase is non-compositional. In this paper, we propose a hybrid method by a linear combination of the distributional component and the compositional component with an individualized phrase compositionality constraint. The phrase compositionality is automatically computed based on the distributional embedding of the phrase and its component words. Evaluation on five phrase level semantic tasks and experiments show that our proposed method has overall best performance. Most importantly, our method is more robust as it is less sensitive to datasets.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Phrase embedding; Compositionality; Distributional hypothesis; Composition model |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 04 Jun 2020 15:54 |
Last Modified: | 30 Oct 2024 20:34 |
URI: | http://repository.essex.ac.uk/id/eprint/27794 |
Available files
Filename: kbs-phrase-embedding-without-trace-2nd-review.pdf
Licence: Creative Commons: Attribution-Noncommercial-No Derivative Works 3.0