Alshaikh, Rana, Bouraoui, Zied, Jeawak, Shelan and Schockaert, Steven  ORCID: https://orcid.org/0000-0002-9256-2881
2020.
A mixture-of-experts model for learning multi-facet entity embeddings.
Presented at: The 28th International Conference on Computational Linguistics (COLING 2020),
Virtual,
8-13 December 2020.
Published in: Scott, D., Bel, N. and Zong, C. eds.
Proceedings of the 28th International Conference on Computational Linguistics.
Association for Computational Linguistics,
pp. 5124-5135.
10.18653/v1/2020.coling-main.449
|
Preview |
PDF
- Published Version
Available under License Creative Commons Attribution. Download (536kB) | Preview |
Abstract
Various methods have already been proposed for learning entity embeddings from text descriptions. Such embeddings are commonly used for inferring properties of entities, for recommendation and entity-oriented search, and for injecting background knowledge into neural architectures, among others. Entity embeddings essentially serve as a compact encoding of a similarity relation, but similarity is an inherently multi-faceted notion. By representing entities as single vectors, existing methods leave it to downstream applications to identify these different facets, and to select the most relevant ones. In this paper, we propose a model that instead learns several vectors for each entity, each of which intuitively captures a different aspect of the considered domain. We use a mixture-of-experts formulation to jointly learn these facet-specific embeddings. The individual entity embeddings are learned using a variant of the GloVe model, which has the advantage that we can easily identify which properties are modelled well in which of the learned embeddings. This is exploited by an associated gating network, which uses pre-trained word vectors to encourage the properties that are modelled by a given embedding to be semantically coherent, i.e. to encourage each of the individual embeddings to capture a meaningful facet.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Date Type: | Publication |
| Status: | Published |
| Schools: | Professional Services > Advanced Research Computing @ Cardiff (ARCCA) Schools > Computer Science & Informatics |
| Publisher: | Association for Computational Linguistics |
| ISBN: | 9781952148279 |
| Date of First Compliant Deposit: | 5 November 2020 |
| Date of Acceptance: | 30 September 2020 |
| Last Modified: | 04 Sep 2025 10:45 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/136131 |
Actions (repository staff only)
 |
Edit Item |
Dimensions
Dimensions