Modelling monotonic and non-monotonic attribute dependencies with embeddings: a theoretical analysis

Schockaert, Steven ORCID: https://orcid.org/0000-0002-9256-2881 2021. Modelling monotonic and non-monotonic attribute dependencies with embeddings: a theoretical analysis. 10.48550/arXiv.2106.14431

PDF - Accepted Post-Print Version Download (323kB)

Abstract

During the last decade, entity embeddings have become ubiquitous in Artificial Intelligence. Such embeddings essentially serve as compact but semantically meaningful representations of the entities of interest. In most approaches, vectors are used for representing the entities themselves, as well as for representing their associated attributes. An important advantage of using attribute embeddings is that (some of the) semantic dependencies between the attributes can thus be captured. However, little is known about what kinds of semantic dependencies can be modelled in this way. The aim of this paper is to shed light on this question, focusing on settings where the embedding of an entity is obtained by pooling the embeddings of its known attributes. Our particular focus is on studying the theoretical limitations of different embedding strategies, rather than their ability to effectively learn attribute dependencies in practice. We first show a number of negative results, revealing that some of the most popular embedding models are not able to capture even basic Horn rules. However, we also find that some embedding strategies are capable, in principle, of modelling both monotonic and non-monotonic attribute dependencies.

Item Type:	Working paper
Date Type:	Published Online
Status:	Unpublished
Schools:	Schools > Computer Science & Informatics
Date of First Compliant Deposit:	19 October 2021
Date of Acceptance:	19 August 2021
Last Modified:	12 Aug 2026 14:39
URI:	https://orca.cardiff.ac.uk/id/eprint/144076

Actions (repository staff only)

Edit Item