Lifted relational neural networks: efficient learning of latent relational structures

Sourek, Gustav, Aschenbrenner, Vojtech, Zelezny, Filip, Schockaert, Steven ORCID: https://orcid.org/0000-0002-9256-2881 and Kuzelka, Ondrej 2018. Lifted relational neural networks: efficient learning of latent relational structures. Journal of Artificial Intelligence Research 62 , pp. 69-100. 10.1613/jair.1.11203

Preview

PDF - Published Version Download (1MB) | Preview

Abstract

We propose a method to combine the interpretability and expressive power of firstorder logic with the effectiveness of neural network learning. In particular, we introduce a lifted framework in which first-order rules are used to describe the structure of a given problem setting. These rules are then used as a template for constructing a number of neural networks, one for each training and testing example. As the different networks corresponding to different examples share their weights, these weights can be efficiently learned using stochastic gradient descent. Our framework provides a flexible way for implementing and combining a wide variety of modelling constructs. In particular, the use of first-order logic allows for a declarative specification of latent relational structures, which can then be efficiently discovered in a given data set using neural network learning. Experiments on 78 relational learning benchmarks clearly demonstrate the effectiveness of the framework.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	AI Access Foundation
ISSN:	1076-9757
Funders:	ERC, Czech Science Foundation, Leverhulme Trust
Date of First Compliant Deposit:	2 May 2018
Date of Acceptance:	1 May 2018
Last Modified:	06 May 2023 12:41
URI:	https://orca.cardiff.ac.uk/id/eprint/111117

Citation Data

Cited 72 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item