Concept-based indexing of annotated images using semantic DNA

Syed Abdullah, Engku and Setchi, Rossitza ORCID: https://orcid.org/0000-0002-7207-6544 2012. Concept-based indexing of annotated images using semantic DNA. Engineering Applications of Artificial Intelligence 25 (8) , pp. 1644-1655. 10.1016/j.engappai.2012.02.005

Full text not available from this repository.

Abstract

One of the challenges in image retrieval is dealing with concepts which have no visual appearance in the images or are not used as keywords in their annotations. To address this problem, this paper proposes an unsupervised concept-based image indexing technique which uses a lexical ontology to extract semantic signatures called ‘semantic chromosomes’ from image annotations. A semantic chromosome is an information structure, which carries the semantic information of an image; it is the semantic signature of an image in a collection expressed through a set of semantic DNA (SDNA), each of them representing a concept. Central to the concept-based indexing technique discussed is the concept disambiguation algorithm developed, which identifies the most relevant ‘semantic DNA’ (SDNA) by measuring the semantic importance of each word/phrase in the annotation. The concept disambiguation algorithm is evaluated using crowdsourcing. The experiments show that the algorithm has better accuracy (79.4%) than the accuracy demonstrated by other unsupervised algorithms (73%) in the 2007 Semeval competition. It is also comparable with the accuracy achieved in the same competition by the supervised algorithms (82–83%) which contrary to the approach proposed in this paper have to be trained with large corpora. The approach is currently applied to the automated generation of mood boards used as an inspirational tool in concept design.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Engineering
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > TK Electrical engineering. Electronics Nuclear engineering
Uncontrolled Keywords:	Concept Design; Image Indexing; Semantics; Lexical Ontology; Design Creativity
Publisher:	Elsevier
ISSN:	0952-1976
Last Modified:	06 Jul 2023 10:17
URI:	https://orca.cardiff.ac.uk/id/eprint/38328

Citation Data

Cited 11 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item