Reasoning and learning services for coalition situational understanding

Harborne, Daniel, Raghavendra, Ramya, Willis, Chris, Chakraborty, Supriyo, Dewan, Pranita, Srivatsa, Mudhakar, Tomsett, Richard and Preece, Alun David ORCID: https://orcid.org/0000-0003-0349-9057 2018. Reasoning and learning services for coalition situational understanding. Presented at: Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX (SPIE Defense and Commercial Sensing Conference 10635), Orlando, USA, 16-18 April 2018. Published in: Kolodny, Michael A., Wiegmann, Dietrich M. and Pham, Tien eds. Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX. SPIE, 10.1117/12.2307009

Preview

PDF - Accepted Post-Print Version Download (3MB) | Preview

Abstract

Situational understanding requires an ability to assess the current situation and anticipate future situations, requiring both pattern recognition and inference. A coalition involves multiple agencies sharing information and analytics. This paper considers how to harness distributed information sources, including multimodal sensors, together with machine learning and reasoning services, to perform situational understanding in a coalition context. To exemplify the approach we focus on a technology integration experiment in which multimodal data — including video and still imagery, geospatial and weather data — is processed and fused in a service-oriented architecture by heterogeneous pattern recognition and inference components. We show how the architecture: (i) provides awareness of the current situation and prediction of future states, (ii) is robust to individual service failure, (iii) supports the generation of ‘why’ explanations for human analysts (including from components based on ‘black box’ deep neural networks which pose particular challenges to explanation generation), and (iv) allows for the imposition of information sharing constraints in a coalition context where there is varying levels of trust between partner agencies.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics Crime and Security Research Institute (CSURI)
Publisher:	SPIE
Date of First Compliant Deposit:	22 June 2018
Date of Acceptance:	15 December 2017
Last Modified:	23 Oct 2022 13:36
URI:	https://orca.cardiff.ac.uk/id/eprint/111126

Citation Data

Cited 2 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item