Nursing care teaching system based on mixed reality for effective caregiver-patient interaction

Aoki, Goro, Luces, Jose Victorio Salazar, Tafrishi, Seyed Amir ORCID: https://orcid.org/0000-0001-9829-3144, Ravankar, Ankit A. and Hirata, Yasuhisa 2023. Nursing care teaching system based on mixed reality for effective caregiver-patient interaction. Presented at: 2023 IEEE/SICE International Symposium on System Integration (SII), Atlanta, GA, USA, 17-20 January 2023. 2023 IEEE/SICE International Symposium on System Integration (SII). IEEE, 10.1109/SII55687.2023.10039419

Preview

PDF - Published Version Download (1MB) | Preview

Abstract

In the nursing care tasks such as assistance for transferring and walking, it is necessary to provide appropriate nursing care movements depending on factors such as the patient's pose and the degree of disability. However, for novice caregivers to practice and learn appropriate nursing care, they must practice for a long time under the guidance of skilled caregivers. To solve this problem, we propose a novel framework for a system that teaches appropriate nursing care actions according to the current situation. The realization of such a teaching system requires technology to recognize the current situation and effectively teach the interaction between the caregiver and the patient. In this article, we propose a system that integrates depth camera-based pose estimation of the patient and Mixed Reality (MR) technology to present the target motion of the patient to a caregiver. To accurately present the patient's target pose to the novice caregivers, our system displays an avatar showing the patient's ideal animation overlaid on the actual patient. Experimental results show that our system can accurately instruct the caregiver about the patient's target pose in each movement procedure.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Published Online
Schools:	Engineering
Publisher:	IEEE
ISBN:	979-8-3503-9868-7
Date of First Compliant Deposit:	19 February 2023
Date of Acceptance:	1 November 2022
Last Modified:	20 Mar 2023 02:30
URI:	https://orca.cardiff.ac.uk/id/eprint/157140

Actions (repository staff only)

Edit Item