Analysis of Performance between Kinect v1 and Kinect v2 for Various Facial Part Movements

The aim of this study is to determine the suitable version of Kinect motion sensor for developing facial therapy or exercise throughout the analysis of face tracking performance. A face tracking system is developed in both version of Kinect cameras by referring to the respective version of Kinect SD...

Full description

Saved in:

Bibliographic Details
Published in:	2019 IEEE 9th International Conference on System Engineering and Technology (ICSET) pp. 17 - 22
Main Authors:	Heng, Sheng Guang, Samad, Rosdiyana, Mustafa, Mahfuzah, Abdullah, Nor Rul Hasma, Pebrianti, Dwi
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01-10-2019
Subjects:	animation unit asymmetry Cameras face tracking Faces Facial features facial part movement Kinect v1 Kinect v2 Medical treatment Motion detection Three-dimensional displays Tracking
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	The aim of this study is to determine the suitable version of Kinect motion sensor for developing facial therapy or exercise throughout the analysis of face tracking performance. A face tracking system is developed in both version of Kinect cameras by referring to the respective version of Kinect SDK. The created face tracking algorithms are then modified to display the detected facial points which are 121 points and 1347 points in total for Kinect v1 and Kinect v2 respectively. A total number of 18 desired facial feature point at similar landmarks will be extracted in the format of 3D coordinates for both Kinect cameras. To investigate the changes in the movement of facial feature points, the points will be paired up for distance ratio calculation between different frames of face image. The action unit of facial points for both Kinect cameras are different and there are some improvements in Kinect v2: asymmetrical facial points, high definition face detection and eye tracking as added action units. However, it shows poor detection in outer eyebrow part compared to Kinect v1. In overall, the Kinect v2 has better performance than Kinect v1 as it provides faster response speed and more detailed facial points movement detection in real-time operation for rehabilitation purposes.
ISSN:	2470-640X
DOI:	10.1109/ICSEngT.2019.8906419