Real-time mimicking of estonian speaker's mouth movements on a 3D avatar using Kinect 2

In this paper an algorithm for the real-time imitation of lips movements of an Estonian speaker on a 3D avatar is proposed. This research is focused on obtaining the RGB and depth information from a Kinect 2 camera, processing it and moving the avatar accordingly. For the more stable extraction of i...

Full description

Saved in:

Bibliographic Details
Published in:	2015 International Conference on Information and Communication Technology Convergence (ICTC) pp. 141 - 143
Main Authors:	Lusi, Iiris, Anbarjafari, Gholamreza, Meister, Einar
Format:	Conference Proceeding
Language:	English
Published:	IEEE 01-10-2015
Subjects:	3D facial movement modelling Avatars Cameras Computer vision depth information analysis human-computer interaction Mouth Nose real-time processing Real-time systems Tracking
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	In this paper an algorithm for the real-time imitation of lips movements of an Estonian speaker on a 3D avatar is proposed. This research is focused on obtaining the RGB and depth information from a Kinect 2 camera, processing it and moving the avatar accordingly. For the more stable extraction of information about lip shape and movement, cosine function is used. The depth info helps to determine the closest speaker and stabilize the movement of avatar and tracking of lips.
DOI:	10.1109/ICTC.2015.7354513