VNU-UET Repository

A Vietnamese 3D Taking Face for Embodied Conversational Agents

Ngo, Thi Duyen and Bui, The Duy (2015) A Vietnamese 3D Taking Face for Embodied Conversational Agents. In: RIVF: 2015 IEEE RIVF International Conference on Computing Communication Technologies - Research, Innovation, and Vision for the Future, 25-28 January 2015, Can Tho, Vietnam.

Full text not available from this repository.

Abstract

Conversational agents are receiving significant attention from multi-agent and human computer interaction research societies. Many techniques have been developed to enable these agents to behave in a human-like manner. In order to do so, they are simulated with similar communicative channels as humans. Moreover, they are also simulated with emotion and personality. In this work, we focus on issue of expressing emotions for embodied-agents. We present a three dimensional face with ability to speak emotional Vietnamese speech and naturally express emotions while talking. Our face can represent lip movements during emotionally pronouncing Vietnamese words, and at the same time it can show emotional facial expressions while speaking. The face's architecture consists of three parts: Vietnamese Emotional Speech Synthesis module, Emotions to Facial Expressions module, and Combination module which creates lip movements when pronouncing Vietnamese emotional speech and combines these movements with emotional facial expressions. We have tested the face in the football supporter domain in order to confirm its naturalness. The face is simulated as the face of a football supporter agent which experiences emotions and expresses emotional expressions in his voice as well as on his face.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: emotion recognition;human computer interaction;multi-agent systems;natural language processing;signal representation;speech synthesis;sport;Vietnamese 3D talking face;Vietnamese emotional speech synthesis module;combination module;communicative channels;embodied conversational agents;emotion-facial expressions module;emotional facial expressions;football supporter agent;football supporter domain;human computer interaction research societies;lip movement representation;multiagent;personality;three dimensional face;Acoustics;Databases;Face;Feature extraction;Lips;Speech;Three-dimensional displays;Conversational Agent;Emotional Facial Expression;Emotional Speech;Vietnamese 3D Talking Face
Subjects: Information Technology (IT)
Divisions: Faculty of Information Technology (FIT)
Depositing User: Prof. Xuan-Tu Tran
Date Deposited: 28 Dec 2015 02:40
Last Modified: 28 Dec 2015 02:40
URI: http://eprints.uet.vnu.edu.vn/eprints/id/eprint/1462

Actions (login required)

View Item View Item