eprintid: 1462
rev_number: 5
eprint_status: archive
userid: 4
dir: disk0/00/00/14/62
datestamp: 2015-12-28 02:40:30
lastmod: 2015-12-28 02:40:30
status_changed: 2015-12-28 02:40:30
type: conference_item
metadata_visibility: show
creators_name: Ngo, Thi Duyen
creators_name: Bui, The Duy
creators_id: duybt@vnu.edu.vn
title: A Vietnamese 3D Taking Face for Embodied Conversational Agents
ispublished: pub
subjects: IT
divisions: fac_fit
keywords: emotion recognition;human computer interaction;multi-agent systems;natural language processing;signal representation;speech synthesis;sport;Vietnamese 3D talking face;Vietnamese emotional speech synthesis module;combination module;communicative channels;embodied conversational agents;emotion-facial expressions module;emotional facial expressions;football supporter agent;football supporter domain;human computer interaction research societies;lip movement representation;multiagent;personality;three dimensional face;Acoustics;Databases;Face;Feature extraction;Lips;Speech;Three-dimensional displays;Conversational Agent;Emotional Facial Expression;Emotional Speech;Vietnamese 3D Talking Face
abstract: Conversational agents are receiving significant attention from multi-agent and human computer interaction research societies. Many techniques have been developed to enable these agents to behave in a human-like manner. In order to do so, they are simulated with similar communicative channels as humans. Moreover, they are also simulated with emotion and personality. In this work, we focus on issue of expressing emotions for embodied-agents. We present a three dimensional face with ability to speak emotional Vietnamese speech and naturally express emotions while talking. Our face can represent lip movements during emotionally pronouncing Vietnamese words, and at the same time it can show emotional facial expressions while speaking. The face's architecture consists of three parts: Vietnamese Emotional Speech Synthesis module, Emotions to Facial Expressions module, and Combination module which creates lip movements when pronouncing Vietnamese emotional speech and combines these movements with emotional facial expressions. We have tested the face in the football supporter domain in order to confirm its naturalness. The face is simulated as the face of a football supporter agent which experiences emotions and expresses emotional expressions in his voice as well as on his face.
date: 2015-01
date_type: published
full_text_status: none
pres_type: paper
pagerange: 94-99
event_title: RIVF: 2015 IEEE RIVF International Conference on Computing Communication Technologies - Research, Innovation, and Vision for the Future
event_location: Can Tho, Vietnam
event_dates: 25-28 January 2015
event_type: conference
refereed: TRUE
citation:   Ngo, Thi Duyen and Bui, The Duy  (2015) A Vietnamese 3D Taking Face for Embodied Conversational Agents.  In: RIVF: 2015 IEEE RIVF International Conference on Computing Communication Technologies - Research, Innovation, and Vision for the Future, 25-28 January 2015, Can Tho, Vietnam.