Emote to win: Affective interactions with a computer game agent

Abstract

In this paper1, we introduce a game interface that is based on affective interactions between a player and a computer pet. As opposed to many traditional computer games, users are not expected to manipulate control devices in a skillful manner to win the game. Instead the basic idea is to elicit certain reactions of the pet via appropriate emotive user behaviors. For improved accuracy of emotion recognition, we employ a combined analysis of signals from two emotive expression channels: affective speech and physiological reactions.