Estimating User Affect and Focus of Attention from Physiological Signals in Life-Like Character Based Interaction Scenarios

Abstract

This paper abstract highlights some of our recent research efforts in designing and evaluating life- like characters that are capable of entertaining affective and social communication with users. The key novelty of our approach is the use of human physiological information: first, as a method to evaluate the effect of life-like character behavior on a moment-to-moment basis, and second, as an input modality for a new generation of interface agents that we call ‘physiologically perceptive’ characters. By exploiting the stream of primarily involuntary human responses, such as biometric signals and eye movements, those characters are expected to respond to users’ affective and social needs in a truly sensitive, and hence effective, friendly, and beneficial way.