Enabling Natural Interaction by Approaching Objects

Abstract

This paper introduces the research issues to make a major step towards natural human interaction with mobile multimodal systems. Thereby, we aim at combining explicit and implicit interaction to blended multimodal interaction. Natural inter- action and the requirement to anticipate a mix of purposive behaviour and uncertainty requires rendering information in a way that is compatible with and aware of the situational context. In two application examples we illustrate our approaches of interaction by movement. As the basis for adaptive behaviour, this paper describes the conclusions drawn from tracking the mobile user in two environments: a museum and a maintenance setting. It also illuminates different aspects of this technology, such as accuracy and costs, and illustrates the results of our project using the specific technology.