User-Defined Voice and Mid-Air Gesture Commands for Maneuver-based Interventions in Automated Vehicles

Abstract

For highly automated vehicles (AVs), new interaction concepts need to be developed.

Even in AVs, the driver might want to intervene and override the automation from time to time.

To create the possibility of control, we explore vehicle control through maneuver-based interventions.

Thereby, we focus on explicit, contact-less interaction, which could be beneficial in future AV designs, where the driver is not necessarily bound to classical controls.

We propose a set of freehand gestures and keywords for voice control derived in a user-centered design process.

Further, we discuss properties, applicability and user impressions of both interaction modalities.

Voice control seems to be an efficient way to select a maneuver and free-hand gestures could be used, if voice channel is blocked, e.g., through conversation with passengers.