An Immersive System for Exploring and Measuring Medical Image Data

Abstract

We present an immersive system to explore and measure medical 2D and 3D data for treatment planning. Our focus lies on interaction techniques, which are oriented on the workflow of treatment planning. We use the head-mounted display from an Oculus Rift DK2 as output device. For input, we use a stylus from a zSpace and implement ray-based interaction techniques. Our system is designed to be used in a sitting position at a desk, similar to the treatment planning environment of a physician. The stylus is grabbed equally to a pen and allows precise input, which is important for measurements. We evaluated our prototype with computer scientists, stating exploratory and measurement tasks on medical 2D and 3D data. Here, we assessed the time, usability, felt presence and informal feedback. Our results show that our exploration and measurement techniques are fast, easily understood and support presence. However, tracking losses due to infrared interference have to be solved for further studies with physicians.