Multi-modal controller for image manipulation in the operating room

Abstract

In the domain of orthopedics, surgeons often rely on radiology images during operations. In this context, manipulating the images displayed on a computer screen is an issue as their hands have to remain sterile. In this article, we present a multi-modal controller (foot and voice) coupled with an existing state-of-the-art radiology display and analysis software used in operating rooms. The controller itself consists of a battery-operated wireless embedded system integrated into a shoe that provides multiple foot pressure-points as well as an absolute orientation sensors. In addition, a wireless microphone is used to acquire voice commands. To demonstrate the validity of our approach, we present a randomized user study conducted on ten subjects that had to perform image manipulation tasks using the controller.