Reliable and Unobtrusive Inter-Device Collaboration by Continuous Interaction

Abstract

Currently, there is a lack of support for seamless task migration among devices - starting a task on one device and continuing it on another, without the need of manual application state inspection and data transfer. We are solving this problem by employing our framework for application state acquisition coupled with user interface based on an intuitive metaphor: video recording. Our solution utilizes a combination of natural features based detection and marker tracking in order to reliably establish the homography between the screen and the observation of the mobile device’s camera. This allows us to employ a fast and precise continuous interaction even on low-end mobile devices. In every moment, user is given relevant task and content-migration options for selected application. The experimental results show that our solution provides reliable task migration at interactive frame rates.