Real-time plane-sweep with local strategy

Abstract

Recent research in computer vision has made significant progress in the reconstruction of depth information from two-dimensional images. A new challenge is to extend these techniques to video images. Given a small set of calibrated video cameras, our goal is to render on-line dynamic scenes in real-time from new viewpoints. This paper presents an image-based rendering system using photogrametric constraints without any knowledge of the geometry of the scene. Our approach follows a plane-sweep algorithm extended by a local dynamic scoring that handles occlusions. In addition, we present an optimization of our method for stereoscopic rendering which computes the second image at low cost. Our method achieves real-time framerate on consumer graphic hardware thanks to fragment shaders.