Automatic Video Generation Using Floor Segmentation from a Single 2D Image

Abstract

Image based video generation paradigms have recently emerged as an interesting problem in the field of robotics. This paper focuses on the problem of automatic video generation of indoor scenes that mainly consist of orthogonal planes. The algorithm infers frontier information directly from the images using a geometric context-based segmentation scheme that uses the natural scene structure in indoor environments. The presence of floor is a major cue for obtaining the termination point for the video generation. First, we perform floor segmentation using dilation and erosion methods. Second, compute the length of the floor using distance method which is used as the termination point for video generation. Finally, video is generated by cropping the image. Our approach needs no human interventions, hence it is fully automatic. We demonstrate the technique to a variety of applications, including virtual walk through ancient time images, in forensics and in architectural sites. The algorithm is tested on nearly 100 images obtained from different buildings, all of them are fairly different in interior decoration themes from each other.