Preenchimento de áreas de oclusão em domo tridimensional texturizado

Abstract

This work aims to apply the inpainting technique on the disocclusions of an equirectangular panorama and texture the video obtained in a three-dimensional dome, in order to generate an interactive spherical video with a uniform approximation of the objects portrayed in the scene. The application of inpainting aims to reconstruct areas of occlusion located between the frontal plane of a given scenario and its adjacent region, completing information missing from certain points of view. The reconstruction is made from the estimation of the input panoramic depth map, which will be used to create a layered structure and will receive the application of a convolutional neural network. The texturing step complements the methodology by inserting the resulting video from the three-dimensional perspective of a dome, thus obtaining a view capable of reaching 360 degrees of amplitude. The combination of both processes, inpainting and texturing in the three-dimensional dome, generated as result a video projected on a sphere that provides the observer the enlargement of objects inserted in the equirectangular panorama, in a homogeneous way and without apparent distortions. The results obtained presented a more realistic way of virtualizing the environment through photogrammetry.