Reconstruction of a Three-Dimensional Scene from its Projections in Computer Vision Systems

• Published in: 2021 Intelligent Technologies and Electronic Devices in Vehicle and Road Transport Complex (TIRVED) pp. 1 - 8
• Main Authors: Gadasin, D. V., Shvedov, A. V., Kuzin, I. A.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 11-11-2021
• Subjects: CNN; Computational modeling; Computer vision; depth map; Power transmission lines; Roads; scene reconstruction; Solid modeling; Stereo image processing; stereo mapping; Three-dimensional displays; three-dimensional images; Three-dimensional reconstruction
• DOI: 10.1109/TIRVED53476.2021.9639161

The problem of reconstructing a three-dimensional scene from its projections is one of the most urgent and studied among the problems solved by computer vision methods. Most often, such systems are implemented by creating geographically distributed complexes that require the transfer of a large amount of data between their components, which creates a large load on the transmission lines. Scene reconstruction using projections obtained from several observation points is a special case and is not always possible, especially when used in unmanned aerial vehicles or autonomous vehicles. To resolve these limitations, the possibility of using a computer stereoscopic vision system and a three-dimensional convolutional neural network capable of reconstructing a complete scene from a single image containing subjective characteristics of scene objects, such as color and depth, is considered in this work, creating its three-dimensional representation. The article describes the architecture and principle of operation of a neural network, and also builds a model of a computer stereo vision stand for image registration. An image formation algorithm is proposed for this model.