Scholarly record
3D-MODELING INFRASTRUCTURE FACILITIES USING DEEP LEARNING BASED ON HIGH RESOLUTION SATELLITE IMAGES
Abstract
The work describes a method for restoring three-dimensional models of rigid objects from one satellite image, based on the usage of convolutional neural network models. General requirements for reference and test satellite images are: seasonal shooting (lack of snow cover); images? geo-linking to railway infrastructure objects and to the general coordinate projection; presence of image metadata on survey and lighting conditions (geo-reference data and time of survey, photography and position of the Sun); visibility conditions - shooting in daylight, absence of survey artifacts, complete or partial visibility of objects for construction; pictures? ortotransformation. The proposed method includes the following steps of processing satellite images. At the first stage, an integral analysis of the image is performed, on which an object of a certain physical class is detected. It is based on the usage of pre-trained networks, rough datasets of objects unloaded from geographic information portals. At the second stage, processing is performed in the locations of areas on the image which were detected in the first step. This network is trained in classes of areas suitable for evaluating three-dimensional shapes and sizes of objects. Such classes include, in particular, roofs (to restore the shape of the base), shadows (to restore the shape of the roof), guide walls and shadows (to restore heights), orts of the buildings (the vicinity of that points in which orthogonal guide walls and eaves of the building?s roof converge). At the third stage, the shape and dimensions are evaluated by the waste of informative areas. It is based on linearization and polarization of the raster contour, as well as the usage of scaling coefficients based on reference objects. During linearization, for each point of the contour line, a segment of the regression line of this and several subsequent points is found. Then there is a line at the points of which the direction of the segments changes. During polarization, the segments are oriented along given guides, for example, in one of two orthogonal directions corresponding to the semi-axes of an equivalent ellipse. At the fourth stage, the geometric model is built. The objects of different physical classes can be given by algebraic formulas, which operands are the simple figures and coefficients that establish dimensions, position and slope in multivariate Euclidean space. For the typical objects, algebraic formulas are considered to be known and the restoration of their models is performed automatically. The models of atypical objects are displayed interactively using a geometric calculator (based on algebraic operations on objects and coefficients). The research was carried out with the support of the Ministry of Education and Science of Russia (unique project identifier RFMEFI60719X0312).
Publication Impact Profile
- Citations
- Scopus - Citation Indexes: 2
- Captures
- Mendeley - Readers: 9
Publication details
References15
Murynin A.B., Richter A.A. Peculiarities of application of methods and algorithms of reconstruction of three-dimensional shape of rigid objects according to panoramic survey data // Machine learning and data analysis, Russia, 2018. Volume 4, No. 4, p. 235-247. DOI: 10.21469/22233792.4.4.02.
Gvozdev O.G., Murynin A.B., Richter A.A. Obtaining information on anthropogenic littering of earth's surface from space imagery data // The First International Conference, SLS (Situation, Language, Speech) 2019, “Computer Science and Control”. Roma, Inaly, October 8-11, 2019. P 50-51.
Sherrie Wang, William Chen, Sang Michael Xie, George Azzari, David B. Lobell. Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery // Remote Sens, USA, 2020, 12, 207; DOI: 10.3390/rs12020207. 25 p.
Tuzhilkin A.Y. Recognition and reconstruction of 3D objects from satellite images based on comparison of graph spectra // Fundamental research, Russia, 2015, № 2, S. 3727-3732.
Sokolova N.O. Recognition of building contours on high spatial resolution satellite images // Journal of KHNTU, Russia, 2015, № 3 (54), S. 610-614.
Kudryashov A.P., Solovyev I.V. Reconstruction of textured model of urban space according to topographic plan and photographs // Software products and systems/Software & Systems, Russia, 2019, 3 (32). DOI: 10.15827/0236-235X.127.496-503.
Umut Gunes Sefercik, Serkan Karakis, Caglar Bayik, Mehmet Alkan & Naci Yastikli. Contribution of Normalized DSM to Automatic Building Extraction from HR Mono Optical Satellite Imagery // European Journal of Remote Sensing, Turkey, 2014, 47, P. 575-591. DOI: 10.5721/EuJRS20144732.
Tusikova A.A., Vikhtenko E.M. On Recognition of Roads on Satellite Images Using Convolutional Networks Mask-rcnn // V International Conference "Information Technologies and High-Performance Computing" (ITHPC-2019), Khabarovsk, Russia, September 16-19, 2019. Collection of Works. Under ed. Smagin S. I., Zacarinny A. A., Russia, 2019, C 308-314.
Sherrie Wang, William Chen, Sang Michael Xie, George Azzari, David B. Lobell. Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery // Remote Sens, USA, 2020, 12, 207; DOI: 10.3390/rs12020207. 25 p.
Srivastava S., Volpi M., Tuia D. Joint Height Estimation and Semantic Labeling of Monocular Aerial Images with CNNs // In Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA, 23–28 July 2017.
Ghamisi P., Yokoya N. IMG2DSM: Height Simulation from Single Imagery Using Conditional Generative Adversarial Net // IEEE Geosci. Remote Sens. Lett. 2018, 5, 794–798.
Mou, L.; Member, S.; Zhu, X.X.; Member, S. IM2HEIGHT: Height Estimation from Single Monocular Imagery via Fully Residual Convolutional-Deconvolutional Network // arXiv 2018, arXiv:1802.10249, 1–13.
Amirkolaee H.A., Arefi H. Height estimation from single aerial images using a deep convolutional encoder-decoder network // ISPRS J. Photogramm. Remote Sens. 2019, 149, 50–66.
Bittner K., D’Angelo P., Körner M., Reinartz P. DSM-to-LoD2: Spaceborne Stereo Digital Surface Model Refinement // Remote Sensing 2018, 10, 1926.
Kaiser P., Wegner J.D., Aurélien L., Jaggi M., Hofmann T., Schindler K. Learning Aerial Image Segmentation from Online Maps // IEEE Trans. Geosci. Remote Sens. 2017, 55, 6054–6068.
Citing literature
Number of times cited according to Crossref: 3
View or Download full articleAccess options
SWS access login
Login as SWS Scientific CommitteeLogin as SWS Scientific PartnerLogin as SWS AuthorAuthors and approved SWS contributors will read and export their own linked papers after identity matching by SWS profile, email and SGEM GlobalID.
For librarian assistance: [email protected]
Purchase Instant Access
- Article can be downloaded after successful payment.
- Article may be used according to SWS library access terms.
- Article cannot be redistributed.