سيدمحمد حسيني پناه

The purpose of image registration is to align two or more images taken from the same scene at different times and/or from different perspectives and/or using different devices. In recent years, with the continuous improvement of human ability to observe the earth, the accuracy and quality of remote sensing images have increased. Therefore, the need for new image registration models that can perform high calculations of these images and also have good accuracy is observed. In this thesis, we have used a new method to solve these problems. The proposed solution includes the use of regions of interest in order to reduce the search area and increase the accuracy. For this purpose, first, the areas that are the same between two images are identified, and then, the image is registered according to the similar areas. To find the region of interest, a deep transformer neural network model is used. The proposed deep neural network of the transformer includes several layers of inner-attention and cross-attention, which has the task of learning the importance of different positions within an image and between two images. The proposed model is a self- supervised method that generate training data using the segment swapping. The training data was collected from Google Earth images and annotated by us. After training the model and obtaining the similar regions, we use the common SIFT model to obtain the image registration. For testing, we have used Sentinel-2 aerial images. To quantitatively eva‎luate the result, we use the root mean square error. Quantitative and qualitative results show a significant performance gap in cost and accuracy, compared to conventional methods of capturing aerial images.

‫ﺳﻨﺠﺶ‬ ‫ﺍﺯ‬ ‫ﺩﻭﺭ‬ , ‫ﺗﻄﺒﯿﻖ‬ ‫ﺗﺼﻮﯾﺮ‬ , ‫ﻧﺎﺣﯿﻪ‬ ‫ﻣﻮﺭﺩ‬ ‫ﻋﻼﻗﻪ‬ , شبكه عصبي عميق ترانسفورمر

Remote Sensing , Image Registration , Region of Interest , Transformer Deep Neural Network

seyed mohammad hoseini panah

mohsen soryani