129
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Multi-scale feature fusion kernel estimation with masked interpolation loss for real-world remote sensing images super-resolution

, , , , , , , ORCID Icon & show all
Pages 5597-5627 | Received 25 Apr 2023, Accepted 07 Aug 2023, Published online: 11 Sep 2023

References

  • Ahn, N., B. Kang, and K.-A. Sohn. 2018. “Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network.” In Computer Vision – ECCV 2018, Munich, Germany, 256–272. Springer International Publishing.
  • Bell-Kligler, S., A. Shocher, and M. Irani 2019. Blind Super-Resolution Kernel Estimation Using an Internal-GAN. Proceedings of the 33rd International Conference on Neural Information Processing Systems, 10. Red Hook, NY, USA: Curran Associates Inc.
  • Dai, T., J. Cai, Y. Zhang, S.-T. Xia, and L. Zhang. 2019a. “Second-Order Attention Network for Single Image Super-Resolution.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 11065–11074.
  • Dai, T., J. Cai, Y. Zhang, S.-T. Xia, and L. Zhang. 2019b. “Second-Order Attention Network for Single Image Super-Resolution.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 11065–11074.
  • Dong, C., C. Change Loy, H. Kaiming, and X. Tang. 2014. “Learning a Deep Convolutional Network for Image Super-Resolution.” In European conference on computer vision, Zurich, Switzerland, 184–199. Springer.
  • Dong, C., C. Change Loy, and X. Tang. 2016. “Accelerating the Super-Resolution Convolutional Neural Network.” In European conference on computer vision, Amsterdam, The Netherlands, 391–407. Springer.
  • Dong, X., L. Wang, X. Sun, X. Jia, L. Gao, and B. Zhang. 2021. “Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks.” IEEE Transactions on Geoscience and Remote Sensing 59 (4): 3473–3485. https://doi.org/10.1109/TGRS.2020.3019660.
  • Dong, R., L. Zhang, and F. Haohuan 2021. “Blind Super-Resolution on Remote Sensing Images with Blur Kernel Prediction.” In 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium, 2879–2882.
  • Dosovitskiy, A., and T. Brox. 2016. “Generating Images with Perceptual Similarity Metrics Based on Deep Networks.“ Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain, 658–666. NIPS'16. Red Hook, NY, USA: Curran Associates Inc.
  • Emad, M., M. Peemen, and H. Corporaal. 2021. “Dualsr: Zero-Shot Dual Learning for Real-World Super-Resolution.” In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA, 1630–1639.
  • Gencer, S., R. Gokberk Cinbis, and S. Aksoy. 2017. “Fine-Grained Object Recognition and Zero-Shot Learning in Remote Sensing Imagery.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 56 (2): 770–779. https://doi.org/10.1109/TGRS.2017.2754648.
  • Haut, J. M., M. E. Paoletti, R. Fernandez-Beltran, J. Plaza, A. Plaza, and L. Jun. 2019. “Remote Sensing Single-Image Superresolution Based on a Deep Compendium Model.” IEEE Geoscience & Remote Sensing Letters 16 (9): 1432–1436. https://doi.org/10.1109/LGRS.2019.2899576.
  • Huang, G., Z. Liu, L. Van Der Maaten, and K. Q. Weinberger. 2017. “Densely Connected Convolutional Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 4700–4708.
  • Huang, F., T. Xie, and Z. Liu. 2023. “Dual-Branche Attention Network for Super-Resolution of Remote Sensing Images.” International Journal of Remote Sensing 44 (2): 492–516. https://doi.org/10.1080/01431161.2023.2166370.
  • Huynh-Thu, Q., and M. Ghanbari. 2008. “Scope of Validity of PSNR in Image/Video Quality Assessment.” Electronics Letters 44 (13): 800–801. https://doi.org/10.1049/el:20080522.
  • Isola, P., J.-Y. Zhu, T. Zhou, and A. A. Efros. 2017. “Image-To-Image Translation with Conditional Adversarial Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 1125–1134.
  • Jiang, K., Z. Wang, Y. Peng, G. Wang, L. Tao, and J. Jiang. 2019. “Edge-Enhanced GAN for Remote Sensing Image Superresolution.” IEEE Transactions on Geoscience and Remote Sensing 57 (8): 5799–5812. https://doi.org/10.1109/TGRS.2019.2902431.
  • Jie, H., L. Shen, and G. Sun. 2018. “Squeeze-And-Excitation Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA, 7132–7141.
  • Kim, J., J. Kwon Lee, and K. Mu Lee. 2016. “Accurate Image Super-Resolution Using Very Deep Convolutional Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA, 1646–1654.
  • Kong, T., A. Yao, Y. Chen, and F. Sun. 2016. “Hypernet: Towards Accurate Region Proposal Generation and Joint Object Detection.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA, 845–853.
  • Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “Imagenet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
  • Lei, P., and C. Liu. 2020. “Inception Residual Attention Network for Remote Sensing Image Super-Resolution.” International Journal of Remote Sensing 41 (24): 9565–9587. https://doi.org/10.1080/01431161.2020.1800129.
  • Lei, S., Z. Shi, and M. Wenjing. 2022. “Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 60:1–11. https://doi.org/10.1109/TGRS.2021.3136190.
  • Lei, S., Z. Shi, and Z. Zou. 2017. “Super-Resolution for Remote Sensing Images via Local–Global Combined Network.” IEEE Geoscience & Remote Sensing Letters 14 (8): 1243–1247. https://doi.org/10.1109/LGRS.2017.2704122.
  • Lei, S., Z. Shi, and Z. Zou. 2020. “Coupled Adversarial Training for Remote Sensing Image Super-Resolution.” IEEE Transactions on Geoscience and Remote Sensing 58 (5): 3633–3643. https://doi.org/10.1109/TGRS.2019.2959020.
  • Li, J., F. Fang, K. Mei, and G. Zhang. 2018. “Multi-Scale Residual Network for Image Super-Resolution.” In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 517–532.
  • Lim, B., S. Son, H. Kim, S. Nah, and K. Mu Lee. 2017. “Enhanced Deep Residual Networks for Single Image Super-Resolution.” In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Honolulu, HI, USA, 136–144.
  • Lin, H., Z. Shi, and Z. Zou. 2017. “Fully Convolutional Network with Task Partitioning for Inshore Ship Detection in Optical Remote Sensing Images.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1665–1669. https://doi.org/10.1109/LGRS.2017.2727515.
  • Liu, Z., L. Gang, G. Mercier, H. You, and Q. Pan. 2017. “Change Detection in Heterogenous Remote Sensing Images via Homogeneous Pixel Transformation.” IEEE Transactions on Image Processing 27 (4): 1822–1834. https://doi.org/10.1109/TIP.2017.2784560.
  • Lu, T., J. Wang, Y. Zhang, Z. Wang, and J. Jiang. 2019. “Satellite Image Super-Resolution via Multi-Scale Residual Deep Neural Network.” Remote Sensing 11 (13). https://doi.org/10.3390/rs11131588.
  • Mei, Y., Y. Fan, Y. Zhou, L. Huang, T. S. Huang, and H. Shi. 2020. “Image Super-Resolution with Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Seattle, WA, USA, 5690–5699.
  • Minh-Tan, P., E. Aptoula, and S. Lefèvre. 2017. “Feature Profiles from Attribute Filtering for Classification of Remote Sensing Images.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 11 (1): 249–256. https://doi.org/10.1109/JSTARS.2017.2773367.
  • Shocher, A., N. Cohen, and M. Irani. 2018. “Zero-Shot super-resolution using deep internal learning.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA, 3118–3126.
  • Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. “Going Deeper with Convolutions.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA, 1–9.
  • Tai, Y., J. Yang, X. Liu, and X. Chunyan 2017. “Memnet: A Persistent Memory Network for Image Restoration.” In Proceedings of the IEEE international conference on computer vision, Venice, Italy, 4539–4547.
  • Tong, T., L. Gen, X. Liu, and Q. Gao. 2017. “Image Super-Resolution Using Dense Skip Connections.” In Proceedings of the IEEE international conference on computer vision, Venice, Italy, 4799–4807.
  • Tong, X., G. Xia, L. Qikai, H. Shen, L. Shengyang, S. You, and L. Zhang. 2020. “Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Models.” Remote Sensing of Environment 237:111322. https://doi.org/10.1016/j.rse.2019.111322.
  • Wald, L. 2000. “Quality of High Resolution Synthesised Images: Is There a Simple Criterion?” In Third conference” Fusion of Earth data: merging point measurements, raster maps and remotely sensed images”, Sophia Antipolis, France, 99–103. SEE/URISCA.
  • Wang, P., B. Bayram, and E. Sertel. 2022. “A Comprehensive Review on Deep Learning Based Remote Sensing Image Super-Resolution Methods.” Earth-Science Reviews 232:104110. https://doi.org/10.1016/j.earscirev.2022.104110.
  • Wang, Z., A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. 2004. “Image Quality Assessment: From Error Visibility to Structural Similarity.” IEEE Transactions on Image Processing 13 (4): 600–612. https://doi.org/10.1109/TIP.2003.819861.
  • Wang, X., W. Jiang, L. Zhao, B. Liu, and Y. Wang. 2022. “Multi-Scale Feature Learning Network with Channel Self-Attention for Remote Sensing Single-Image Super-Resolution.” International Journal of Remote Sensing 43 (18): 6669–6688. https://doi.org/10.1080/01431161.2022.2143732.
  • Wang, X., L. Xie, C. Dong, and Y. Shan. 2021. “Real-Esrgan: Training Real-World Blind Super-Resolution with Pure Synthetic Data.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada, 1905–1914.
  • Wang, X., K. Yu, W. Shixiang, G. Jinjin, Y. Liu, C. Dong, Y. Qiao, and C. Change Loy. 2018. “Esrgan: Enhanced Super-Resolution Generative Adversarial Networks.” In Proceedings of the European conference on computer vision (ECCV) workshops, 0–0.
  • Wang, S., T. Zhou, L. Yao, and D. Huijun. 2022. “Contextual Transformation Network for Lightweight Remote-Sensing Image Super-Resolution.” IEEE Transactions on Geoscience & Remote Sensing 60:1–13. https://doi.org/10.1109/TGRS.2021.3132093.
  • Xia, G.-S., H. Jingwen, H. Fan, B. Shi, X. Bai, Y. Zhong, L. Zhang, and L. Xiaoqiang. 2017. “AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (7): 3965–3981. https://doi.org/10.1109/TGRS.2017.2685945.
  • Xiaozhong, J., Y. Cao, Y. Tai, C. Wang, L. Jilin, and F. Huang. 2020. “Real-World Super-Resolution via Kernel Estimation and Noise Injection.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA, 466–467.
  • Yuhas, R. H., A. F. Goetz, and J. W. Boardman. 1992. Discrimination Among Semi-Arid Landscape Endmembers Using the Spectral Angle Mapper (SAM) Algorithm. Vol. 1. JPL, Summaries of the Third Annual JPL Airborne Geoscience Workshop, AVIRIS Workshop.
  • Zhang, R., P. Isola, A. A. Efros, E. Shechtman, and O. Wang. 2018. “The Unreasonable Effectiveness of Deep Features as a Perceptual Metric.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 586–595.
  • Zhang, Y., L. Kunpeng, L. Kai, L. Wang, B. Zhong, and F. Yun 2018. “Image Super-Resolution Using Very Deep Residual Channel Attention Networks.” In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 286–301.
  • Zhang, Y., Y. Tian, Y. Kong, B. Zhong, and F. Yun 2018. “Residual Dense Network for Image Super-Resolution.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2472–2481.
  • Zhang, L., and W. Xiaolin. 2006. “An Edge-Guided Image Interpolation Algorithm via Directional Filtering and Data Fusion.” IEEE Transactions on Image Processing 15 (8): 2226–2238. https://doi.org/10.1109/TIP.2006.877407.
  • Zhang, K., W. Zuo, and L. Zhang. 2018. “Learning a Single Convolutional Super-Resolution Network for Multiple Degradations.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 3262–3271.
  • Zhao, H., J. Shi, Q. Xiaojuan, X. Wang, and J. Jia. 2017. “Pyramid Scene Parsing Network.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 2881–2890.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.