CTNet: an efficient coupled transformer network for robust hyperspectral unmixing

References

• Achanta, R., A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk. 2012. “SLIC Superpixels Compared to State-Of-The-Art Superpixel Methods.” IEEE Transactions on Pattern Analysis & Machine Intelligence 34 (11): 2274–2282. https://doi.org/10.1109/TPAMI.2012.120.
   PubMed Web of Science ®Google Scholar
• Altmann, Y., A. Halimi, N. Dobigeon, and J.-Y. Tourneret. 2011. “Supervised Nonlinear Spectral Unmixing Using a Polynomial Post Nonlinear Model for Hyperspectral Imagery.” Proceedings of IEEE International Conference on Acoustics, Speech and Signal Process. (ICASSP), 1009–1012. Prague, Czech Republic.
   Google Scholar
• Ba, J., J. Kiros, and G. Hinton. 2016. “Layer Normalization.” NIPS 2016 Deep Learning Symposium, Barcelona, Spain, arXiv:1607.06450.
   Google Scholar
• Bhatt, J. S., and M. V. Joshi. 2020. “Deep Learning in Hyperspectral Unmixing: A Review.” IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, 2189–2192. Waikoloa, HI, USA.
   Google Scholar
• Bhatt, J. S., M. V. Joshi, and S. S. Vijayashekhar. 2018. “A Multitemporal Linear Spectral Unmixing: An Iterative Approach Accounting for Abundance Variations, 2018.” 9th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), 1–5. Amsterdam, Netherlands.
   Google Scholar
• Bioucas-Dias, J. M., and M. Figueiredo. 2010. “Alternating Direction Algorithms for Constrained Sparse Regression: Application to Hyperspectral Unmixing.” Proceedings of IEEE Workshop Hyperspectral Image Signal Process: Evolution in Remote Sensing, 1–4. Reykjavik, Iceland.
   Google Scholar
• Bioucas-Dias, J. M., A. Plaza, N. Dobigeon, M. Parente, Q. Du, P. Gader, J. Chanussot, et al. 2012. “Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 5 (2): 354–379. https://doi.org/10.1109/JSTARS.2012.2194696.
   Web of Science ®Google Scholar
• Borsoi, R. A., D. Erdoğmuş, and T. Imbiriba. 2023. “Learning Interpretable Deep Disentangled Neural Networks for Hyperspectral Unmixing.” IEEE Transactions on Computational Imaging 9:977–991. https://doi.org/10.1109/TCI.2023.3321985.
   Google Scholar
• Borsoi, R. A., T. Imbiriba, J. C. M. Bermudez, C. Richard, J. Chanussot, L. Drumetz, J.-Y. Tourneret, et al. 2021. “Spectral Variability in Hyperspectral Data Unmixing: A Comprehensive Review.” IEEE Geoscience and Remote Sensing Magazine 9 (4): 223–270. https://doi.org/10.1109/MGRS.2021.3071158.
   Web of Science ®Google Scholar
• Borsoi, R., A. T. Imbiriba, and J. C. M. Bermudez. 2020. “Deep Generative Endmember Modeling: An Application to Unsupervised Spectral Unmixing.” IEEE Transactions on Computational Imaging 6:374–384. https://doi.org/10.1109/TCI.2019.2948726.
   Web of Science ®Google Scholar
• Dobigeon, N., J. Tourneret, C. Richard, J. C. M. Bermudez, S. McLaughlin, and A. O. Hero. 2014. “Nonlinear Unmixing of Hyperspectral Images: Models and Algorithms.” IEEE Signal Processing Magazine 31 (1): 82–94. https://doi.org/10.1109/MSP.2013.2279274.
   Web of Science ®Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” International Conference on Learning Representations, Online, arXiv:2010.11929.
   Google Scholar
• Drumetz, L., M. A. Veganzones, S. Henrot, R. Phlypo, J. Chanussot, and C. Jutten. 2016. “Blind Hyperspectral Unmixing Using an Extended Linear Mixing Model to Address Spectral Variability.” IEEE Transactions on Image Processing 25 (8): 3890–3905. https://doi.org/10.1109/TIP.2016.2579259.
   PubMed Web of Science ®Google Scholar
• Gao, L. Z. H., D. Hong, B. Zhang, and J. Chanussot. 2022. “CyCU-Net: Cycle-Consistency Unmixing Network by Learning Cascaded Autoencoders.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2021.3064958.
   Web of Science ®Google Scholar
• Ghosh, P., S. K. Roy, B. Koirala, B. Rasti, and P. Scheunders. 2022. “Hyperspectral Unmixing Using Transformer Network.” IEEE Transactions on Geoscience & Remote Sensing 60:1–16. https://doi.org/10.1109/TGRS.2022.3196057.
   Web of Science ®Google Scholar
• Guo, R., W. Wang, and H. Qi. 2015. “Hyperspectral Image Unmixing Using Autoencoder Cascade.” 7th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS), 1–4. Tokyo, Japan.
   Google Scholar
• Halimi, A., Y. Altmann, N. Dobigeon, and J. Y. Tourneret. 2011. “Nonlinear Unmixing of Hyperspectral Images Using a Generalized Bilinear Model.” IEEE Transactions on Geoscience & Remote Sensing 49 (11): 4153–4162. https://doi.org/10.1109/TGRS.2010.2098414.
   Web of Science ®Google Scholar
• Han, Z., D. Hong, L. Gao, B. Zhang, and J. Chanussot. 2021. “Deep Half-Siamese Networks for Hyperspectral Unmixing.” IEEE Geoscience & Remote Sensing Letters 18 (11): 1996–2000. https://doi.org/10.1109/LGRS.2020.3011941.
   Web of Science ®Google Scholar
• Heinz, D. C., and Chein-I-Chang. 2001. “Fully Constrained Least Squares Linear Spectral Mixture Analysis Method for Material Quantification in Hyperspectral Imagery.” IEEE Transactions on Geoscience & Remote Sensing 39 (3): 529–545. https://doi.org/10.1109/36.911111.
   Web of Science ®Google Scholar
• Heylen, R., D. Burazerovic, and P. Scheunders. 2011. “Fully Constrained Least Squares Spectral Unmixing by Simplex Projection.” IEEE Transactions on Geoscience & Remote Sensing 49 (11): 4112–4122. https://doi.org/10.1109/TGRS.2011.2155070.
   Web of Science ®Google Scholar
• Heylen, R., M. Parente, and P. Gader. 2014. “A Review of Nonlinear Hyperspectral Unmixing Methods.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 7 (6): 1844–1868. https://doi.org/10.1109/JSTARS.2014.2320576.
   Web of Science ®Google Scholar
• Heylen, R., P. Scheunders, A. Rangarajan, and P. Gader. 2015. “Nonlinear Unmixing by Using Different Metrics in a Linear Unmixing Chain.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 8 (6): 2655–2664. https://doi.org/10.1109/JSTARS.2014.2375342.
   Web of Science ®Google Scholar
• Hong, D., J. Chanussot, N. Yokoya, U. Heiden, W. Heldens, and X. X. Zhu. 2019. “WU-Net: A Weakly-Supervised Unmixing Network for Remotely Sensed Hyperspectral Imagery.” IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium, 373–376. Yokohama, Japan.
   Google Scholar
• Hong, D., L. Gao, J. Yao, N. Yokoya, J. Chanussot, U. Heiden, B. Zhang, et al. 2022. “Endmember-Guided Unmixing Network (EGU-Net): A General Deep Learning Framework for Self-Supervised Hyperspectral Unmixing.” IEEE Transactions on Neural Networks and Learning Systems 33 (11): 6518–6531. https://doi.org/10.1109/TNNLS.2021.3082289.
   PubMed Web of Science ®Google Scholar
• Hong, D., W. He, N. Yokoya, J. Yao, L. Gao, L. Zhang, J. Chanussot, et al. 2021. “Interpretable Hyperspectral Artificial Intelligence: When Nonconvex Modeling Meets Hyperspectral Remote Sensing.” IEEE Geoscience and Remote Sensing Magazine 9 (2): 52–87. https://doi.org/10.1109/MGRS.2021.3064051.
   Web of Science ®Google Scholar
• Hong, D., N. Yokoya, J. Chanussot, and X. X. Zhu. 2017. “Learning a Low-Coherence Dictionary to Address Spectral Variability for Hyperspectral Unmixing.” 2017 IEEE International Conference on Image Processing (ICIP), 235–239. Beijing, China.
   Google Scholar
• Imbiriba, T., R. A. Borsoi, and J. C. Moreira Bermudez. 2018. “Generalized Linear Mixing Model Accounting for Endmember Variability.” 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1862–1866. Calgary, AB, Canada.
   Google Scholar
• Ioffe, S., C. Szegedy, Y. V. Nelyubina, Y. A. Khomutova, S. L. Ioffe, and V. A. Tartakovsky. 2015. “Synthesis of B,o,N-Doped Adamantanes and Diamantanes by Condensation of Oximes with Boronic Acids.” The Journal of Organic Chemistry 80 (13): 6728–6736. https://doi.org/10.1021/acs.joc.5b00892.
   PubMed Web of Science ®Google Scholar
• Iordache, M.-., D. J. M. Bioucas-Dias, and A. Plaza. 2014. “Collaborative Sparse Regression for Hyperspectral Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 52 (1): 341–354. https://doi.org/10.1109/TGRS.2013.2240001.
   Web of Science ®Google Scholar
• Iordache, M. D., J. M. Bioucas-Dias, and A. Plaza. 2012. “Total Variation Spatial Regularization for Sparse Hyperspectral Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 50 (11): 4484–4502. https://doi.org/10.1109/TGRS.2012.2191590.
   Web of Science ®Google Scholar
• Jia, S., and Y. Qian. 2009. “Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 47 (1): 161–173. https://doi.org/10.1109/TGRS.2008.2002882.
   Web of Science ®Google Scholar
• Jiang, J., J. Ma, Z. Wang, C. Chen, and X. Liu. 2019. “Hyperspectral Image Classification in the Presence of Noisy Labels.” IEEE Transactions on Geoscience & Remote Sensing 57 (2): 851–865. https://doi.org/10.1109/TGRS.2018.2861992.
   Web of Science ®Google Scholar
• Jin, Q., Y. Ma, X. Mei, X. Dai, H. Li, F. Fan, and J. Huang. 2019. “Gaussian Mixture Model for Hyperspectral Unmixing with Low-Rank Representation.” IGARSS 2019–2019 IEEE International Geoscience and Remote Sensing Symposium, 294–297. Yokohama, Japan.
   Google Scholar
• Jin, Q., Y. Ma, X. Mei, H. Li, and J. Ma. 2021. “UTDN: An Unsupervised Two-Stream Dirichlet-Net for Hyperspectral Unmixing.” ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1885–1889. Toronto, ON, Canada.
   Google Scholar
• Jin, Q., Y. Ma, X. Mei, and J. Ma. 2022. “TANet: An Unsupervised Two-Stream Autoencoder Network for Hyperspectral Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2021.3094884.
   Web of Science ®Google Scholar
• Keshava, N., and J. F. Mustard. 2002. “Spectral Unmixing.” IEEE Signal Processing Magazine 19 (1): 44–57. https://doi.org/10.1109/79.974727.
   Web of Science ®Google Scholar
• Kingma, D., and J. Ba. 2014. “Adam: A Method for Stochastic Optimization.” International Conference on Learning Representations (ICLR), San Diego, USA, 6980.
   Google Scholar
• Li, H., and L. Zhang. 2011. “A Hybrid Automatic Endmember Extraction Algorithm Based on a Local Window.” IEEE Transactions on Geoscience & Remote Sensing 49 (11): 4223–4238. https://doi.org/10.1109/TGRS.2011.2162098.
   Web of Science ®Google Scholar
• Ma, R., R. Wang, G. Liu, H. H. Chen, and Z. Qin. 2020. “UAV-Assisted Data Collection for Ocean Monitoring Networks.” IEEE Network 34 (6): 250–258. https://doi.org/10.1109/MNET.011.2000168.
   Web of Science ®Google Scholar
• Mei, X., Y. Ma, C. Li, F. Fan, J. Huang, and J. Ma. 2018. “Robust GBM Hyperspectral Image Unmixing with Superpixel Segmentation Based Low Rank and Sparse Representation.” Neurocomputing 275:2783–2797. https://doi.org/10.1016/j.neucom.2017.11.052.
   Web of Science ®Google Scholar
• Nascimento, J. M. P., and J. M. B. Dias. 2005. “Vertex Component Analysis: A Fast Algorithm to Unmix Hyperspectral Data.” IEEE Transactions on Geoscience & Remote Sensing 43 (4): 898–910. https://doi.org/10.1109/TGRS.2005.844293.
   Web of Science ®Google Scholar
• Palsson, B. M. O. U., and J. R. Sveinsson. 2019. “Convolutional Autoencoder for Spatial-Spectral Hyperspectral Unmixing.” IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium, 357–360. Yokohama, Japan.
   Google Scholar
• Palsson, B., J. Sigurdsson, J. R. Sveinsson, and M. O. Ulfarsson. 2018. “Hyperspectral Unmixing Using a Neural Network Autoencoder.” Institute of Electrical and Electronics Engineers Access 6:25646–25656. https://doi.org/10.1109/ACCESS.2018.2818280.
   Google Scholar
• Qu, Y., and H. Qi. 2019. “uDAS: An Untied Denoising Autoencoder with Sparsity for Spectral Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 57 (3): 1698–1712. https://doi.org/10.1109/TGRS.2018.2868690.
   Web of Science ®Google Scholar
• Rasti, B., D. Hong, R. Hang, P. Ghamisi, X. Kang, J. Chanussot, J. A. Benediktsson, et al. 2020. “Feature Extraction for Hyperspectral Imagery: The Evolution from Shallow to Deep: Overview and Toolbox.” IEEE Geoscience and Remote Sensing Magazine 8 (4): 60–88. https://doi.org/10.1109/MGRS.2020.2979764.
   Web of Science ®Google Scholar
• Su, Y., X. Xu, J. Li, H. Qi, P. Gamba, and A. Plaza. 2021. “Deep Autoencoders with Multitask Learning for Bilinear Hyperspectral Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 59 (10): 8615–8629. https://doi.org/10.1109/TGRS.2020.3041157.
   Web of Science ®Google Scholar
• Tang, M., Y. Qu, and H. Qi. 2020. “Hyperspectral Nonlinear Unmixing via Generative Adversarial Network.” IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, 2404–2407. Waikoloa, HI, USA.
   Google Scholar
• Teke, M., H. S. Deveci, O. Haliloğlu, S. Z. Gürbüz, and U. Sakarya. 2013. “A Short Survey of Hyperspectral Remote Sensing Applications in Agriculture.” 6th International Conference on Recent Advances in Space Technologies (RAST), 171–176. Istanbul, Turkey.
   Google Scholar
• Thouvenin, P.-., A. N. Dobigeon, and J. Y. Tourneret. 2016. “Hyperspectral Unmixing with Spectral Variability Using a Perturbed Linear Mixing Model.” IEEE Transactions on Signal Processing 64 (2): 525–538. https://doi.org/10.1109/TSP.2015.2486746.
   Web of Science ®Google Scholar
• Vaswani, A., N. Shazeer, N. Parmar, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, and Polosukhin I. 2017. “Attention is All You Need.” International Conference on Neural Information Processing Systems, California, USA, 6000–6010. arXiv: 1706.03762.
   Google Scholar
• Wang, W., E. Xie, X. Li, D. P. Fan, K. Song, D. Liang, T. Lu, P. Luo, and L. Shao. 2021. “Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions.” Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 568–678. Montreal, QC, Canada.
   Google Scholar
• Wang, X., Y. Zhong, L. Zhang, and Y. Xu. 2019. “Blind Hyperspectral Unmixing Considering the Adjacency Effect.” IEEE Transactions on Geoscience & Remote Sensing 57 (9): 6633–6649. https://doi.org/10.1109/TGRS.2019.2907567.
   Web of Science ®Google Scholar
• Yang, B., B. B. Wang, and Z. Wu. 2017. “Nonlinear Hyperspectral Unmixing Based on Geometric Characteristics of Bilinear Mixture Models.” IEEE Transactions on Geoscience & Remote Sensing 56 (2): 694–714. https://doi.org/10.1109/TGRS.2017.2753847.
   Web of Science ®Google Scholar
• Yang, J., D. Li, X. Jiang, S. Chen, and L. Hanzo. 2020. “Enhancing the Resilience of Low Earth Orbit Remote Sensing Satellite Networks.” IEEE Network 34 (4): 304–311. https://doi.org/10.1109/MNET.001.1900550.
   Web of Science ®Google Scholar
• Zare, A., and K. C. Ho. 2014. “Endmember Variability in Hyperspectral Analysis: Addressing Spectral Variability During Spectral Unmixing.” IEEE Signal Processing Magazine 31 (1): 95–104. https://doi.org/10.1109/MSP.2013.2279177.
   Web of Science ®Google Scholar