244
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Hyperspectral anomaly detection with vision transformer and adversarial refinement

, , , &
Pages 4034-4057 | Received 15 Feb 2023, Accepted 26 May 2023, Published online: 14 Jul 2023

References

  • Bati, E., A. Çalışkan, A. Koz, and A. A. Alatan. 2015. “Hyperspectral Anomaly Detection Method Based on Auto-Encoder.” In Image and Signal Processing for Remote Sensing XXI, edited by L. Bruzzone, 220–226. Vol. 9643. SPIE: International Society for Optics and Photonics.
  • Bera, S., and V. K. Shrivastava. 2020. “Analysis of Various Optimizers on Deep Convolutional Neural Network Model in the Application of Hyperspectral Remote Sensing Image Classification.” International Journal of Remote Sensing 41 (7): 2664–2683.April 2 https://doi.org/10.1080/01431161.2019.1694725.
  • Candès, E. J., X. Li, Y. Ma, and J. Wright. 2011. “Robust Principal Component Analysis?” Journal of the ACM 58 (3): 1–37. https://doi.org/10.1145/1970392.1970395.
  • Carlotto, M. 2005. “A Cluster-Based Approach for Detecting Man-Made Objects and Changes in Imagery.” IEEE Transactions on Geoscience and Remote Sensing 43 (2): 374–387. https://doi.org/10.1109/TGRS.2004.841481.
  • Chen, Y., N. M. Nasrabadi, and T. D. Tran. 2011. “Simultaneous Joint Sparsity Model for Target Detection in Hyperspectral Imagery.” IEEE Geoscience and Remote Sensing Letters 8 (4): 676–680. https://doi.org/10.1109/LGRS.2010.2099640.
  • Dalla Mura, M., J. A. Benediktsson, B. Waske, and L. Bruzzone. 2010. “Morphological Attribute Profiles for the Analysis of Very High Resolution Images.” IEEE Transactions on Geoscience and Remote Sensing 48 (10): 3747–3762. https://doi.org/10.1109/TGRS.2010.2048116.
  • Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” CoRr. abs/2010.11929.
  • Elkholy, M. M., M. Mostafa, H. M. Ebied, and M. F. Tolba. 2020. “Hyperspectral Unmixing Using Deep Convolutional Autoencoder.” International Journal of Remote Sensing 41 (12): 4799–4819. https://doi.org/10.1080/01431161.2020.1724346.
  • Fan, G., Y. Ma, X. Mei, F. Fan, J. Huang, and J. Ma. 2022. “Hyperspectral Anomaly Detection with Robust Graph Autoencoders.” IEEE Transactions on Geoscience and Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2021.3097097.
  • Gong, D., L. Liu, V. Le, B. Saha, M. R. Mansour, S. Venkatesh, and A. Van Den Hengel 2019. “Memorizing Normality to Detect Anomaly: Memory-Augmented Deep Autoencoder for Unsupervised Anomaly Detection.” In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 1705–1714.
  • Green, R. O., M. L. Eastwood, C. M. Sarture, T. G. Chrien, M. Aronsson, B. J. Chippendale, J. A. Faust, et al. 1998. “Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (Aviris).” Remote Sensing of Environment 65 (3): 227–248. https://doi.org/10.1016/S0034-4257(98)00064-9.
  • He, K., J. Sun, and X. Tang. 2013 06. “Guided Image Filtering.” IEEE Transactions on Pattern Analysis and Machine Intelligence 35 (6): 1397–1409. https://doi.org/10.1109/TPAMI.2012.213.
  • Hinton, G. E., and R. S. Zemel 1993. “Autoencoders, Minimum Description Length and Helmholtz Free Energy.” In Proceedings of the 6th International Conference on Neural Information Processing Systems, NIPS’93, 3–10. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.
  • Hosseiny, B., and R. Shah-Hosseini. 2020. “A Hyperspectral Anomaly Detection Framework Based on Segmentation and Convolutional Neural Network Algorithms.” International Journal of Remote Sensing 41 (18): 6946–6975. https://doi.org/10.1080/01431161.2020.1752413.
  • Hou, M., T. Wang, Y. Su, Y. Cai, and J. Cao. 2022a. “Hyperspectral Anomaly Detection Based on Adaptive Weighting Method Combined with Autoencoder and Convolutional Neural Network.” International Journal of Remote Sensing 43 (7): 2617–2637. https://doi.org/10.1080/01431161.2022.2061876.
  • Hou, M., T. Wang, Y. Su, Y. Cai, and Y. Wang. 2022b. “Hyperspectral Anomaly Detection Based on Score-Guided Cooperative Autoencoders.” International Journal of Remote Sensing 43 (12): 4436–4453. https://doi.org/10.1080/01431161.2022.2112110.
  • Jiao, C., B. Yang, Q. Wang, G. Wang, and J. Wu. 2022. “Discriminative Multiple-Instance Hyperspectral Subpixel Target Characterization.” IEEE Transactions on Geoscience & Remote Sensing 60:1–20. https://doi.org/10.1109/TGRS.2022.3140798.
  • Kang, X., X. Zhang, S. Li, K. Li, J. Li, and J. A. Benediktsson. 2017. “Hyperspectral Anomaly Detection with Attribute and Edge-Preserving Filters.” IEEE Transactions on Geoscience & Remote Sensing 55 (10): 5600–5611. https://doi.org/10.1109/TGRS.2017.2710145.
  • Kumar, B., O. Dikshit, A. Gupta, and M. K. Singh. 2020. “Feature Extraction for Hyperspectral Image Classification: A Review.” International Journal of Remote Sensing 41 (16): 6248–6287. https://doi.org/10.1080/01431161.2020.1736732.
  • Kwon, H., and N. Nasrabadi. 2005. “Kernel Rx-Algorithm: A Nonlinear Anomaly Detector for Hyperspectral Imagery.” IEEE Transactions on Geoscience and Remote Sensing 43 (2): 388–397. https://doi.org/10.1109/TGRS.2004.841487.
  • Liao, J., L. Wang, G. Zhao, and S. Hao. 2019. “Hyperspectral Image Classification Based on Bilateral Filter with Linear Spatial Correlation Information.” International Journal of Remote Sensing 40 (17): 6861–6883. https://doi.org/10.1080/01431161.2019.1597301.
  • Li, W., and Q. Du. 2015. “Collaborative Representation for Hyperspectral Anomaly Detection.” IEEE Transactions on Geoscience and Remote Sensing 53 (3): 1463–1474. https://doi.org/10.1109/TGRS.2014.2343955.
  • Li, Y., T. Jiang, W. Xie, J. Lei, and Q. Du. 2022. “Sparse Coding-Inspired Gan for Hyperspectral Anomaly Detection in Weakly Supervised Learning.” IEEE Transactions on Geoscience and Remote Sensing 60:1–11. https://doi.org/10.1109/TGRS.2021.3102048.
  • Liu, G., Z. Lin, and Y. Yu 2010. “Robust Subspace Segmentation by Low-Rank Representation.” In Proceedings of the 27th International Conference on International Conference on Machine Learning, ICML’10, 663–670. Madison, WI, USA: Omnipress.
  • Li, W., G. Wu, and Q. Du. 2017. “Transferred Deep Learning for Anomaly Detection in Hyperspectral Imagery.” IEEE Geoscience and Remote Sensing Letters 14 (5): 597–601. https://doi.org/10.1109/LGRS.2017.2657818.
  • Lobo, J. M., A. Jimenez-Valverde, and R. Real. 2008. “Auc: A Misleading Measure of the Performance of Predictive Distribution Models.” Global Ecology & Biogeography 17 (2): 145–151. https://doi.org/10.1111/j.1466-8238.2007.00358.x.
  • Matteoli, S., T. Veracini, M. Diani, and G. Corsini. 2014. “A Locally Adaptive Background Density Estimator: An Evolution for Rx-Based Anomaly Detectors.” IEEE Geoscience and Remote Sensing Letters 11 (1): 323–327. https://doi.org/10.1109/LGRS.2013.2257670.
  • Paszke, A., S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, Z. Lin, A. Desmaison, L. Antiga, and A. Lerer. 2017. “Automatic Differentiation in Pytorch.” NIPS-W.
  • Pepe, M. 2000. “Receiver Operating Characteristic Methodology.” Journal of the American Statistical Association 95 (449): 308–311. https://doi.org/10.1080/01621459.2000.10473930.
  • Pirnay, J., and K. Chai. 2021. “Inpainting Transformer for Anomaly Detection.” CoRr. abs/2104.13897.
  • Quintano, C., A. Fernández-Manso, Y. E. Shimabukuro, and G. Pereira. 2012. “Spectral Unmixing.” International Journal of Remote Sensing 33 (17): 5307–5340. https://doi.org/10.1080/01431161.2012.661095.
  • Qu, Y., W. Wang, R. Guo, B. Ayhan, C. Kwan, S. Vance, and H. Qi. 2018. “Hyperspectral Anomaly Detection Through Spectral Unmixing and Dictionary-Based Low-Rank Decomposition.” IEEE Transactions on Geoscience and Remote Sensing 56 (8): 4391–4405. https://doi.org/10.1109/TGRS.2018.2818159.
  • Reed, I., and X. Yu. 1990. “Adaptive Multiple-Band Cfar Detection of an Optical Pattern with Unknown Spectral Distribution.” IEEE Transactions on Acoustics, Speech, and Signal Processing 38 (10): 1760–1770. https://doi.org/10.1109/29.60107.
  • Ren, L., Z. Ma, F. Bovolo, J. Hu, and L. Bruzzone. 2022. “Hyperspectral Unmixing Using Weighted Sparse Regression with Total Variation Regularization.” International Journal of Remote Sensing 43 (15–16): 6124–6151. https://doi.org/10.1080/01431161.2021.2018151.
  • Sabokrou, M., M. Khalooei, M. Fathy, and E. Adeli 2018. “Adversarially Learned One-Class Classifier for Novelty Detection.” In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 3379–3388.
  • Schaum, A. 2004. “Joint Subspace Detection of Hyperspectral Targets.” In 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720), Big Sky, MT, USA 3:1824.
  • Tao, R., X. Zhao, W. Li, H. C. Li, and Q. Du. 2019. “Hyperspectral Anomaly Detection by Fractional Fourier Entropy.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 12 (12): 4920–4929. https://doi.org/10.1109/JSTARS.2019.2940278.
  • Wang, Q., Q. Li, and X. Li. 2019. “Hyperspectral Band Selection via Adaptive Subspace Partition Strategy.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 12 (12): 4940–4950. https://doi.org/10.1109/JSTARS.2019.2941454.
  • Wang, Q., Q. Li, and X. Li. 2021. “A Fast Neighborhood Grouping Method for Hyperspectral Band Selection.” IEEE Transactions on Geoscience and Remote Sensing 59 (6): 5028–5039. https://doi.org/10.1109/TGRS.2020.3011002.
  • Wang, S., X. Wang, L. Zhang, and Y. Zhong. 2022. “Auto-Ad: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder.” IEEE Transactions on Geoscience and Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2021.3057721.
  • Xiang, P., H. Zhou, H. Li, S. Song, W. Tan, J. Song, and L. Gu. 2020. “Hyperspectral Anomaly Detection by Local Joint Subspace Process and Support Vector Machine.” International Journal of Remote Sensing 41 (10): 3798–3819. https://doi.org/10.1080/01431161.2019.1708504.
  • Xie, W., T. Jiang, Y. Li, X. Jia, and J. Lei. 2019. “Structure Tensor and Guided Filtering-Based Algorithm for Hyperspectral Anomaly Detection.” IEEE Transactions on Geoscience and Remote Sensing 57 (7): 4218–4230. https://doi.org/10.1109/TGRS.2018.2890212.
  • Xie, W., Y. Li, J. Lei, J. Yang, C.-I. Chang, and Z. Li. 2020. “Hyperspectral Band Selection for Spectral–Spatial Anomaly Detection.” IEEE Transactions on Geoscience & Remote Sensing 58 (5): 3426–3436. https://doi.org/10.1109/TGRS.2019.2956159.
  • Xie, W., X. Zhang, Y. Li, J. Lei, J. Li, and Q. Du. 2021. “Weakly Supervised Low-Rank Representation for Hyperspectral Anomaly Detection.” IEEE Transactions on Cybernetics 51 (8): 3889–3900. https://doi.org/10.1109/TCYB.2021.3065070.
  • Xue, W., L. Zhang, X. Mou, and A. C. Bovik. 2014. “Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index.” IEEE Transactions on Image Processing 23 (2): 684–695. https://doi.org/10.1109/TIP.2013.2293423.
  • Xu, Y., Z. Wu, J. Li, A. Plaza, and Z. Wei. 2016. “Anomaly Detection in Hyperspectral Images Based on Low-Rank and Sparse Representation.” IEEE Transactions on Geoscience and Remote Sensing 54 (4): 1990–2000. https://doi.org/10.1109/TGRS.2015.2493201.
  • Zhang, G., N. Li, B. Tu, Z. Liao, and Y. Peng. 2020. “Hyperspectral Anomaly Detection via Dual Collaborative Representation.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:4881–4894. https://doi.org/10.1109/JSTARS.2020.3009324.
  • Zhao, K., Q. Han, C. Bin Zhang, J. Xu, and M. Ming Cheng 2021. “Deep Hough Transform for Semantic Line Detection.” In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
  • Zhao, C., X. Li, and H. Zhu. 2017. “Hyperspectral Anomaly Detection Based on Stacked Denoising Autoencoders.” Journal of Applied Remote Sensing 11 (4): 1–19. https://doi.org/10.1117/1.JRS.11.042605.
  • Zhao, W., D. Wu, and Y. Liu. 2021. “Hyperspectral Image Classification with Multi-Scale Graph Convolution Network.” International Journal of Remote Sensing 42 (21): 8380–8397. https://doi.org/10.1080/01431161.2021.1978585.
  • Zhou, T., and D. Tao 2011. “Godec: Randomized Low-Rank Sparse Matrix Decomposition in Noisy Case.” In Proceedings of the 28th International Conference on International Conference on Machine Learning, ICML’11, 33–40. Madison, WI, USA: Omnipress.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.