Advanced search
Publication Cover
Geo-spatial Information Science Latest Articles
Submit an article Journal homepage
264
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Vegetation classification in a subtropical region with Sentinel-2 time series data and deep learning

Ming Zhanga Institute of Geography, Fujian Normal University, Fuzhou, China;b Key Laboratory for Humid Subtropical Eco-Geographical Processes of the Ministry of Education, Fujian Normal University, Fuzhou, ChinaORCID Iconhttps://orcid.org/0009-0009-2742-6822View further author information
ORCID Icon,
Dengqiu Lia Institute of Geography, Fujian Normal University, Fuzhou, China;b Key Laboratory for Humid Subtropical Eco-Geographical Processes of the Ministry of Education, Fujian Normal University, Fuzhou, ChinaCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0002-9839-759XView further author information
ORCID Icon,
Guiying Lia Institute of Geography, Fujian Normal University, Fuzhou, China;b Key Laboratory for Humid Subtropical Eco-Geographical Processes of the Ministry of Education, Fujian Normal University, Fuzhou, ChinaORCID Iconhttps://orcid.org/0000-0001-7198-4607View further author information
ORCID Icon &
Dengsheng Lua Institute of Geography, Fujian Normal University, Fuzhou, China;b Key Laboratory for Humid Subtropical Eco-Geographical Processes of the Ministry of Education, Fujian Normal University, Fuzhou, China;c Fujian Provincial Engineering Research Center for Forest Carbon Metering, Fujian Normal University, Fuzhou, ChinaORCID Iconhttps://orcid.org/0000-0003-4767-5710View further author information
ORCID Icon
Received 12 Jun 2023, Accepted 25 Mar 2024, Published online: 01 May 2024

References

  • Brooks, E. B., V. A. Thomas, R. H. Wynne, and J. W. Coulston. 2012. “Fitting the Multitemporal Curve: A Fourier Series Approach to the Missing Data Problem in Remote Sensing Analysis.” IEEE Transactions on Geoscience & Remote Sensing 50 (9): 3340–3353. https://doi.org/10.1109/TGRS.2012.2183137.
  • Cai, Y., K. Guan, P. Jian, S. Wang, C. Seifert, B. Wardlow, and L. Zhan. 2018. “A High-Performance and In-Season Classification System of Field-Level Crop Types Using Time-Series Landsat Data and a Machine Learning Approach.” Remote Sensing of Environment 210:35–47. https://doi.org/10.1016/j.rse.2018.02.045.
  • Chelali, M., C. Kurtz, A. Puissant, and N. Vincent. 2021. “Deep-StaR: Classification of Image Time Series Based on Spatio-Temporal Representations.” Computer Vision and Image Understanding 208:103221. https://doi.org/10.1016/j.cviu.2021.103221.
  • Deng, X., S. Guo, L. Sun, and J. Chen. 2020. “Identification of Short-Rotation Eucalyptus Plantation at Large Scale Using Multi-Satellite Imageries and Cloud Computing Platform.” Remote Sensing 12 (13): 2153. https://doi.org/10.3390/rs12132153.
  • Dias, D., U. Dias, N. Menini, R. Lamparelli, G. L. Maire, and R. D. S. Torres. 2020. “Image-Based Time Series Representations for Pixelwise Eucalyptus Region Classification: A Comparative Study.” IEEE Geoscience & Remote Sensing Letters 17 (8): 1450–1454. https://doi.org/10.1109/LGRS.2019.2946951.
  • Dias, D., A. Pinto, U. Dias, R. Lamparelli, G. L. Maire, and R. D. S. Torres. 2020. “A Multirepresentational Fusion of Time Series for Pixelwise Classification.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 13:4399–4409. https://doi.org/10.1109/JSTARS.2020.3012117.
  • Dou, P., H. Shen, Z. Li, and X. Guan. 2021. “Time Series Remote Sensing Image Classification Framework Using Combination of Deep Learning and Multiple Classifiers System.” International Journal of Applied Earth Observation and Geoinformation 103 (1): 102477. https://doi.org/10.1016/j.jag.2021.102477.
  • Eckmann, J. P., S. O. Kamphorst, and D. Ruelle. 1987. “Recurrence Plots of Dynamical Systems.” Europhysics Letters 4 (9): 973–977. https://doi.org/10.1209/0295-5075/4/9/004.
  • Fang, F., B. E. McNeil, T. A. Warner, A. E. Maxwell, G. A. Dahle, E. Eutsler, and J. Li. 2020. “Discriminating Tree Species at Different Taxonomic Levels Using Multi-Temporal WorldView-3 Imagery in Washington D.C., USA.” Remote Sensing of Environment 246:111811. https://doi.org/10.1016/j.rse.2020.111811.
  • Fawaz, H. I., G. Forestier, J. Weber, L. Idoumghar, and P. A. Muller. 2019. “Deep Learning for Time Series Classification: A Review.” Data Mining and Knowledge Discovery 33 (4): 917–963. https://doi.org/10.1007/s10618-019-00619-1.
  • Franklin, S. E., O. S. Ahmed, M. A. Wulder, J. C. White, T. Hermosilla, and N. C. Coops. 2015. “Large Area Mapping of Annual Land Cover Dynamics Using Multitemporal Change Detection and Classification of Landsat Time Series Data.” Canadian Journal of Remote Sensing 41 (4): 293–314. https://doi.org/10.1080/07038992.2015.1089401.
  • Gómez, C., J. C. White, and M. A. Wulder. 2016. “Optical Remotely Sensed Time Series Data for Land Cover Classification: A Review.” ISPRS Journal of Photogrammetry & Remote Sensing 116:55–72. https://doi.org/10.1016/j.isprsjprs.2016.03.008.
  • Gong, P., H. Liu, M. Zhang, C. Li, J. Wang, H. Huang, N. Clinton, et al. 2019. “Stable Classification with Limited Sample: Transferring a 30-M Resolution Sample Set Collected in 2015 to Mapping 10-M Resolution Global Land Cover in 2017.” Science Bulletin 64 (6): 370–373. https://doi.org/10.1016/j.scib.2019.03.002.
  • Gong, P., X. Li, J. Wang, Y. Bai, B. Chen, T. Hu, X. Liu, et al. 2020. “Annual Maps of Global Artificial Impervious Area (GAIA) Between 1985 and 2018.” Remote Sensing of Environment 236:111510. https://doi.org/10.1016/j.rse.2019.111510.
  • Grings, F., E. Roitberg, and V. Barraza. 2019. “EVI Time-Series Breakpoint Detection Using Convolutional Networks for Online Deforestation Monitoring in Chaco Forest.” IEEE Transactions on Geoscience & Remote Sensing 58 (2): 1303–1312. https://doi.org/10.1109/TGRS.2019.2945719.
  • Hakkenberg, C. R., M. P. Dannenberg, C. Song, and K. B. Ensor. 2019. “Characterizing Multi-Decadal, Annual Land Cover Change Dynamics in Houston, TX Based on Automated Classification of Landsat Imagery.” International Journal of Remote Sensing 40 (2): 693–718. https://doi.org/10.1080/01431161.2018.1516318.
  • Hamida, A. B., A. Benoit, P. Lambert, and C. B. Amar. 2018. “3-D Deep Learning Approach for Remote Sensing Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 56 (8): 4420–4434. https://doi.org/10.1109/TGRS.2018.2818945.
  • Hinton, G. E., and S. Roweis. 2002. “Stochastic Neighbor Embedding.” In Proceedings of the 15th International Conference on Neural Information Processing Systems (NIPS), Cambridge, MA, 857–864. MIT Press. https://dl.acm.org/doi/10.5555/2968618.2968725.
  • Huang, Z., L. Zhong, F. Zhao, J. Wu, H. Tang, Z. Lv, B. Xu, L. Zhou, R. Sun, and R. Meng. 2023. “A Spectral-Temporal Constrained Deep Learning Method for Tree Species Mapping of Plantation Forests Using Time Series Sentinel-2 Imagery.” ISPRS Journal of Photogrammetry & Remote Sensing 204:397–420. https://doi.org/10.1016/j.isprsjprs.2023.09.009.
  • Ienco, D., R. Gaetano, C. Dupaquier, and P. Maurel. 2017. “Land Cover Classification via Multitemporal Spatial Data by Deep Recurrent Neural Networks.” IEEE Geoscience and Remote Sensing Letters 14 (10): 1685–1689. https://doi.org/10.1109/LGRS.2017.2728698.
  • Ienco, D., R. Interdonato, R. Gaetano, and D. H. T. Minh. 2019. “Combining Sentinel-1 and Sentinel-2 Satellite Image Time Series for Land Cover Mapping via a Multi-Source Deep Learning Architecture.” ISPRS Journal of Photogrammetry & Remote Sensing 158:11–22. https://doi.org/10.1016/j.isprsjprs.2019.09.016.
  • Interdonato, R., D. Ienco, R. Gaetano, and K. Ose. 2019. “DuPLO: A DUal View Point Deep Learning Architecture for Time Series Classification.” ISPRS Journal of Photogrammetry & Remote Sensing 149:91–104. https://doi.org/10.1016/j.isprsjprs.2019.01.011.
  • Lattari, F., A. Rucci, and M. Matteucci. 2022. “A Deep Learning Approach for Change Points Detection in InSAR Time Series.” IEEE Transactions on Geoscience & Remote Sensing 60:1–16. https://doi.org/10.1109/TGRS.2022.3155969.
  • Li, D., D. Lu, Y. Wu, and K. Luo. 2022. “Retrieval of Eucalyptus Planting History and Stand Age Using Random Localization Segmentation and Continuous Land-Cover Classification Based on Landsat Time-Series Data.” GIScience & Remote Sensing 59 (1): 1426–1445. https://doi.org/10.1080/15481603.2022.2118440.
  • Li, X., W. Zhu, Z. Xie, P. Zhan, X. Huang, L. Sun, and Z. Duan. 2021. “Assessing the Effects of Time Interpolation of NDVI Composites on Phenology Trend Estimation.” Remote Sensing 13 (24): 5018. https://doi.org/10.3390/rs13245018.
  • Menini, N., A. E. Almeida, R. Lamparelli, G. L. Maire, J. A. D. Santos, H. Pedrini, M. Hirota, and R. D. S. Torres. 2018. “A Soft Computing Framework for Image Classification Based on Recurrence Plots.” IEEE Geoscience & Remote Sensing Letters 16 (2): 320–324. https://doi.org/10.1109/LGRS.2018.2872132.
  • Moskolaï, W. R., W. Abdou, and A. Dipanda. 2021. “Application of Deep Learning Architectures for Satellite Image Time Series Prediction: A Review.” Remote Sensing 13 (23): 4822. https://doi.org/10.3390/rs13234822.
  • Pasquarella, V. J., C. E. Holden, L. Kaufman, and C. E. Woodcock. 2016. “From Imagery to Ecology: Leveraging Time Series of All Available Landsat Observations to Map and Monitor Ecosystem State and Dynamics.” Remote Sensing in Ecology and Conservation 2 (3): 152–170‬. https://doi.org/10.1002/rse2.24‬.‬‬‬‬‬‬‬‬‬‬‬‬‬.
  • Pelletier, C., G. I. Webb, and F. Petitjean. 2019. “Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series.” Remote Sensing 11 (5): 523. https://doi.org/10.3390/rs11050523.
  • Pringle, M. J., M. Schmidt, and J. S. Muir. 2009. “Geostatistical Interpolation of SLC-Off Landsat ETM+ Images.” ISPRS Journal of Photogrammetry & Remote Sensing 64 (6): 654–664. https://doi.org/10.1016/j.isprsjprs.2009.06.001.
  • Rad, A. M., D. Ashourloo, H. S. Shahrabi, and H. Nematollahi. 2019. “Developing an Automatic Phenology-Based Algorithm for Rice Detection Using Sentinel-2 Time-Series Data.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 12 (5): 1471–1481. https://doi.org/10.1109/JSTARS.2019.2906684.
  • Rußwurm, M., and M. Körner. 2020. “Self-Attention for Raw Optical Satellite Time Series Classification.” ISPRS Journal of Photogrammetry & Remote Sensing 169:421–435. https://doi.org/10.1016/j.isprsjprs.2020.06.006.
  • Schafer, R. W. 2011. “What Is a Savitzky-Golay Filter?” IEEE Signal Processing Magazine 28 (4): 111–117. https://doi.org/10.1109/MSP.2011.941097.
  • Sedukhin, S., Y. Tomioka, and K. Yamamoto. 2022. “In Search of the Performance-And Energy-Efficient CNN Accelerators.” IEICE Transactions on Electronics 105 (6): 209–221. https://doi.org/10.1587/transele.2021LHP0003.
  • Senf, C., P. J. Leitão, D. Pflugmacher, S. V. D. Linden, and P. Hostert. 2015. “Mapping Land Cover in Complex Mediterranean Landscapes Using Landsat: Improved Classification Accuracies from Integrating Multi-Seasonal and Synthetic Imagery.” Remote Sensing of Environment 156:527–536. https://doi.org/10.1016/j.rse.2014.10.018.
  • Shao, Y., and R. S. Lunetta. 2012. “Comparison of Support Vector Machine, Neural Network, and CART Algorithms for the Land-Cover Classification Using Limited Training Data Points.” ISPRS Journal of Photogrammetry & Remote Sensing 70:78–87. https://doi.org/10.1016/j.isprsjprs.2012.04.001.
  • Shen, H., X. Li, Q. Cheng, C. Zeng, G. Yang, H. Li, and L. Zhang. 2015. “Missing Information Reconstruction of Remote Sensing Data: A Technical Review.” IEEE Geoscience and Remote Sensing Magazine 3 (3): 61–85. https://doi.org/10.1109/MGRS.2015.2441912.
  • Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. 2015. “Going Deeper with Convolutions.” In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 1–9. Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/CVPR.2015.7298594.
  • Tan, Z., Z. Tan, J. Luo, and H. Duan. 2023. “Mapping 30-M Cotton Areas Based on an Automatic Sample Selection and Machine Learning Method Using Landsat and MODIS Images.” Geo-Spatial Information Science. Advance online publication. https://doi.org/10.1080/10095020.2023.2275622.
  • Tarasiou, M., E. Chavez, and S. Zafeiriou. 2023. “ViTs for SITS: Vision Transformers for Satellite Image Time Series.” In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada. Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/CVPR52729.2023.01004.
  • Tariq, A., J. Yan, A. S. Gagnon, M. R. Khan, and F. Mumtaz. 2023. “Mapping of Cropland, Cropping Patterns and Crop Types by Combining Optical Remote Sensing Images with Decision Tree Classifier and Random Forest.” Geo-Spatial Information Science 26 (3): 302–320. https://doi.org/10.1080/10095020.2022.2100287.
  • Thiel, M., M. C. Romano, and J. Kurths. 2004. “How Much Information Is Contained in a Recurrence Plot?” Physics Letters: A 330 (5): 343–349. https://doi.org/10.1016/j.physleta.2004.07.050.
  • Torre, D. M. G. D., J. Gao, C. Macinnis-Ng, and Y. Shi. 2021. “Phenology-Based Delineation of Irrigated and Rain-Fed Paddy Fields with Sentinel-2 Imagery in Google Earth Engine.” Geo-Spatial Information Science 24 (4): 695–710. https://doi.org/10.1080/10095020.2021.1984183.
  • Tran, K. H., X. Zhang, A. R. Ketchpaw, J. Wang, Y. Ye, and Y. Shen. 2022. “A Novel Algorithm for the Generation of Gap-Free Time Series by Fusing Harmonized Landsat 8 and Sentinel-2 Observations with PhenoCam Time Series for Detecting Land Surface Phenology.” Remote Sensing of Environment 282:113275. https://doi.org/10.1016/j.rse.2022.113275.
  • Turkoglu, M. O., S. D’Aronco, G. Perich, F. Liebisch, C. Streit, K. Schindler, and J. D. Wegner. 2021. “Crop Mapping from Image Time Series: Deep Learning with Multi-Scale Label Hierarchies.” Remote Sensing of Environment 264:112603. https://doi.org/10.1016/j.rse.2021.112603.
  • Vrieling, A., M. Meroni, R. Darvishzadeh, A. K. Skidmore, T. Wang, R. Zurita-Milla, K. Oosterbeek, B. O’Connor, and M. Paganini. 2018. “Vegetation Phenology from Sentinel-2 and Field Cameras for a Dutch Barrier Island.” Remote Sensing of Environment 215:517–529. https://doi.org/10.1016/j.rse.2018.03.014.
  • Weerakody, P. B., K. W. Wong, G. Wang, and W. Ela. 2021. “A Review of Irregular Time Series Data Handling with Gated Recurrent Neural Networks.” Neurocomputing 441:161–178. https://doi.org/10.1016/j.neucom.2021.02.046.
  • Wen, Q., T. Zhou, C. Zhang, W. Chen, Z. Ma, J. Yan, and L. Sun. 2023. “Transformers in Time Series: A Survey.” In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI), Macao, P.R. China, 6778–6786. Morgan Kaufmann. https://doi.org/10.24963/ijcai.2023/759.
  • White, M. A., K. Beurs, K. Didan, D. W. Inouye, and O. P. Jensen. 2009. “Intercomparison, Interpretation, and Assessment of Spring Phenology in North America Estimated from Remote Sensing for 1982–2006.” Global Change Biology 15 (10): 2335–2359. https://doi.org/10.1111/j.1365-2486.2009.01910.x.
  • Wolberg, G., and I. Alfy. 1999. “Monotonic Cubic Spline Interpolation.” In Proceedings Computer Graphics International, Canmore, Canada, 188–195. Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/CGI.1999.777953.
  • Wulder, M. A., D. P. Roy, V. C. Radeloff, T. R. Loveland, M. C. Anderson, D. M. Johnson, S. Healey, et al. 2022. “Fifty Years of Landsat Science and Impacts.” Remote Sensing of Environment 280:113195. https://doi.org/10.1016/j.rse.2022.113195.
  • Xiao, C., E. Choi, and J. Sun. 2018. “Opportunities and Challenges in Developing Deep Learning Models Using Electronic Health Records Data: A Systematic Review.” Journal of the American Medical Informatics Association 25 (10): 1419–1428. https://doi.org/10.1093/jamia/ocy068.
  • Xu, J. F., Y. Zhu, R. H. Zhong, Z. X. Lin, J. L. Xu, H. Jiang, J. F. Huang, H. F. Li, and T. Lin. 2020. “DeepCropmapping: A Multi-Temporal Deep Learning Approach with Improved Spatial Generalizability for Dynamic Corn and Soybean Mapping.” Remote Sensing of Environment 247:111946. https://doi.org/10.1016/j.rse.2020.111946.
  • Yan, J., J. Liu, L. Wang, D. Liang, Q. Cao, W. Zhang, and J. Peng. 2022. “Land-Cover Classification with Time-Series Remote Sensing Images by Complete Extraction of Multiscale Timing Dependence.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 15:1953–1967. https://doi.org/10.1109/JSTARS.2022.3150430.
  • Yan, L., and D. P. Roy. 2018. “Large-Area Gap Filling of Landsat Reflectance Time Series by Spectral-Angle-Mapper Based Spatio-Temporal Similarity (SAMSTS).” Remote Sensing 10 (4): 609. https://doi.org/10.3390/rs10040609.
  • Yan, L., and D. P. Roy. 2020. “Spatially and Temporally Complete Landsat Reflectance Time Series Modelling: The Fill-And-Fit Approach.” Remote Sensing of Environment 241:111718. https://doi.org/10.1016/j.rse.2020.111718.
  • Yan, J., L. Wang, H. He, D. Liang, W. Song, and W. Han. 2022. “Large-Area Land-Cover Changes Monitoring with Time-Series Remote Sensing Images Using Transferable Deep Models.” IEEE Transactions on Geoscience & Remote Sensing 60:1–17. https://doi.org/10.1109/TGRS.2022.3160617.
  • Yuan, Y., and L. Lin. 2020. “Self-Supervised Pretraining of Transformers for Satellite Image Time Series Classification.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 14:474–487. https://doi.org/10.1109/JSTARS.2020.3036602.
  • Yuan, Y., L. Lin, Q. Liu, R. Hang, and Z. G. Zhou. 2022. “SITS-Former: A Pre-Trained Spatio-Spectral-Temporal Representation Model for Sentinel-2 Time Series Classification.” International Journal of Applied Earth Observation and Geoinformation 106:102651. https://doi.org/10.1016/j.jag.2021.102651.
  • Yu, X., J. Pan, M. Wang, and J. Xu. 2023. “A Curvature-Driven Cloud Removal Method for Remote Sensing Images.” Geo-Spatial Information Science 25 (2): 278–294. https://doi.org/10.1080/10095020.2023.2189462.
  • Zhang, X., L. Liu, T. Zhao, X. Chen, S. Lin, J. Wang, J. Mi, and W. Liu. 2023. “GWL_FCS30: A Global 30 M Wetland Map with a Fine Classification System Using Multi-Sourced and Time-Series Remote Sensing Imagery in 2020.” Earth System Science Data 15 (1): 265–293. https://doi.org/10.5194/essd-15-265-2023.
  • Zhang, Y., D. Lu, X. Jiang, Y. Li, and D. Li. 2023. “Forest Structure Simulation of Eucalyptus Plantation Using Remote-Sensing-Based Forest Age Data and 3-PG Model.” Remote Sensing 15 (1): 183. https://doi.org/10.3390/rs15010183.
  • Zhang, Z., M. Zhang, J. Gong, X. Hu, H. Xiong, H. Zhou, and Z. Cao. 2023. “LuoJiaAI: A Cloud-Based Artificial Intelligence Platform for Remote Sensing Image Interpretation.” Geo-Spatial Information Science 26 (2): 218–241. https://doi.org/10.1080/10095020.2022.2162980.
  • Zhong, L., L. Hu, and H. Zhou. 2019. “Deep Learning Based Multi-Temporal Crop Classification.” Remote Sensing of Environment 221:430–443. https://doi.org/10.1016/j.rse.2018.11.032.
  • Zhu, X., and D. Liu. 2014. “Accurate Mapping of Forest Types Using Dense Seasonal Landsat Time-Series.” ISPRS Journal of Photogrammetry & Remote Sensing 96:1–11. https://doi.org/10.1016/j.isprsjprs.2014.06.012.
  • Zhu, Z., M. A. Wulder, D. P. Roy, C. E. Woodcock, M. C. Hansen, V. C. Radeloff, S. P. Healey, et al. 2019. “Benefits of the Free and Open Landsat Data Policy.” Remote Sensing of Environment 224:382–385. https://doi.org/10.1016/j.rse.2019.02.016.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.