A comprehensive evaluation of disturbance agent classification approaches: Strengths of ensemble classification, multiple indices, spatio-temporal variables, and direct prediction

Katsuto Shimizu, Tetsuji Ota, Nobuya Mizoue, Shigejiro Yoshida

Research output: Contribution to journalArticle

Abstract

Landsat time series images are used for the detection of forest disturbance and the classification of causal agents. Various studies have classified disturbance agents with respect to forest disturbance detected using Landsat time series images. However, the accuracy of the finally classified disturbance agents in different approaches is rarely evaluated. In this study, we investigated the effectiveness of using ensemble classification, and multiple spectral and spatio-temporal information for the accuracy of the classification of disturbance agents in two-stage prediction (i.e., disturbance agents are classified with respect to the detected disturbance) and direct prediction (i.e., disturbance agents are directly classified from Landsat temporal information). Predictor variables were derived from the results of the trajectory-based temporal segmentation of five spectral indices using an annual Landsat time series (2000–2018). We compared six approaches of classifying disturbance agents. For two-stage prediction, we investigated four disturbance detection approaches: threshold-based detection with a single spectral index, random forest (RF) model with a single spectral index, RF model with multiple spectral indices, and RF model with spatio-temporal variables. The detected disturbance pixels were aggregated to disturbance patches and classified into disturbance agents. For direct prediction, two RF models one with only temporal variables and the other with spatio-temporal variables were constructed to classify pixel-based disturbance agents. The overall accuracy of the RF model using spatio-temporal variables for direct prediction was 92.4% and significantly higher than that of the RF model for two-stage prediction (90.9%). The use of an RF model based only on a single spectral index in disturbance detection was not effective for improving accuracy compared with threshold-based detection; however, the use of an RF model based on multiple spectral indices in disturbance detection improved the accuracy of the final classification of disturbance agents. Introducing spatial variables in RF models was effective for improving the overall classification accuracy in pixel-based direct prediction. However, it was not necessary in two-stage prediction because of spatial information contained in the patches. Although a spatially discontinuous appearance was observed for the RF model for directly classifying disturbance agents, this could be an alternative approach to two-stage prediction when considering the relative classification performance and simplicity of implementation.

Original languageEnglish
Pages (from-to)99-112
Number of pages14
JournalISPRS Journal of Photogrammetry and Remote Sensing
Volume158
DOIs
Publication statusPublished - Dec 2019

Fingerprint

disturbances
disturbance
evaluation
prediction
predictions
Time series
Pixels
Landsat
index
pixel
pixels
time series
classifying
Trajectories
thresholds
segmentation
detection
trajectory
trajectories

All Science Journal Classification (ASJC) codes

  • Atomic and Molecular Physics, and Optics
  • Engineering (miscellaneous)
  • Computer Science Applications
  • Computers in Earth Sciences

Cite this

@article{319f183f797045699b7c03519671e25b,
title = "A comprehensive evaluation of disturbance agent classification approaches: Strengths of ensemble classification, multiple indices, spatio-temporal variables, and direct prediction",
abstract = "Landsat time series images are used for the detection of forest disturbance and the classification of causal agents. Various studies have classified disturbance agents with respect to forest disturbance detected using Landsat time series images. However, the accuracy of the finally classified disturbance agents in different approaches is rarely evaluated. In this study, we investigated the effectiveness of using ensemble classification, and multiple spectral and spatio-temporal information for the accuracy of the classification of disturbance agents in two-stage prediction (i.e., disturbance agents are classified with respect to the detected disturbance) and direct prediction (i.e., disturbance agents are directly classified from Landsat temporal information). Predictor variables were derived from the results of the trajectory-based temporal segmentation of five spectral indices using an annual Landsat time series (2000–2018). We compared six approaches of classifying disturbance agents. For two-stage prediction, we investigated four disturbance detection approaches: threshold-based detection with a single spectral index, random forest (RF) model with a single spectral index, RF model with multiple spectral indices, and RF model with spatio-temporal variables. The detected disturbance pixels were aggregated to disturbance patches and classified into disturbance agents. For direct prediction, two RF models one with only temporal variables and the other with spatio-temporal variables were constructed to classify pixel-based disturbance agents. The overall accuracy of the RF model using spatio-temporal variables for direct prediction was 92.4{\%} and significantly higher than that of the RF model for two-stage prediction (90.9{\%}). The use of an RF model based only on a single spectral index in disturbance detection was not effective for improving accuracy compared with threshold-based detection; however, the use of an RF model based on multiple spectral indices in disturbance detection improved the accuracy of the final classification of disturbance agents. Introducing spatial variables in RF models was effective for improving the overall classification accuracy in pixel-based direct prediction. However, it was not necessary in two-stage prediction because of spatial information contained in the patches. Although a spatially discontinuous appearance was observed for the RF model for directly classifying disturbance agents, this could be an alternative approach to two-stage prediction when considering the relative classification performance and simplicity of implementation.",
author = "Katsuto Shimizu and Tetsuji Ota and Nobuya Mizoue and Shigejiro Yoshida",
year = "2019",
month = "12",
doi = "10.1016/j.isprsjprs.2019.10.004",
language = "English",
volume = "158",
pages = "99--112",
journal = "ISPRS Journal of Photogrammetry and Remote Sensing",
issn = "0924-2716",
publisher = "Elsevier",

}

TY - JOUR

T1 - A comprehensive evaluation of disturbance agent classification approaches

T2 - Strengths of ensemble classification, multiple indices, spatio-temporal variables, and direct prediction

AU - Shimizu, Katsuto

AU - Ota, Tetsuji

AU - Mizoue, Nobuya

AU - Yoshida, Shigejiro

PY - 2019/12

Y1 - 2019/12

N2 - Landsat time series images are used for the detection of forest disturbance and the classification of causal agents. Various studies have classified disturbance agents with respect to forest disturbance detected using Landsat time series images. However, the accuracy of the finally classified disturbance agents in different approaches is rarely evaluated. In this study, we investigated the effectiveness of using ensemble classification, and multiple spectral and spatio-temporal information for the accuracy of the classification of disturbance agents in two-stage prediction (i.e., disturbance agents are classified with respect to the detected disturbance) and direct prediction (i.e., disturbance agents are directly classified from Landsat temporal information). Predictor variables were derived from the results of the trajectory-based temporal segmentation of five spectral indices using an annual Landsat time series (2000–2018). We compared six approaches of classifying disturbance agents. For two-stage prediction, we investigated four disturbance detection approaches: threshold-based detection with a single spectral index, random forest (RF) model with a single spectral index, RF model with multiple spectral indices, and RF model with spatio-temporal variables. The detected disturbance pixels were aggregated to disturbance patches and classified into disturbance agents. For direct prediction, two RF models one with only temporal variables and the other with spatio-temporal variables were constructed to classify pixel-based disturbance agents. The overall accuracy of the RF model using spatio-temporal variables for direct prediction was 92.4% and significantly higher than that of the RF model for two-stage prediction (90.9%). The use of an RF model based only on a single spectral index in disturbance detection was not effective for improving accuracy compared with threshold-based detection; however, the use of an RF model based on multiple spectral indices in disturbance detection improved the accuracy of the final classification of disturbance agents. Introducing spatial variables in RF models was effective for improving the overall classification accuracy in pixel-based direct prediction. However, it was not necessary in two-stage prediction because of spatial information contained in the patches. Although a spatially discontinuous appearance was observed for the RF model for directly classifying disturbance agents, this could be an alternative approach to two-stage prediction when considering the relative classification performance and simplicity of implementation.

AB - Landsat time series images are used for the detection of forest disturbance and the classification of causal agents. Various studies have classified disturbance agents with respect to forest disturbance detected using Landsat time series images. However, the accuracy of the finally classified disturbance agents in different approaches is rarely evaluated. In this study, we investigated the effectiveness of using ensemble classification, and multiple spectral and spatio-temporal information for the accuracy of the classification of disturbance agents in two-stage prediction (i.e., disturbance agents are classified with respect to the detected disturbance) and direct prediction (i.e., disturbance agents are directly classified from Landsat temporal information). Predictor variables were derived from the results of the trajectory-based temporal segmentation of five spectral indices using an annual Landsat time series (2000–2018). We compared six approaches of classifying disturbance agents. For two-stage prediction, we investigated four disturbance detection approaches: threshold-based detection with a single spectral index, random forest (RF) model with a single spectral index, RF model with multiple spectral indices, and RF model with spatio-temporal variables. The detected disturbance pixels were aggregated to disturbance patches and classified into disturbance agents. For direct prediction, two RF models one with only temporal variables and the other with spatio-temporal variables were constructed to classify pixel-based disturbance agents. The overall accuracy of the RF model using spatio-temporal variables for direct prediction was 92.4% and significantly higher than that of the RF model for two-stage prediction (90.9%). The use of an RF model based only on a single spectral index in disturbance detection was not effective for improving accuracy compared with threshold-based detection; however, the use of an RF model based on multiple spectral indices in disturbance detection improved the accuracy of the final classification of disturbance agents. Introducing spatial variables in RF models was effective for improving the overall classification accuracy in pixel-based direct prediction. However, it was not necessary in two-stage prediction because of spatial information contained in the patches. Although a spatially discontinuous appearance was observed for the RF model for directly classifying disturbance agents, this could be an alternative approach to two-stage prediction when considering the relative classification performance and simplicity of implementation.

UR - http://www.scopus.com/inward/record.url?scp=85073761715&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073761715&partnerID=8YFLogxK

U2 - 10.1016/j.isprsjprs.2019.10.004

DO - 10.1016/j.isprsjprs.2019.10.004

M3 - Article

AN - SCOPUS:85073761715

VL - 158

SP - 99

EP - 112

JO - ISPRS Journal of Photogrammetry and Remote Sensing

JF - ISPRS Journal of Photogrammetry and Remote Sensing

SN - 0924-2716

ER -