Supervised image classification of multi-spectral images based on statistical machine learning

Ryuei Nishii, Shinto Eguchi

Research output: Chapter in Book/Report/Conference proceedingChapter

1 Citation (Scopus)

Abstract

Image classification for geostatistical data is one of the most important issues in the remote-sensing community. Statistical approaches have been discussed extensively in the literature. In particular, Markov random fields (MRFs) are used for modeling distributions of land-cover classes, and contextual classifiers based on MRFs exhibit efficient performances. In addition, various classification methods were proposed. See Ref. [3] for an excellent review paper on classification. See also Refs. [1,4-7] for a general discussion on classification methods, and Refs. [8,9] for backgrounds on spatial statistics. In a paradigm of supervised learning, AdaBoost was proposed as a machine learning technique in Ref. [10] and has been widely and rapidly improved for use in pattern recognition. AdaBoost linearly combines several weak classifiers into a strong classifier. The coefficients of the classifiers are tuned by minimizing an empirical exponential risk. The classification method exhibits high performance in various fields [11,12]. In addition, fusion techniques have been discussed [13-15]. In the present chapter, we consider contextual classification methods based on statistics and machine learning. We review AdaBoost with binary class labels as well as multi-class labels. The procedures for deriving coefficients for classifiers are discussed, and robustness for loss functions is emphasized here. Next, contextual image classification methods including Switzer’s smoothing method [1], MRF-based methods [16], and spatial boosting [2,17] are introduced. Relationships among them are also pointed out. Spatial parallel boost by meta-learning for multi-source and multi-temporal data classification is proposed. The remainder of the chapter is organized as follows. In Section 4.2, AdaBoost is briefly reviewed. A simple example with binary class labels is provided to illustrate AdaBoost. Then, we proceed to the case with multi-class labels. Section 4.3 gives general boosting methods to obtain the robustness property of the classifier. Then, contextual classifiers including Switzer’s method, an MRF-based method, and spatial boosting are discussed. Relationships among them are shown in Section 4.5. The exact error rate and the properties of the MRF-based classifier are given. Section 4.6 proposes spatial parallel boost applicable to classification of multi-source and multi-temporal data sets. The methods treated here are applied to a synthetic data set and two benchmark data sets, and the performances are examined in Section 4.7. Section 4.8 concludes the chapter and mentions future problems.

Original languageEnglish
Title of host publicationImage Processing for Remote Sensing
PublisherCRC Press
Pages79-106
Number of pages28
ISBN (Electronic)9781420066654
ISBN (Print)1420066641, 9781420066647
Publication statusPublished - Jan 1 2007

Fingerprint

multispectral image
Image classification
Learning systems
Classifiers
Adaptive boosting
Labels
image classification
Statistics
machine learning
supervised image classification
method
Supervised learning
Pattern recognition
Remote sensing
pattern recognition
Fusion reactions
smoothing
land cover
learning
remote sensing

All Science Journal Classification (ASJC) codes

  • Engineering(all)
  • Earth and Planetary Sciences(all)

Cite this

Nishii, R., & Eguchi, S. (2007). Supervised image classification of multi-spectral images based on statistical machine learning. In Image Processing for Remote Sensing (pp. 79-106). CRC Press.

Supervised image classification of multi-spectral images based on statistical machine learning. / Nishii, Ryuei; Eguchi, Shinto.

Image Processing for Remote Sensing. CRC Press, 2007. p. 79-106.

Research output: Chapter in Book/Report/Conference proceedingChapter

Nishii, R & Eguchi, S 2007, Supervised image classification of multi-spectral images based on statistical machine learning. in Image Processing for Remote Sensing. CRC Press, pp. 79-106.
Nishii R, Eguchi S. Supervised image classification of multi-spectral images based on statistical machine learning. In Image Processing for Remote Sensing. CRC Press. 2007. p. 79-106
Nishii, Ryuei ; Eguchi, Shinto. / Supervised image classification of multi-spectral images based on statistical machine learning. Image Processing for Remote Sensing. CRC Press, 2007. pp. 79-106
@inbook{31157ccf0b0f4ccd8117a974c7f1919c,
title = "Supervised image classification of multi-spectral images based on statistical machine learning",
abstract = "Image classification for geostatistical data is one of the most important issues in the remote-sensing community. Statistical approaches have been discussed extensively in the literature. In particular, Markov random fields (MRFs) are used for modeling distributions of land-cover classes, and contextual classifiers based on MRFs exhibit efficient performances. In addition, various classification methods were proposed. See Ref. [3] for an excellent review paper on classification. See also Refs. [1,4-7] for a general discussion on classification methods, and Refs. [8,9] for backgrounds on spatial statistics. In a paradigm of supervised learning, AdaBoost was proposed as a machine learning technique in Ref. [10] and has been widely and rapidly improved for use in pattern recognition. AdaBoost linearly combines several weak classifiers into a strong classifier. The coefficients of the classifiers are tuned by minimizing an empirical exponential risk. The classification method exhibits high performance in various fields [11,12]. In addition, fusion techniques have been discussed [13-15]. In the present chapter, we consider contextual classification methods based on statistics and machine learning. We review AdaBoost with binary class labels as well as multi-class labels. The procedures for deriving coefficients for classifiers are discussed, and robustness for loss functions is emphasized here. Next, contextual image classification methods including Switzer’s smoothing method [1], MRF-based methods [16], and spatial boosting [2,17] are introduced. Relationships among them are also pointed out. Spatial parallel boost by meta-learning for multi-source and multi-temporal data classification is proposed. The remainder of the chapter is organized as follows. In Section 4.2, AdaBoost is briefly reviewed. A simple example with binary class labels is provided to illustrate AdaBoost. Then, we proceed to the case with multi-class labels. Section 4.3 gives general boosting methods to obtain the robustness property of the classifier. Then, contextual classifiers including Switzer’s method, an MRF-based method, and spatial boosting are discussed. Relationships among them are shown in Section 4.5. The exact error rate and the properties of the MRF-based classifier are given. Section 4.6 proposes spatial parallel boost applicable to classification of multi-source and multi-temporal data sets. The methods treated here are applied to a synthetic data set and two benchmark data sets, and the performances are examined in Section 4.7. Section 4.8 concludes the chapter and mentions future problems.",
author = "Ryuei Nishii and Shinto Eguchi",
year = "2007",
month = "1",
day = "1",
language = "English",
isbn = "1420066641",
pages = "79--106",
booktitle = "Image Processing for Remote Sensing",
publisher = "CRC Press",

}

TY - CHAP

T1 - Supervised image classification of multi-spectral images based on statistical machine learning

AU - Nishii, Ryuei

AU - Eguchi, Shinto

PY - 2007/1/1

Y1 - 2007/1/1

N2 - Image classification for geostatistical data is one of the most important issues in the remote-sensing community. Statistical approaches have been discussed extensively in the literature. In particular, Markov random fields (MRFs) are used for modeling distributions of land-cover classes, and contextual classifiers based on MRFs exhibit efficient performances. In addition, various classification methods were proposed. See Ref. [3] for an excellent review paper on classification. See also Refs. [1,4-7] for a general discussion on classification methods, and Refs. [8,9] for backgrounds on spatial statistics. In a paradigm of supervised learning, AdaBoost was proposed as a machine learning technique in Ref. [10] and has been widely and rapidly improved for use in pattern recognition. AdaBoost linearly combines several weak classifiers into a strong classifier. The coefficients of the classifiers are tuned by minimizing an empirical exponential risk. The classification method exhibits high performance in various fields [11,12]. In addition, fusion techniques have been discussed [13-15]. In the present chapter, we consider contextual classification methods based on statistics and machine learning. We review AdaBoost with binary class labels as well as multi-class labels. The procedures for deriving coefficients for classifiers are discussed, and robustness for loss functions is emphasized here. Next, contextual image classification methods including Switzer’s smoothing method [1], MRF-based methods [16], and spatial boosting [2,17] are introduced. Relationships among them are also pointed out. Spatial parallel boost by meta-learning for multi-source and multi-temporal data classification is proposed. The remainder of the chapter is organized as follows. In Section 4.2, AdaBoost is briefly reviewed. A simple example with binary class labels is provided to illustrate AdaBoost. Then, we proceed to the case with multi-class labels. Section 4.3 gives general boosting methods to obtain the robustness property of the classifier. Then, contextual classifiers including Switzer’s method, an MRF-based method, and spatial boosting are discussed. Relationships among them are shown in Section 4.5. The exact error rate and the properties of the MRF-based classifier are given. Section 4.6 proposes spatial parallel boost applicable to classification of multi-source and multi-temporal data sets. The methods treated here are applied to a synthetic data set and two benchmark data sets, and the performances are examined in Section 4.7. Section 4.8 concludes the chapter and mentions future problems.

AB - Image classification for geostatistical data is one of the most important issues in the remote-sensing community. Statistical approaches have been discussed extensively in the literature. In particular, Markov random fields (MRFs) are used for modeling distributions of land-cover classes, and contextual classifiers based on MRFs exhibit efficient performances. In addition, various classification methods were proposed. See Ref. [3] for an excellent review paper on classification. See also Refs. [1,4-7] for a general discussion on classification methods, and Refs. [8,9] for backgrounds on spatial statistics. In a paradigm of supervised learning, AdaBoost was proposed as a machine learning technique in Ref. [10] and has been widely and rapidly improved for use in pattern recognition. AdaBoost linearly combines several weak classifiers into a strong classifier. The coefficients of the classifiers are tuned by minimizing an empirical exponential risk. The classification method exhibits high performance in various fields [11,12]. In addition, fusion techniques have been discussed [13-15]. In the present chapter, we consider contextual classification methods based on statistics and machine learning. We review AdaBoost with binary class labels as well as multi-class labels. The procedures for deriving coefficients for classifiers are discussed, and robustness for loss functions is emphasized here. Next, contextual image classification methods including Switzer’s smoothing method [1], MRF-based methods [16], and spatial boosting [2,17] are introduced. Relationships among them are also pointed out. Spatial parallel boost by meta-learning for multi-source and multi-temporal data classification is proposed. The remainder of the chapter is organized as follows. In Section 4.2, AdaBoost is briefly reviewed. A simple example with binary class labels is provided to illustrate AdaBoost. Then, we proceed to the case with multi-class labels. Section 4.3 gives general boosting methods to obtain the robustness property of the classifier. Then, contextual classifiers including Switzer’s method, an MRF-based method, and spatial boosting are discussed. Relationships among them are shown in Section 4.5. The exact error rate and the properties of the MRF-based classifier are given. Section 4.6 proposes spatial parallel boost applicable to classification of multi-source and multi-temporal data sets. The methods treated here are applied to a synthetic data set and two benchmark data sets, and the performances are examined in Section 4.7. Section 4.8 concludes the chapter and mentions future problems.

UR - http://www.scopus.com/inward/record.url?scp=84951871418&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84951871418&partnerID=8YFLogxK

M3 - Chapter

AN - SCOPUS:84951871418

SN - 1420066641

SN - 9781420066647

SP - 79

EP - 106

BT - Image Processing for Remote Sensing

PB - CRC Press

ER -