> Landsat program represents the world's longest continuously acquired collection of spacebased moderate-resolution land remote sensing data. So far, the sensors include the Landsat1-5 Multispectral Scanners (MSS), the Landsat 5 Thematic Mapper (TM) and the Landsat 7 Enhanced Thematic Mapper Plus (ETM+). The Landsat imagery with nearly four decades (from 1972 to present, see Fig.1) provides a unique resource for researchers and common users who work in agriculture, geology, forestry, regional planning, education, mapping, and global change research. Currently, both Landsat 5 and Landsat 7 are still being operated in orbit for data collection, although they have exceeded the expected service time and always readily experienced malfunction.

> The scan-line corrector (SLC) for the ETM+ sensor, on board the Landsat 7 satellite, failed permanently on May 31, 2003. Normally,the SLC compensates for the forward motion of the satellite. Under the abnormal situation, without an operating SLC, images have wedgeshaped gaps that range from a single pixel in width near the nadir point, to about 12 pixels towards the edges of the scene. The SLC anomaly results in about 22% pixels in these images are un-scanned. The consequence of the SLC failure (called SLC-off problem) hampers the use of the Landsat 7 ETM+ data. At the same time, Landsat 5 has suffered problems with its solar array drive which have affected data availability. It suggests that Landsat 5 would be at the end of its operational life and not be reliable on as a source of future imagery (Pringle et al., 2009). Additionally, TM sensor onboard the Landsat 5 has been suspended from 2011 November resulted from the failure of its electronic component vital to the data transmission, according to the news provided by the U.S. Geological Survey (USGS). The Landsat Data Continuity Mission (LDCM), to be called Landsat 8, which is regarded as a successor of the preliminary series (e.g. the Landsat 1-4, Landsat 5, and

© 2012 Chen et al., licensee InTech. This is an open access chapter distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. © 2012 The Author(s). Licensee InTech. This chapter is distributed under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### 318 Data Acquisition Applications

Landsat 7), will be launched in December 2012 or January 2013 according to the passed schedule. Under the condition that no replacement of Landsat or Landsat-like sensor from the LDCM has been launched presently, along with the sensors failures mentioned above, there would be a period of data gap, probably ranging from 2003 to 2013. Fortunately, SLCoff has not affected the radiometric and geometric quality of the sensor, with approximately 80% of the pixels in each image being scanned (The USGS & National Aeronautics Space Administration [NASA], 2003). Although the SLC anomalies produce obviously negative impacts on the post-event Landsat 7 ETM+ data usability, for some applications the SLC-off ETM+ retains significant and important utility for scientific applications and some users still prefer these data over more costly alternatives (USGS & NASA, 2003). In order to resolve the SLC-off problem and enable the continuous usage of ETM+, we must find suitable way to estimate the values at un-scanned pixels.

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 319

researches. For example, Reza and Ali (2008) used IRS products to recover the SLC-off ETM+ image, while Boloorani et al (2008a) and F. Chen et al (2010) demonstrated the possibility of estimating un-scanned pixels in SLC-off image by using EO-1/ALI and CBERS data as auxiliary information, respectively. Furthermore, Roy et al (2008) used the information observed by MODIS to calculate reflectance of the missing pixels, although the spatial

Recovering procedures based on other concepts or methodologies were also discussed separately. Multi-scale segmentation approach was developed by Maxwell et al (2007) to fill gaps in the Landsat 7 SLC-off ETM+ images. By means of the geostatistical techniques, in which kriging or co-kriging was used, not only the value of the un-scanned pixels can be estimated, but also the uncertainty of the prediction can be quantified (Zhang et al.,2007; Pringle et al.,2009). Boloorani et al (2008b) developed a methodology called 'projection transformation'. A simple but effective method was proposed by J. Chen et al (2011) to fill the gaps, in which information about the neighbourhood similar pixels were incorporated for estimating the target un-scanned pixel. The recovered accuracy was improved

As mentioned above, researches have been conducted widely for issues associated with recovering the Landsat 7 SLC-off ETM+ image, by interested individuals, institutions or organizations. However, while much attention has been paid to the reconstruction of its multispectral bands (e.g. visible and near infrared ones), few researches have been done to recover its thermal infrared band, although this band has been used widely, such as for urban heat island (X. L. Chen et al., 2006; Rajasekar & Weng, 2009), water environment (Wloczyk et al., 2006), volcanic activity (Flynn et al., 2001). Thus, the thermal infrared band of SLC-off ETM+ image should be useful for scientific applications, provided that a suitable recovering procedure is implemented(F. Chen et al., 2011). The modified AWLHM method was preliminarily proposed for recovering the thermal infrared band of Landsat 7 SLC-off ETM+ image, while the multispectral bands of CBERS were used as auxiliary data (F. Chen et al., 2011). Results illustrated this methodology's availability for getting brightness temperature directly from the SLC-off thermal infrared band. However, overestimation and

Moreover, in 2008, the USGS made a decision to make the Landsat standard data products freely available through the internet, which was served as a watershed event in the history of the Landsat program. This policy has triggered more and more studies by using Landsat series data, which had been limited previously by data costs and processing requirements. As stated by Wulder & Masek (2012), a special emphasis is placed on the burgeoning scientific and applications opportunities enabled by free access to the US archive, such as use of dense time-series data to characterize inter- and intra-annual land cover changes, new capabilities for continental-scale mapping, and applications focused on particular information needs. Meanwhile, the LDCM program, including the approaching launch of Landsat 8, and the proposed Landsat 9 and Landsat 10, will make sure the future continuity of the Landsat series, which is critical for understanding the Earth system and for providing a scientific basis for land management in the future. Nevertheless, the data gap for valid

resolution of MODIS sensor is much coarser than that of Landsat 7 ETM+.

consequently, especially in heterogeneous landscape areas (J. Chen et al., 2011).

underestimation were presented in cooler and warmer areas, respectively.

**Figure 1.** Landsat missions' timeline and their current status (modified for illustration, originally obtained from USGS (*http://landsat.usgs.gov/about\_mission\_history.php*))

Soon after SLC-off occurred, a report was compiled by the USGS (USGS & NASA, 2003). It suggested that, at the un-canned location, the reflectance of a particular ETM+ band could be estimated by compositing the target image, the SLC-off one need to be recovered, with the corresponding band of laterally overlapping ETM+ images, SLC-off or SLC-on ETM+ images (called fill image) of the same area from other dates (USGS & NASA, 2003). The means and the variances of the bands in the additional images can be adjusted, either globally or locally, to the means and variances of the bands in a target image (USGS & NASA, 2003). Based on this assumption, an expert group organized by the USGS proposed several recovering methodologies to tackle this issue, including global linear histogram match (GLHM), localized linear histogram match (LLHM), and adaptive window linear histogram match (AWLHM) (Scaramuzza et al.,2003; USGS & NASA, 2004). These methods are simple and easily to be put into application. Therefore, the un-scanned pixels in the SLCoff ETM+ images are able to be recovered with acceptable accuracy, given that the input scenes (the target and fill ones) are provided with high quality and represent comparable seasonal conditions (USGS & NASA, 2004).

However, in practice, there are shortcomings associated with these original methods, of which, the most obvious one is the restrict requirement on selecting the fill image (F. Chen et al., 2010). Thus, as an alternative to those methods, it is possible to use the information from a sensor other than ETM+, which is observed at the close time as a SLC-off ETM+ image, to estimate the un-scanned pixels. This assumption has been verified by several previous researches. For example, Reza and Ali (2008) used IRS products to recover the SLC-off ETM+ image, while Boloorani et al (2008a) and F. Chen et al (2010) demonstrated the possibility of estimating un-scanned pixels in SLC-off image by using EO-1/ALI and CBERS data as auxiliary information, respectively. Furthermore, Roy et al (2008) used the information observed by MODIS to calculate reflectance of the missing pixels, although the spatial resolution of MODIS sensor is much coarser than that of Landsat 7 ETM+.

318 Data Acquisition Applications

estimate the values at un-scanned pixels.

seasonal conditions (USGS & NASA, 2004).

Landsat 7), will be launched in December 2012 or January 2013 according to the passed schedule. Under the condition that no replacement of Landsat or Landsat-like sensor from the LDCM has been launched presently, along with the sensors failures mentioned above, there would be a period of data gap, probably ranging from 2003 to 2013. Fortunately, SLCoff has not affected the radiometric and geometric quality of the sensor, with approximately 80% of the pixels in each image being scanned (The USGS & National Aeronautics Space Administration [NASA], 2003). Although the SLC anomalies produce obviously negative impacts on the post-event Landsat 7 ETM+ data usability, for some applications the SLC-off ETM+ retains significant and important utility for scientific applications and some users still prefer these data over more costly alternatives (USGS & NASA, 2003). In order to resolve the SLC-off problem and enable the continuous usage of ETM+, we must find suitable way to

**Figure 1.** Landsat missions' timeline and their current status (modified for illustration, originally

Soon after SLC-off occurred, a report was compiled by the USGS (USGS & NASA, 2003). It suggested that, at the un-canned location, the reflectance of a particular ETM+ band could be estimated by compositing the target image, the SLC-off one need to be recovered, with the corresponding band of laterally overlapping ETM+ images, SLC-off or SLC-on ETM+ images (called fill image) of the same area from other dates (USGS & NASA, 2003). The means and the variances of the bands in the additional images can be adjusted, either globally or locally, to the means and variances of the bands in a target image (USGS & NASA, 2003). Based on this assumption, an expert group organized by the USGS proposed several recovering methodologies to tackle this issue, including global linear histogram match (GLHM), localized linear histogram match (LLHM), and adaptive window linear histogram match (AWLHM) (Scaramuzza et al.,2003; USGS & NASA, 2004). These methods are simple and easily to be put into application. Therefore, the un-scanned pixels in the SLCoff ETM+ images are able to be recovered with acceptable accuracy, given that the input scenes (the target and fill ones) are provided with high quality and represent comparable

However, in practice, there are shortcomings associated with these original methods, of which, the most obvious one is the restrict requirement on selecting the fill image (F. Chen et al., 2010). Thus, as an alternative to those methods, it is possible to use the information from a sensor other than ETM+, which is observed at the close time as a SLC-off ETM+ image, to estimate the un-scanned pixels. This assumption has been verified by several previous

obtained from USGS (*http://landsat.usgs.gov/about\_mission\_history.php*))

Recovering procedures based on other concepts or methodologies were also discussed separately. Multi-scale segmentation approach was developed by Maxwell et al (2007) to fill gaps in the Landsat 7 SLC-off ETM+ images. By means of the geostatistical techniques, in which kriging or co-kriging was used, not only the value of the un-scanned pixels can be estimated, but also the uncertainty of the prediction can be quantified (Zhang et al.,2007; Pringle et al.,2009). Boloorani et al (2008b) developed a methodology called 'projection transformation'. A simple but effective method was proposed by J. Chen et al (2011) to fill the gaps, in which information about the neighbourhood similar pixels were incorporated for estimating the target un-scanned pixel. The recovered accuracy was improved consequently, especially in heterogeneous landscape areas (J. Chen et al., 2011).

As mentioned above, researches have been conducted widely for issues associated with recovering the Landsat 7 SLC-off ETM+ image, by interested individuals, institutions or organizations. However, while much attention has been paid to the reconstruction of its multispectral bands (e.g. visible and near infrared ones), few researches have been done to recover its thermal infrared band, although this band has been used widely, such as for urban heat island (X. L. Chen et al., 2006; Rajasekar & Weng, 2009), water environment (Wloczyk et al., 2006), volcanic activity (Flynn et al., 2001). Thus, the thermal infrared band of SLC-off ETM+ image should be useful for scientific applications, provided that a suitable recovering procedure is implemented(F. Chen et al., 2011). The modified AWLHM method was preliminarily proposed for recovering the thermal infrared band of Landsat 7 SLC-off ETM+ image, while the multispectral bands of CBERS were used as auxiliary data (F. Chen et al., 2011). Results illustrated this methodology's availability for getting brightness temperature directly from the SLC-off thermal infrared band. However, overestimation and underestimation were presented in cooler and warmer areas, respectively.

Moreover, in 2008, the USGS made a decision to make the Landsat standard data products freely available through the internet, which was served as a watershed event in the history of the Landsat program. This policy has triggered more and more studies by using Landsat series data, which had been limited previously by data costs and processing requirements. As stated by Wulder & Masek (2012), a special emphasis is placed on the burgeoning scientific and applications opportunities enabled by free access to the US archive, such as use of dense time-series data to characterize inter- and intra-annual land cover changes, new capabilities for continental-scale mapping, and applications focused on particular information needs. Meanwhile, the LDCM program, including the approaching launch of Landsat 8, and the proposed Landsat 9 and Landsat 10, will make sure the future continuity of the Landsat series, which is critical for understanding the Earth system and for providing a scientific basis for land management in the future. Nevertheless, the data gap for valid Landsat 7 ETM+ data caused by the SLC-off problem, between 2003 and 2013, may prevent the full usage of the Landsat legacy to some extent.

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 321

**Figure 3.** Linear model for GLHM method (modified from document (Scaramuzza et al., 2003) for

*gain*

Where, X (also denoted 2 ( , , ,) *j j Lx y t b* in following sections) is the pixel value in the fill image, and Y (also denoted 1 ( , , ,) *j j Lx y t b* in the following sections) is the pixel value in the

of the target image; *X* is the mean of the fill image and *Y* is the mean of the target image.

When this transformation is applied to the entire image, it is called GLHM. GLHM is a very simple method, and all un-scanned pixels are estimated using the same gain and bias. It may perform well over scenes with invariant terrain such as deserts and rocky areas, but obviously visible errors are possible in scenes with transient. It is desirable to consider the inter-regional heterogeneity caused by factors such as atmosphere, topography, and land cover. For greater precision, gain and bias for estimating the un-scanned pixels can be calculated in a moving window around each un-scanned pixel, which is the original basis of

'Phase Two Methodology' is an enhancement of the 'Phase One Methodology', which allows users to choose multiple images and to combine SLC-off images (USGS & NASA, 2004). AWLHM is an improved version of the LLHM. The AWLHM is based on the same assumption as LLHM, except that the moving window size is changeable. To obtain the correlation (or gain and bias) statistically, the number of effective pixels used for estimating each un-scanned pixel should be considered. The moving window around each un-scanned pixel should be adaptive according to the distribution of commonly scanned pixels (Fig.4). Based on the AWLHM method, the recovered image can be obtained through iteration process over all un-scanned pixels in the target image. Iteration for one un-scanned pixel is

*X*

; *bias Y gainX* (1)

is the standard deviation

*Y gainX bias* with *Y*

is the standard deviation of the fill image, and *Y*

illustration)

target image; *X*

the LLHM.

**2.2. AWLHM method**

described as follows:

In conclusion, further researches concerned on recovering the Landsat 7 SLC-off ETM+ image is necessary, mainly due to valuable legacy of the Landsat series and the freely distributed policy. In this chapter, we intend to review and show several solutions for making full use of the Landsat 7 SLC-off ETM+ image based on actual conditions, followed by methods comparison and discussion on the usage of the recovered ETM+ images.

### **2. The recovering approaches**

As mentioned in the introduction (Section 1), different recovering approaches have been proposed based on different assumptions. Fig.2 shows an example of recovering SLC-off ETM+ image by using information from a precedent SLC-on ETM+ image. Under each ideal condition, recovered results were properly obtained, as illustrated in simulation studies. For practical application, these recovering approaches should be compared in depth, and thus the most suitable one should be selected at last.

**Figure 2.** An example of recovering SLC-off ETM+ image: top image: Pre-SLC anomaly scene (SLC-on), middle image: Scene after SLC anomaly (SLC-off), bottom image: Scene after SLC anomaly, with interpolation. (Obtained from *http://landsathandbook.gsfc.nasa.gov/sysper/*)

### **2.1. GLHM and LLHM method**

Soon after the SLC failed, experts from USGS initially provided two recovering methods, called GLHM and LLHM respectively, and they were served as the 'Phase One Methodology' (Scaramuzza et al., 2003).The basis for these methods is that linear relationship exists between one image and another, in view of band-by-band comparison, as shown in Fig.3. Generally, linear least squares estimate can be used to estimate the transformation parameters (e.g. gain and bias). For convenience, in the' Phase One Methodology', a simple procedure was adopted for calculating gain and bias (see equation (1)).

**Figure 3.** Linear model for GLHM method (modified from document (Scaramuzza et al., 2003) for illustration)

$$Y \approx \operatorname{gain} X + \text{bias} \quad \text{with} \quad \operatorname{gain} = \frac{\sigma\_Y}{\sigma\_X} \quad ; \text{ bias} = \overline{Y} - \operatorname{gain} \overline{X} \tag{1}$$

Where, X (also denoted 2 ( , , ,) *j j Lx y t b* in following sections) is the pixel value in the fill image, and Y (also denoted 1 ( , , ,) *j j Lx y t b* in the following sections) is the pixel value in the target image; *X* is the standard deviation of the fill image, and *Y* is the standard deviation of the target image; *X* is the mean of the fill image and *Y* is the mean of the target image.

When this transformation is applied to the entire image, it is called GLHM. GLHM is a very simple method, and all un-scanned pixels are estimated using the same gain and bias. It may perform well over scenes with invariant terrain such as deserts and rocky areas, but obviously visible errors are possible in scenes with transient. It is desirable to consider the inter-regional heterogeneity caused by factors such as atmosphere, topography, and land cover. For greater precision, gain and bias for estimating the un-scanned pixels can be calculated in a moving window around each un-scanned pixel, which is the original basis of the LLHM.

#### **2.2. AWLHM method**

320 Data Acquisition Applications

the full usage of the Landsat legacy to some extent.

**2. The recovering approaches**

the most suitable one should be selected at last.

Landsat 7 ETM+ data caused by the SLC-off problem, between 2003 and 2013, may prevent

In conclusion, further researches concerned on recovering the Landsat 7 SLC-off ETM+ image is necessary, mainly due to valuable legacy of the Landsat series and the freely distributed policy. In this chapter, we intend to review and show several solutions for making full use of the Landsat 7 SLC-off ETM+ image based on actual conditions, followed

As mentioned in the introduction (Section 1), different recovering approaches have been proposed based on different assumptions. Fig.2 shows an example of recovering SLC-off ETM+ image by using information from a precedent SLC-on ETM+ image. Under each ideal condition, recovered results were properly obtained, as illustrated in simulation studies. For practical application, these recovering approaches should be compared in depth, and thus

**Figure 2.** An example of recovering SLC-off ETM+ image: top image: Pre-SLC anomaly scene (SLC-on), middle image: Scene after SLC anomaly (SLC-off), bottom image: Scene after SLC anomaly, with

Soon after the SLC failed, experts from USGS initially provided two recovering methods, called GLHM and LLHM respectively, and they were served as the 'Phase One Methodology' (Scaramuzza et al., 2003).The basis for these methods is that linear relationship exists between one image and another, in view of band-by-band comparison, as shown in Fig.3. Generally, linear least squares estimate can be used to estimate the transformation parameters (e.g. gain and bias). For convenience, in the' Phase One Methodology', a simple procedure was adopted for calculating gain and bias (see equation

interpolation. (Obtained from *http://landsathandbook.gsfc.nasa.gov/sysper/*)

**2.1. GLHM and LLHM method**

(1)).

by methods comparison and discussion on the usage of the recovered ETM+ images.

'Phase Two Methodology' is an enhancement of the 'Phase One Methodology', which allows users to choose multiple images and to combine SLC-off images (USGS & NASA, 2004). AWLHM is an improved version of the LLHM. The AWLHM is based on the same assumption as LLHM, except that the moving window size is changeable. To obtain the correlation (or gain and bias) statistically, the number of effective pixels used for estimating each un-scanned pixel should be considered. The moving window around each un-scanned pixel should be adaptive according to the distribution of commonly scanned pixels (Fig.4). Based on the AWLHM method, the recovered image can be obtained through iteration process over all un-scanned pixels in the target image. Iteration for one un-scanned pixel is described as follows:

the maximum allowable gain, then calculate gain and bias using the mean and standard deviation, just like the method mentioned in the 'Phase One Methodology'(Scaramuzza

d. Estimate the value for the un-scanned pixel in the target SLC-off ETM+ image, using the

Complete this procedure for each un-scanned pixel in the target SLC-off ETM+ image, thus the recovered ETM+ image may be obtained. However, in some cases, there are still some un-scanned pixels remaining in the recovered image, resulted from many factors. Under this condition, the recovering procedure is need to be conducted again, and even several times, by assigning the lastly recovered image as target image and taking the other fill image or

Note that this method will encounter the problem for the proper window around the edges of the image, and expanding the extent of the image is needed thereby. In this study, a symmetrical extending procedure was implemented around the edges of the image with the length of 17 pixels, in order to make AWLHM available to estimate each un-scanned pixel

Compared with GLHM and LLHM, the AWLHM is more rational; however, poor results are potentially suffered if the images being combined exhibit radical differences in target radiance. At the same time, the AWLHM can perform well when adjust the temporal changes happened in homogeneous areas such as agricultural field, airport (F. Chen et al., 2010), but it has difficulty when the size of the areas exhibiting change is too small. Generally, features smaller than the local window size (normally 19×19 pixels) are difficult to model if significant change occurred. That is why fill data are typically better matched in the large agricultural fields typical of the American Midwest and West than in the smaller fields of the Northeast and, presumably, much of Europe and Asia (USGS & NASA, 2004).Taking into account the shortcomings for AWLHM, especially for heterogeneous landscape, J. Chen et al (2011) proposed an improved method, referred to as the Neighbourhood Similar Pixel Interpolator (NSPI). More details on the NSPI method will be

For obtaining recovered ETM+ image with good quality, selecting proper fill images is critical. According to the report written by USGS & NASA (2004), the most important criteria for selecting fill images are those related to the similarity of image content between the target and fill images. Any new data the similar fill image provide is likely to be of high quality, which will provide valuable additional information for transforming subsequent fill images. As suggested by USGS & NASA (2004), following guidelines for fill image selection

a. Select fill images that are as free of clouds as possible and that contain as few obvious

b. Select SLC-off images that are as close time to target image as possible to minimize changes in vegetation conditions. Failing this, select fill images that are as close to an anniversary

data as possible to take advantage of the similarities in seasonal vegetation cycles.

et al., 2003).

linear relationship (see equation. (1)).

given in next section (Section2.3).

are listed in order of priority:

changes in image as possible.

images to repeat the recovering process mentioned above.

including the marginal ones in the tested ETM+ SLC-off images.

**Figure 4.** Illustration of the adaptive moving window process, the red pixels is the un-scanned ones needed to be recovered, and the rectangles with red dash lines represent the window searching process, while the red rectangles are the lastly determined windows (modified from document (USGS & NASA, 2004), just for methodology but not exact)

the maximum allowable gain, then calculate gain and bias using the mean and standard deviation, just like the method mentioned in the 'Phase One Methodology'(Scaramuzza et al., 2003).

d. Estimate the value for the un-scanned pixel in the target SLC-off ETM+ image, using the linear relationship (see equation. (1)).

322 Data Acquisition Applications

2004), just for methodology but not exact)

results but impose a significant performance penalty.

Methodology', the minimum number is defined as 144.

**Figure 4.** Illustration of the adaptive moving window process, the red pixels is the un-scanned ones needed to be recovered, and the rectangles with red dash lines represent the window searching process, while the red rectangles are the lastly determined windows (modified from document (USGS & NASA,

a. Extract an n×n window around the un-scanned pixel which is need to be recovered, in both target and fill images. Larger windows were found to yield essentially identical

b. Find smallest square of pixels between the two blocks (windows in the fill image and the target one) which contains at least a minimum number of commonly scanned pixels (the valid data in both the target and fill images). Beginning with the smallest window size with 1×1 pixel, the number of valid common pixels between the target and the fill images is counted. If the minimum number of commonly scanned pixels is not met, the moving window size is expanded by one pixel on each side of the window. Then the commonly scanned pixels are counted again. The moving window is expanded gradually, with increasing size series, such as 3×3, 5×5, 7×7 ,…(Fig.4). Iteration continues until the minimum number of common pixels is met. If the minimum number of common pixels is not met before reaching the maximum extent of the window, all commonly scanned pixels in the moving window are used for obtaining the transformation parameters, regardless of the total number. In the 'Phase Two

c. Using the common pixels in the lastly determined moving window around the unscanned pixel, to estimate the bias and gain by means of the least squares solution for the linear equations, established based on the values of all selected common pixels in the moving window. It is necessary to check the estimated gain to see whether it is reasonable, and to prevent outliers from having a strong effect on the transform. If it is greater than the maximum allowable gain (Mgain) or less than the inverse (1/Mgain) of Complete this procedure for each un-scanned pixel in the target SLC-off ETM+ image, thus the recovered ETM+ image may be obtained. However, in some cases, there are still some un-scanned pixels remaining in the recovered image, resulted from many factors. Under this condition, the recovering procedure is need to be conducted again, and even several times, by assigning the lastly recovered image as target image and taking the other fill image or images to repeat the recovering process mentioned above.

Note that this method will encounter the problem for the proper window around the edges of the image, and expanding the extent of the image is needed thereby. In this study, a symmetrical extending procedure was implemented around the edges of the image with the length of 17 pixels, in order to make AWLHM available to estimate each un-scanned pixel including the marginal ones in the tested ETM+ SLC-off images.

Compared with GLHM and LLHM, the AWLHM is more rational; however, poor results are potentially suffered if the images being combined exhibit radical differences in target radiance. At the same time, the AWLHM can perform well when adjust the temporal changes happened in homogeneous areas such as agricultural field, airport (F. Chen et al., 2010), but it has difficulty when the size of the areas exhibiting change is too small. Generally, features smaller than the local window size (normally 19×19 pixels) are difficult to model if significant change occurred. That is why fill data are typically better matched in the large agricultural fields typical of the American Midwest and West than in the smaller fields of the Northeast and, presumably, much of Europe and Asia (USGS & NASA, 2004).Taking into account the shortcomings for AWLHM, especially for heterogeneous landscape, J. Chen et al (2011) proposed an improved method, referred to as the Neighbourhood Similar Pixel Interpolator (NSPI). More details on the NSPI method will be given in next section (Section2.3).

For obtaining recovered ETM+ image with good quality, selecting proper fill images is critical. According to the report written by USGS & NASA (2004), the most important criteria for selecting fill images are those related to the similarity of image content between the target and fill images. Any new data the similar fill image provide is likely to be of high quality, which will provide valuable additional information for transforming subsequent fill images. As suggested by USGS & NASA (2004), following guidelines for fill image selection are listed in order of priority:

c. Select fill images that provide good predicted un-scanned coverage based on the unscanned phase statistics.

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 325

2 2 ( )( ) *D xx yy jj j* (4)

(5)

( ) *b* is the standard deviation of the entire fill image for band *b*, and *m* is the number

of classes, which is a predefined value according to the complexity of the landscape.

similar pixels (M) is met, or the window reaches the maximum size.

*2.3.2. Calculation of the weights for similar pixels*

pixel is calculated by following equation:

*2.3.3. Calculation of the target pixel value*

Requirement for the minimum number (M) of similar pixels in the moving window is also need predefinition. Then, the initial moving window size can be estimated, and the number of selected similar pixels in this initial window is counted. Expanding the window iteratively, as described in Section 2.2,until either the requirement for minimum number of

The contribution of the selected similar pixels to the prediction of target pixel might vary according to their spectral similarity, temporal change difference and geographic distance related to the target pixel. Generally, similar pixels with higher spectral similarity and smaller distance to the target pixel are more important than other ones. The geographic distance between the j th similar pixel (,) *j j x y* and the target pixel (,) *x y* is calculated in

Then, the weight indicating the contribution of similar pixel j to the prediction of the target

*W RMSD D RMSD D*

The weight indicator *Wj* is a normalized one, with the range from 0 to 1. For the special situation, when some similar pixels have the same or distinct spectral characteristics as the target pixel, that is to say, their spectral similarities RMSD are 0, then the weight for the special pixels is set to an equal value, and all the information is given by these special

According to the statements by J. Chen et al (2011), two procedures can be used to estimate the target pixel value using the information provided by the similar pixels separately. However, the integrated value based on the two predictions is possibly more reliable (J.

The first method is based on the fact that the similar pixels have the same or at least approximate spectral value with the target pixel when they are observed at the same time, and the weighted average of all the similar pixels in the target image (SLC-off one) is

1 (1 / ( )) / 1 / ( ) *N j j j j j j*

Where,

Euclid space:

similar pixels.

Chen et al., 2011).

calculated.

### **2.3. NSPI method**

The NSPI method is a simple but effective one, for estimating the values of un-scanned pixels in SLC-off ETM+ image. It is based on the assumption that the same-class neighbouring pixels around the un-scanned pixel have similar spectral characteristics, and that these neighbouring pixels and un-scanned ones exhibit similar temporal change patterns. Thus,as found in the initial research based on simulated and actual experiments, the NSPI method can restore the value of un-scanned pixels very accurately, and even performs well in heterogeneous areas(J. Chen et al., 2011). Another advantage of the NSPI method is that it can work well even if there is a relatively long time interval or obvious spectral changes between the fill and target images. Compared with the original AWLHM method, the NSPI method incorporates several other sub- procedures, including selection of neighbouring similar pixels, calculation of the weights for similar pixels, calculation of the target pixel value in view of temporal differences.

#### *2.3.1. Selection of neighboring similar pixels*

As same as AWLHM method, all commonly scanned pixels in the determined adaptive moving window around the un-scanned pixel (target pixel) are selected. Then, similar pixels are selected from these common pixels based on spectral similarity, which is defined as root mean square deviation (RMSD) between each common pixel and the target one.

$$RMSD\_i = \sqrt{\frac{\sum\_{b=1}^{n} (L(x\_{i'}, y\_{i'}, t\_{1'}, b) - L(x\_{i'}, y\_{i'}, t\_{1'}, b))^2}{n}} \tag{2}$$

Where, 1 ( , , ,) *i i Lx y t b* are the value of common pixel i, which locates in ( , ) *i i x y* , in band b for the fill image acquired at time t1, while 1 *Lxyt b* (, , ,) is for the target pixel locating in (,) *x y* ; and n is the number of spectral bands. Larger RMSD value denotes larger spectral difference.

According to previous research conducted by Gao et al (2006), common pixels with lower RMSD values than the predefined threshold are identified as the similar ones:

$$RMSD\_i \le \left[ \sum\_{b=1}^n \sigma(b) \times 2 / m \right] / m \tag{3}$$

Where,( ) *b* is the standard deviation of the entire fill image for band *b*, and *m* is the number of classes, which is a predefined value according to the complexity of the landscape.

Requirement for the minimum number (M) of similar pixels in the moving window is also need predefinition. Then, the initial moving window size can be estimated, and the number of selected similar pixels in this initial window is counted. Expanding the window iteratively, as described in Section 2.2,until either the requirement for minimum number of similar pixels (M) is met, or the window reaches the maximum size.

#### *2.3.2. Calculation of the weights for similar pixels*

324 Data Acquisition Applications

**2.3. NSPI method**

difference.

scanned phase statistics.

target pixel value in view of temporal differences.

*2.3.1. Selection of neighboring similar pixels*

c. Select fill images that provide good predicted un-scanned coverage based on the un-

d. Select SLC-off fill images that are within +/-4 WRS cycles of the target image, if possible. e. For recovering image with multiple SLC-off images, including an anniversary date SLCon image as the final fill image is recommended as a way of ensuring good image

The NSPI method is a simple but effective one, for estimating the values of un-scanned pixels in SLC-off ETM+ image. It is based on the assumption that the same-class neighbouring pixels around the un-scanned pixel have similar spectral characteristics, and that these neighbouring pixels and un-scanned ones exhibit similar temporal change patterns. Thus,as found in the initial research based on simulated and actual experiments, the NSPI method can restore the value of un-scanned pixels very accurately, and even performs well in heterogeneous areas(J. Chen et al., 2011). Another advantage of the NSPI method is that it can work well even if there is a relatively long time interval or obvious spectral changes between the fill and target images. Compared with the original AWLHM method, the NSPI method incorporates several other sub- procedures, including selection of neighbouring similar pixels, calculation of the weights for similar pixels, calculation of the

As same as AWLHM method, all commonly scanned pixels in the determined adaptive moving window around the un-scanned pixel (target pixel) are selected. Then, similar pixels are selected from these common pixels based on spectral similarity, which is defined as root

*i i*

Where, 1 ( , , ,) *i i Lx y t b* are the value of common pixel i, which locates in ( , ) *i i x y* , in band b for the fill image acquired at time t1, while 1 *Lxyt b* (, , ,) is for the target pixel locating in (,) *x y* ; and n is the number of spectral bands. Larger RMSD value denotes larger spectral

According to previous research conducted by Gao et al (2006), common pixels with lower

1

*n*

2

(3)

(2)

1 1

( ( , , , ) ( , , , ))

*Lx y t b Lxyt b*

*n*

( ) 2/ /

mean square deviation (RMSD) between each common pixel and the target one.

1

RMSD values than the predefined threshold are identified as the similar ones:

*i b RMSD b m n*

*b*

*i*

*RMSD*

*n*

registration performance and providing complete un-scanned coverage.

The contribution of the selected similar pixels to the prediction of target pixel might vary according to their spectral similarity, temporal change difference and geographic distance related to the target pixel. Generally, similar pixels with higher spectral similarity and smaller distance to the target pixel are more important than other ones. The geographic distance between the j th similar pixel (,) *j j x y* and the target pixel (,) *x y* is calculated in Euclid space:

$$D\_j = \sqrt{(x\_j - x)^2 + (y\_j - y)^2} \tag{4}$$

Then, the weight indicating the contribution of similar pixel j to the prediction of the target pixel is calculated by following equation:

$$\mathcal{W}\_{\dot{\jmath}} = \{1/\{\text{RMSD}\_{\dot{\jmath}} \times D\_{\dot{\jmath}}\}\} / \sum\_{j=1}^{N} 1/\{\text{RMSD}\_{\dot{\jmath}} \times D\_{\dot{\jmath}}\} \tag{5}$$

The weight indicator *Wj* is a normalized one, with the range from 0 to 1. For the special situation, when some similar pixels have the same or distinct spectral characteristics as the target pixel, that is to say, their spectral similarities RMSD are 0, then the weight for the special pixels is set to an equal value, and all the information is given by these special similar pixels.

#### *2.3.3. Calculation of the target pixel value*

According to the statements by J. Chen et al (2011), two procedures can be used to estimate the target pixel value using the information provided by the similar pixels separately. However, the integrated value based on the two predictions is possibly more reliable (J. Chen et al., 2011).

The first method is based on the fact that the similar pixels have the same or at least approximate spectral value with the target pixel when they are observed at the same time, and the weighted average of all the similar pixels in the target image (SLC-off one) is calculated.

$$L\_1(\mathbf{x}, \mathbf{y}, t\_2, b) = \sum\_{j=1}^{N} W\_j \times L(\mathbf{x}\_{j'}, \mathbf{y}\_{j'}, t\_2, b) \tag{6}$$

principal component transformation (PCT), which can make new representative data sets of the original ones, is mathematically lossless and vigorous invertible transformation. Over the obtained new components, if transformation be carried out, the original data sets can be recovered with no loss. The PCT-gap-fill method is to recover the un-scanned areas in the target image based on the scanned pixels from the fill image. Generally, this recovering procedure is mainly based on forward and backward principle component transformations. When the target and the fill images both have been normalized, such as transformed to reflectance, the PCT-gap-fill method can be applied as follows (Boloorani et al., 2008b):

a. Extract the scanned pixels in the target SLC-off image, and calculate the needed

b. Extract the scanned pixels in the fill image, which were un-scanned in the target image, and apply the PCT to these selected pixels to get the transformed ones (denoted TFs). c. Inversely transform the TFs using the statistics obtained from the scanned pixels in the target image (in step a.),to make new values for those pixels (NITFs) in the fill image selected in step b, then the un-scanned pixels in the target image can be recovered by

The step a. is important, where the scanned pixels in the target image need to be selected carefully due to the crucial role they play in the recovering procedure. In fact, the pixels selected for transformation statistics can be gotten either from the whole scanned area in the fill image or some samples of it. As suggested by Boloorani et al (2008b), the selected samples must be the real representative of the physical phenomena from the land surface. The previously simulated experiment shows that the PCT-gap-fill method recovered the SLC-off image with higher accuracy than the LLHM method, and preserved the radiometric characteristics better even in the areas with sharp radiometric changes. However, the simulated result also demonstrated that the gap lines were still visible in areas with sharp radiometric differences. The findings from this analysis based on simulated SLC-off image, provide a new concept for recovering the Landsat 7 SLC-off ETM+ image by means of data transformation, such as PCT, which is able to estimate the un-scanned pixels fully using the multispectral bands (e.g. Band 1-5, 7). Therefore, it is possible that the values of one specific un-scanned pixel in all bands can be estimated simultaneously by inverted PCT. Nevertheless, some other methods just are able to recover the Landsat 7 SLC-off ETM+ image band-by-band. In view of convenience for application, this methodology based on transformation is a good choice, given that several related problems is tackled properly, such as for heterogeneous area with sharp radiometric difference, the incorporation of the

Initially, the GLHM, LLHM and AWLHM methods were developed based on the basic assumption that there is a linear relationship between the target image and the fill one or ones. Thus, several images (SLC-on or SLC-off) need to be selected properly as the fill images for recovering the target SLC-off ETM+ image. The most important criteria for

statistics for inverted PCT based on these pixels.

moving window tech.

**2.5. Geostatistical method**

means of setting the geospatially corresponding NITFs to them.

At the same time, it is rational that the value (e.g. radiance, reflectance) of the target pixel at t2 (the acquisition time of the target SLC-off image) is the sum of its value at t1 (the acquisition time of the fill image) and the temporal spectra difference between t1 and t2. It is also acceptable in most cases that the similar pixels undergo the similar temporal change as the target one. Then, the second method for estimating the target pixel value at t2 is developed, by using the change information provided by the similar pixels:

$$L\_2(\mathbf{x}, y, t\_2, b) = L(\mathbf{x}, y, t\_1, b) + \sum\_{j=1}^{N} W\_j \times (L(\mathbf{x}\_{j'}, y\_{j'}, t\_{2'}, b) - L(\mathbf{x}\_{j'}, y\_{j'}, t\_{1'}, b)) \tag{7}$$

Predicted values with more accuracy may be obtained by integrating these two estimated results, with a suitable weight framework, in which both the landscape heterogeneity and the temporal change are incorporated. In the work of J. Chen et al (2011), the averaged RMSD between the similar pixels and the target pixel (RMSD1, see equation (8)) was used to indicate the heterogeneity, while the averaged RMSD of similar pixels between observations at t1 and t2 (RMSD2, see equation(9)) is used to denote the temporal change between two images:

$$RMSD\_1 = \frac{1}{N} \sum\_{j=1}^{N} \sqrt{\left[\sum\_{b=1}^{n} (L(\mathbf{x}\_j, y\_j, t\_1, b) - L(\mathbf{x}, y, t\_1, b))^2\right]} / \,\mathrm{n} \tag{8}$$

$$RMSD\_2 = \frac{1}{N} \sum\_{j=1}^{N} \sqrt{\left[\sum\_{b=1}^{n} (L(\mathbf{x}\_{j'}, \mathbf{y}\_{j'}, t\_1, b) - L(\mathbf{x}\_{j'}, \mathbf{y}\_{j'}, t\_2, b))^2\right]} / n \tag{9}$$

The combined weights are calculated through a normalized process,shown as follows:

$$T\_1 = (1/RMSD\_1) / (1/RMSD\_1 + 1/RMSD\_2) \tag{10}$$

$$T\_2 = (1/RMSD\_2) / (1/RMSD\_1 + 1/RMSD\_2) \tag{11}$$

Finally, the estimated value for the target pixel is an integrated result combined two initial results and two combined weights:

$$L(\mathbf{x}, y, t\_2, b) = T\_1 \times L\_1(\mathbf{x}, y, t\_2, b) + T\_2 \times L\_2(\mathbf{x}, y, t\_2, b) \tag{12}$$

However, it is worth to note that when there is no similar pixel selected, the AWLHM method(see Section 2.2)can be applied to estimate the value of the un-scanned pixel.

#### **2.4. Projection transformation method**

A recovering method based on projection transformation was evaluated through a simulated experiment, which called the PCT-gap-fill method (Boloorani et al., 2008b). The principal component transformation (PCT), which can make new representative data sets of the original ones, is mathematically lossless and vigorous invertible transformation. Over the obtained new components, if transformation be carried out, the original data sets can be recovered with no loss. The PCT-gap-fill method is to recover the un-scanned areas in the target image based on the scanned pixels from the fill image. Generally, this recovering procedure is mainly based on forward and backward principle component transformations. When the target and the fill images both have been normalized, such as transformed to reflectance, the PCT-gap-fill method can be applied as follows (Boloorani et al., 2008b):

The step a. is important, where the scanned pixels in the target image need to be selected carefully due to the crucial role they play in the recovering procedure. In fact, the pixels selected for transformation statistics can be gotten either from the whole scanned area in the fill image or some samples of it. As suggested by Boloorani et al (2008b), the selected samples must be the real representative of the physical phenomena from the land surface. The previously simulated experiment shows that the PCT-gap-fill method recovered the SLC-off image with higher accuracy than the LLHM method, and preserved the radiometric characteristics better even in the areas with sharp radiometric changes. However, the simulated result also demonstrated that the gap lines were still visible in areas with sharp radiometric differences. The findings from this analysis based on simulated SLC-off image, provide a new concept for recovering the Landsat 7 SLC-off ETM+ image by means of data transformation, such as PCT, which is able to estimate the un-scanned pixels fully using the multispectral bands (e.g. Band 1-5, 7). Therefore, it is possible that the values of one specific un-scanned pixel in all bands can be estimated simultaneously by inverted PCT. Nevertheless, some other methods just are able to recover the Landsat 7 SLC-off ETM+ image band-by-band. In view of convenience for application, this methodology based on transformation is a good choice, given that several related problems is tackled properly, such as for heterogeneous area with sharp radiometric difference, the incorporation of the moving window tech.

### **2.5. Geostatistical method**

326 Data Acquisition Applications

between two images:

results and two combined weights:

**2.4. Projection transformation method**

1 2 2 1 (, , ,) ( , , ,) *N*

At the same time, it is rational that the value (e.g. radiance, reflectance) of the target pixel at t2 (the acquisition time of the target SLC-off image) is the sum of its value at t1 (the acquisition time of the fill image) and the temporal spectra difference between t1 and t2. It is also acceptable in most cases that the similar pixels undergo the similar temporal change as the target one. Then, the second method for estimating the target pixel value at t2 is

> 22 1 2 1 1 ( , , , ) ( , , , ) ( ( , , , ) ( , , , ))

Predicted values with more accuracy may be obtained by integrating these two estimated results, with a suitable weight framework, in which both the landscape heterogeneity and the temporal change are incorporated. In the work of J. Chen et al (2011), the averaged RMSD between the similar pixels and the target pixel (RMSD1, see equation (8)) was used to indicate the heterogeneity, while the averaged RMSD of similar pixels between observations at t1 and t2 (RMSD2, see equation(9)) is used to denote the temporal change

1 1 1

2 1 2

The combined weights are calculated through a normalized process,shown as follows:

*RMSD Lx y t b Lx y t b n N*

Finally, the estimated value for the target pixel is an integrated result combined two initial

However, it is worth to note that when there is no similar pixel selected, the AWLHM method(see Section 2.2)can be applied to estimate the value of the un-scanned pixel.

A recovering method based on projection transformation was evaluated through a simulated experiment, which called the PCT-gap-fill method (Boloorani et al., 2008b). The

*j j*

*RMSD Lx y t b Lxyt b n N*

1 ( ( , , , ) ( , , , )) /

1 ( ( , , , ) ( , , , )) /

*j j j j*

1 1

1 1

*j b*

*N n*

*j b*

*N n*

*N*

*j L xyt b Lxyt b W Lx y t b Lx y t b*

*j L xyt b W Lx y t b*

developed, by using the change information provided by the similar pixels:

*j jj*

*j jj j j*

(7)

(6)

2

2

(8)

(9)

1 1 12 *T RMSD RMSD RMSD* (1 / ) / (1 / 1 / ) (10)

2 2 12 *T RMSD RMSD RMSD* (1 / ) / (1 / 1 / ) (11)

2 11 2 22 2 *Lxyt b T L xyt b T L xyt b* (, , ,) (, , ,) (, , ,) (12)

Initially, the GLHM, LLHM and AWLHM methods were developed based on the basic assumption that there is a linear relationship between the target image and the fill one or ones. Thus, several images (SLC-on or SLC-off) need to be selected properly as the fill images for recovering the target SLC-off ETM+ image. The most important criteria for selecting suitable fill images are cloud free and associated with time interval. However,in fact, these criteria are difficult to meet, especially for regions with moist environment. Under this condition, the GLHM,LLHM and AWLHM methods are limited to use consequently. On the basis that the autocorrelation is one of the predominant phenomena in physical geography, pixels in a specific extent may correlate with each other to a certain degree. So, it is possible to estimate un-scanned pixels based on the pixel relationship rules within the image itself, and this methodology is served as interpolation. General interpolation methods, such as inverse distance weighted methods and triangulation methods may be not suitable for recovering un-scanned pixels in the SLC-off image, because information about spatial structure is not used fully by these interpolation methods. Understanding the magnitude and pattern in spatial variability is necessary for accurately interpolating the unscanned pixels. Zhang et al (2007) and Pringle et al (2009) discussed the possibility that using geostatistical techniques (e.g. kriging methods) to resolve the un-scanned pixels issue, which provides unbiased estimation with minimum and known error.

As mentioned above, the fundamental idea of geostatistics is the first law of geography, that spatial data from locations close to each other are more similar than data from locations far apart. Variogram used to indicate the spatial structure can be applied to estimate values at un-sampled locations (here, are un-scanned pixels in SLC-off ETM+ image).

Variogram model the spatial dependence in a regionalized variable *Z* (here is reflectance, radiance or digital number (DN) in SLC-off ETM+ image) under the 'intrinsic' hypothesis that the increments ( ( , , ) ( , ) *Zx y h Zx y ii ii* ) associated with a small distance h are weakly stationary (Zhang et al., 2007). For multispectral image, in practice, a semivariogram is computed using the values in each band, shown as follows:

$$\gamma(h) = \frac{1}{2N(h)} \sum\_{i=1}^{N(h)} \left[ Z(\mathbf{x}\_{i'} \boldsymbol{y}\_i) - Z(\mathbf{x}\_{i'} \boldsymbol{y}\_{i'} h) \right]^2 \tag{13}$$

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 329

1

*j x y*

*n OK*

(,)1

(15)

*j ii*

Mathematical models frequently used for fitting semivariogram include nugget effect model, spherical model, exponent model, Gaussian model and power model. At the same time, for fitting cross-semivariogram, the basic models usually used are linear, spherical and

Kriging is a family of generalized least-square regression algorithms that take advantage of the spatial dependence information given by the variogram. Ordinary kriging is the most common and robust one, which is able to rescale locally the random function model to a different mean value in different locations (Zhang et al., 2007). For estimating an un-scanned pixel ( , ) *i i x y* in the SLC-off ETM+ image, pixels locating in the local neighbourhood are only used, and the extent of the neighbourhood is determined by semivariogram. Therefore, the

with ( )

neighbourhood of pixel ( , ) *i i x y* , of which the value needs to be estimated, and n is the number of pixels locating in the neighbourhood of pixel ( , ) *i i x y* .The ordinary kriging

Cokriging is an extended version of kriging, which incorporates more than one variable in the estimating procedure. Thus, generally, it can improve the accuracy, particularly when the primary variable is sparse and poorly correlated in space compared to the secondary one. Both the autocorrelation in each variable and the cross-correlation between the variables are taken into consideration in cokriging method. The value of pixel ( , ) *i i x y* (denoted ( , ) *Z xy COK i i* ) estimated by means of cokriging method is expressed as follows:

( ) ( )

neighbourhood of pixel ( , ) *i i x y* for the primary variable, and n1 is the number of pixels locating in the neighbourhood of pixel ( , ) *i i x y* for the primary variable. Similarly,

 *x y* is the ordinary cokriging weight for the pixel jj locating in the neighbourhood of pixel ( , ) *i i x y* for the secondary variable, and n2 is the number of pixels locating in the

As illustrated above (see equations (15) and (16)), two procedures are needed for estimating the value of the un-scanned pixel in advance, including determining the extent of local neighbourhood and thereby the valid sampling pixels, and calculating the kriging weights

( , ) ( , )( , ) ( , ) ( , ) *n n COK COK COK i i j i i j j jj i i S jj jj*

 *x y Zx y xyZ x y*

*n COK*

2

1

*jj x y*

*x y* is the ordinary cokriging weight for the pixel j locating in the

(,)0

(16)

*jj i i*

estimator is unbiased by forcing the kriging weights to sum to 1(see equation (15)).

1 2

1 1

*j jj*

(,)1

and

*j ii*

*x y* is the ordinary kriging weight for the pixel j locating in the

value of pixel ( , ) *i i x y* (denoted ( , ) *Z xy OK i i* ) is estimated through a linear model:

( )

( , ) ( , )( , ) *n OK OK i i j i i j j*

1

1

*n COK*

1

*j x y*

neighbourhood of pixel ( , ) *i i x y* for the secondary variable.

*j Z x y x y Zx y*

exponential models.

Where, ( )(,) *OK*

*j ii*

*Z xy*

With

*j ii*

Where, ( )(,) *COK*

( )(,) *COK jj i i*

Where, *N h*( ) is the number of pairs of pixel locating with h apart, and distance h is defined in Euclidean space. The larger value of ( ) *h* indicate the pixel pairs distributing apart with h distance are less similar.

Similarly, in view of the two co-dependent variables, the joint spatial dependence is common, and is often modelled using a cross-semivariogram, shown as follows:

$$\gamma(h) = \frac{1}{2N(h)} \sum\_{i=1}^{N(h)} \left[ Z\_1(\mathbf{x}\_i, y\_i) - Z\_1(\mathbf{x}\_i, y\_i, h) \right] \bullet \left[ Z\_2(\mathbf{x}\_i, y\_i) - Z\_2(\mathbf{x}\_i, y\_i, h) \right] \tag{14}$$

Where, *Z*1 and *Z*2 represents values in image 1 and image 2 (here referred to the target image and the fill image), respectively. Unlike semivariogram models, the crosssemivariogram may have negative values because of a negative cross-correlation between the two images.

The calculated semivariogram (cross-semivariogram) values based on the sampled pixels according to equations mentioned above, need to be fit for its further application in kriging. Mathematical models frequently used for fitting semivariogram include nugget effect model, spherical model, exponent model, Gaussian model and power model. At the same time, for fitting cross-semivariogram, the basic models usually used are linear, spherical and exponential models.

328 Data Acquisition Applications

selecting suitable fill images are cloud free and associated with time interval. However,in fact, these criteria are difficult to meet, especially for regions with moist environment. Under this condition, the GLHM,LLHM and AWLHM methods are limited to use consequently. On the basis that the autocorrelation is one of the predominant phenomena in physical geography, pixels in a specific extent may correlate with each other to a certain degree. So, it is possible to estimate un-scanned pixels based on the pixel relationship rules within the image itself, and this methodology is served as interpolation. General interpolation methods, such as inverse distance weighted methods and triangulation methods may be not suitable for recovering un-scanned pixels in the SLC-off image, because information about spatial structure is not used fully by these interpolation methods. Understanding the magnitude and pattern in spatial variability is necessary for accurately interpolating the unscanned pixels. Zhang et al (2007) and Pringle et al (2009) discussed the possibility that using geostatistical techniques (e.g. kriging methods) to resolve the un-scanned pixels issue,

As mentioned above, the fundamental idea of geostatistics is the first law of geography, that spatial data from locations close to each other are more similar than data from locations far apart. Variogram used to indicate the spatial structure can be applied to estimate values at

Variogram model the spatial dependence in a regionalized variable *Z* (here is reflectance, radiance or digital number (DN) in SLC-off ETM+ image) under the 'intrinsic' hypothesis that the increments ( ( , , ) ( , ) *Zx y h Zx y ii ii* ) associated with a small distance h are weakly stationary (Zhang et al., 2007). For multispectral image, in practice, a semivariogram is

2

( ) *h* indicate the pixel pairs distributing apart with h

(13)

*ii ii*

( )

*N h*

*i*

common, and is often modelled using a cross-semivariogram, shown as follows:

1 1 ( ) [ ( , ) ( , , )] 2 ()

*h Zx y Zx y h N h*

Where, *N h*( ) is the number of pairs of pixel locating with h apart, and distance h is defined

Similarly, in view of the two co-dependent variables, the joint spatial dependence is

1 ( ) [ ( , ) ( , , )] [ ( , ) ( , , )] 2 ()

*h Zxy Zxyh Zxy Zxyh N h*

Where, *Z*1 and *Z*2 represents values in image 1 and image 2 (here referred to the target image and the fill image), respectively. Unlike semivariogram models, the crosssemivariogram may have negative values because of a negative cross-correlation between

The calculated semivariogram (cross-semivariogram) values based on the sampled pixels according to equations mentioned above, need to be fit for its further application in kriging.

11 22

*ii ii ii ii*

(14)

which provides unbiased estimation with minimum and known error.

un-sampled locations (here, are un-scanned pixels in SLC-off ETM+ image).

computed using the values in each band, shown as follows:

( )

*N h*

*i*

1

in Euclidean space. The larger value of

distance are less similar.

the two images.

Kriging is a family of generalized least-square regression algorithms that take advantage of the spatial dependence information given by the variogram. Ordinary kriging is the most common and robust one, which is able to rescale locally the random function model to a different mean value in different locations (Zhang et al., 2007). For estimating an un-scanned pixel ( , ) *i i x y* in the SLC-off ETM+ image, pixels locating in the local neighbourhood are only used, and the extent of the neighbourhood is determined by semivariogram. Therefore, the value of pixel ( , ) *i i x y* (denoted ( , ) *Z xy OK i i* ) is estimated through a linear model:

$$Z\_{\rm OK}(\mathbf{x}\_{i'}, y\_i) = \sum\_{j=1}^{n} \lambda\_j^{(\rm OK)}(\mathbf{x}\_{i'}, y\_i) Z(\mathbf{x}\_{j'}, y\_j) \quad \text{with} \quad \sum\_{j=1}^{n} \lambda\_j^{(\rm OK)}(\mathbf{x}\_{i'}, y\_i) = 1 \tag{15}$$

Where, ( )(,) *OK j ii x y* is the ordinary kriging weight for the pixel j locating in the neighbourhood of pixel ( , ) *i i x y* , of which the value needs to be estimated, and n is the number of pixels locating in the neighbourhood of pixel ( , ) *i i x y* .The ordinary kriging estimator is unbiased by forcing the kriging weights to sum to 1(see equation (15)).

Cokriging is an extended version of kriging, which incorporates more than one variable in the estimating procedure. Thus, generally, it can improve the accuracy, particularly when the primary variable is sparse and poorly correlated in space compared to the secondary one. Both the autocorrelation in each variable and the cross-correlation between the variables are taken into consideration in cokriging method. The value of pixel ( , ) *i i x y* (denoted ( , ) *Z xy COK i i* ) estimated by means of cokriging method is expressed as follows:

$$\mathbf{Z}\_{\rm{COK}}\{\mathbf{x}\_{i}, y\_{i}\} = \sum\_{j=1}^{n1} \lambda\_{j}^{\rm{(COK)}} \{\mathbf{x}\_{i}, y\_{j}\} \mathbf{Z}\{\mathbf{x}\_{j}, y\_{j}\} + \sum\_{j\bar{j}=1}^{n2} \lambda\_{j\bar{j}}^{\rm{(COK)}} \{\mathbf{x}\_{i}, y\_{i}\} \mathbf{Z}\_{\rm{S}}\{\mathbf{x}\_{j\bar{j}}, y\_{j\bar{j}}\}$$

$$\text{With } \sum\_{j=1}^{n1} \lambda\_{j}^{\rm{COK}} \{\mathbf{x}\_{i}, y\_{i}\} = \mathbf{1} \quad \text{and} \quad \sum\_{j\bar{j}=1}^{n2} \lambda\_{j\bar{j}}^{\rm{COK}} \{\mathbf{x}\_{i}, y\_{i}\} = 0 \tag{16}$$

Where, ( )(,) *COK j ii x y* is the ordinary cokriging weight for the pixel j locating in the neighbourhood of pixel ( , ) *i i x y* for the primary variable, and n1 is the number of pixels locating in the neighbourhood of pixel ( , ) *i i x y* for the primary variable. Similarly, ( )(,) *COK jj i i x y* is the ordinary cokriging weight for the pixel jj locating in the neighbourhood of pixel ( , ) *i i x y* for the secondary variable, and n2 is the number of pixels locating in the neighbourhood of pixel ( , ) *i i x y* for the secondary variable.

As illustrated above (see equations (15) and (16)), two procedures are needed for estimating the value of the un-scanned pixel in advance, including determining the extent of local neighbourhood and thereby the valid sampling pixels, and calculating the kriging weights for each neighbourhood valid sampling pixel. Ordinarily, these procedures especially the last one need much time. The simplified versions for both ordinary kriging and cokriging were proposed for tackling the SLC-off issue by Zhang et al (2007), which are faster.

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 331

As mentioned before, selecting the fill image is crucial for recovering the SLC-off ETM+ image, and that cloud free images (SLC-on or SLC-off) acquired temporally close to the target image are desirable. But, for regions with moist environment the valid fill images are few. Consequently, due to the limitation of data acquisition, e.g. temporal resolution and atmospheric condition, there are always a large number of overlapping areas filled with unscanned pixels in two cloud-free SLC-off ETM+ images which are close in time. Ordinary kriging has been illustrated as a good tool for tackling this issue (Zhang et al., 2007). However, as an alternative to ordinary kriging, the image from a sensor other than Landsat 7 ETM+, which is observed at the close time as the target SLC-off ETM+ image, may be able to be used to estimate the un-scanned pixels. This assumption has been verified by several previous researches. For example, Reza and Ali (2008) used IRS products, Boloorani et al (2008a) and F. Chen et al (2010) adopted EO-1/ALI and CBERS data as auxiliary information,

respectively, while Roy et al (2008) used the information observed by MODIS.

Our experiments conducted on exploiting CBERS data as the fill image are shown here. All provided bands (totally four) of CBERS-02B CCD sensor have a spatial resolution of approximately 20m. There is similarity more or less between CBERS-02B CCD and Landsat7 ETM+ VNIR bands (Fig.5.) as well as the medium spatial resolution of each band, which makes it possible to estimate the un-scanned pixels in the ETM+ SLC-off image considering the CBERS-02B as the fill image. After the main procedures, including image resampling, geometrical registration, radiometric correction, several methods (e.g. Simple Filling, GLHM, LLHM, and AWLHM) were applied. Findings show the availability that using CBERS image as the fill data, and the superiority of AWLHM compared to the rest methods. However, further researches should be conducted, such as recovering all multispectral bands of SLC-off ETM+, and improving the estimated accuracy in urban or sub-urban areas

Generally, AWLHM along with CBERS-02B estimated un-scanned pixels well around which the neighborhood was relatively homogeneous, however, was less accurate for pixels in the context of heterogeneous land use/cover. It is clear that the procedure performed well near the International Airport (Fig.6 (B2), (B4)) but less properly near the mixture places (Fig.6 (U2), (U4)) with incompatible appearance, no matter which date is considered. Setting recovered results of ETM+ 021 as an example, Fig.7 demonstrates that the linear relationship is less proper between pixels around P1 in SLC-off ETM+ and corresponding ones in CBERS-02B, compared with the good linear relationship for the relatively homogeneous neighborhood around P2, shown in Fig.8. The imprecise relationship might impact the accuracy of estimation at P1.These findings suggest the necessity to resolve the issues associated with heterogeneity to recover the SLC-off images in urban and sub-urban regions. According to the previous researches, ideas incorporated into the NSPI method (J.

Another problem is that the number of multispectral bands validly provided by CBERS (here is CBERS-02B) is less than that of Landsat 7 ETM+. It may limit the full usage of the

**2.6. Using images from other sensors**

with obvious heterogeneity.

Chen et al., 2011) may be worth learning.

Extent of the local neighbourhood is mainly defined based on the variogram, which are well-structured and can be fitted well due to the abundant data available in the SLC-off ETM+ image (about 80%).The specific pattern of the un-scanned pixels makes it possible to recover the SLC-off ETM+ image accurately, which was verified by Zhang et al (2007). Mean while, the case study showed that the cokriging method provided little improvement in estimating the un-scanned pixels in the SLC-off ETM+ image compared with the ordinary kriging method(Zhang et al., 2007). That is to say, similar results were obtained by these two approaches separately. The ordinary kriging allows users to extract the maximum information from the individual scene of the SLC-off ETM+ image by considering spatial variability and dependence, and it also overcomes the inherent problems caused by radiometric differences and small georeferencing errors possibly suffered in the GLHM, LLHM and AWLHM methods.

However, according to the statement of Pringle et al (2009), ordinary kriging and cokriging can be used complementarily to interpolate the value of un-scanned pixels in the SLC-off images. In detail, cokriging can be implemented by default and kriging is used in some subregions where the secondary variable is under-sampled. The recovered experiment based on the geostatistical method and two fill images (both are cloud-free), of which one was collected a few weeks earlier than the target image and the other one was collected a few weeks later, demonstrated the superiority of the geostatistics to several compositing methods and the improved prediction of cokriging method in the sub-regions where the secondary variable was more numerous than the target one (Pringle et al., 2009).

These previous researches suggest that the geostatistical method, especially the ordinary kriging is a good alternative to these traditional methods (e.g. the GLHM, LLHM and AWLHM) for predicting the values of un-scanned pixels in the SLC-off ETM+ image, especially for regions where suitable fill images are difficult to obtain, mainly resulted from weather conditions, cloud and temporal interval between images acquisition. Also, as shown in the previous results, main reasons for the advantages of geostatistics are including, (1) all un-scanned pixels in the SLC-off image are able to be recovered; (2) recovered results agree more strongly with the observations, even when there is an abrupt temporal changes; (3) for each recovered pixel, geostatistical method provides an estimation variance associated with uncertainty. However, the disadvantages of the geostatistical method in recovering the SLC-off ETM+ image are associated with its relatively slow speed and the selection of neighbourhood pixels for kriging weights. To solve its disadvantage in time consuming, Pringle et al (2009) proposed a hybrid technique. Additionally, further research is needed to find how many valid pixels in local neighbour is most suitable for estimating the un-scanned pixel, considering the specific spatial distribution characteristics of the un-scanned pixels in the SLC-off ETM+ image (Zhang et al., 2007).

### **2.6. Using images from other sensors**

330 Data Acquisition Applications

LLHM and AWLHM methods.

(Zhang et al., 2007).

for each neighbourhood valid sampling pixel. Ordinarily, these procedures especially the last one need much time. The simplified versions for both ordinary kriging and cokriging

Extent of the local neighbourhood is mainly defined based on the variogram, which are well-structured and can be fitted well due to the abundant data available in the SLC-off ETM+ image (about 80%).The specific pattern of the un-scanned pixels makes it possible to recover the SLC-off ETM+ image accurately, which was verified by Zhang et al (2007). Mean while, the case study showed that the cokriging method provided little improvement in estimating the un-scanned pixels in the SLC-off ETM+ image compared with the ordinary kriging method(Zhang et al., 2007). That is to say, similar results were obtained by these two approaches separately. The ordinary kriging allows users to extract the maximum information from the individual scene of the SLC-off ETM+ image by considering spatial variability and dependence, and it also overcomes the inherent problems caused by radiometric differences and small georeferencing errors possibly suffered in the GLHM,

However, according to the statement of Pringle et al (2009), ordinary kriging and cokriging can be used complementarily to interpolate the value of un-scanned pixels in the SLC-off images. In detail, cokriging can be implemented by default and kriging is used in some subregions where the secondary variable is under-sampled. The recovered experiment based on the geostatistical method and two fill images (both are cloud-free), of which one was collected a few weeks earlier than the target image and the other one was collected a few weeks later, demonstrated the superiority of the geostatistics to several compositing methods and the improved prediction of cokriging method in the sub-regions where the

These previous researches suggest that the geostatistical method, especially the ordinary kriging is a good alternative to these traditional methods (e.g. the GLHM, LLHM and AWLHM) for predicting the values of un-scanned pixels in the SLC-off ETM+ image, especially for regions where suitable fill images are difficult to obtain, mainly resulted from weather conditions, cloud and temporal interval between images acquisition. Also, as shown in the previous results, main reasons for the advantages of geostatistics are including, (1) all un-scanned pixels in the SLC-off image are able to be recovered; (2) recovered results agree more strongly with the observations, even when there is an abrupt temporal changes; (3) for each recovered pixel, geostatistical method provides an estimation variance associated with uncertainty. However, the disadvantages of the geostatistical method in recovering the SLC-off ETM+ image are associated with its relatively slow speed and the selection of neighbourhood pixels for kriging weights. To solve its disadvantage in time consuming, Pringle et al (2009) proposed a hybrid technique. Additionally, further research is needed to find how many valid pixels in local neighbour is most suitable for estimating the un-scanned pixel, considering the specific spatial distribution characteristics of the un-scanned pixels in the SLC-off ETM+ image

secondary variable was more numerous than the target one (Pringle et al., 2009).

were proposed for tackling the SLC-off issue by Zhang et al (2007), which are faster.

As mentioned before, selecting the fill image is crucial for recovering the SLC-off ETM+ image, and that cloud free images (SLC-on or SLC-off) acquired temporally close to the target image are desirable. But, for regions with moist environment the valid fill images are few. Consequently, due to the limitation of data acquisition, e.g. temporal resolution and atmospheric condition, there are always a large number of overlapping areas filled with unscanned pixels in two cloud-free SLC-off ETM+ images which are close in time. Ordinary kriging has been illustrated as a good tool for tackling this issue (Zhang et al., 2007). However, as an alternative to ordinary kriging, the image from a sensor other than Landsat 7 ETM+, which is observed at the close time as the target SLC-off ETM+ image, may be able to be used to estimate the un-scanned pixels. This assumption has been verified by several previous researches. For example, Reza and Ali (2008) used IRS products, Boloorani et al (2008a) and F. Chen et al (2010) adopted EO-1/ALI and CBERS data as auxiliary information, respectively, while Roy et al (2008) used the information observed by MODIS.

Our experiments conducted on exploiting CBERS data as the fill image are shown here. All provided bands (totally four) of CBERS-02B CCD sensor have a spatial resolution of approximately 20m. There is similarity more or less between CBERS-02B CCD and Landsat7 ETM+ VNIR bands (Fig.5.) as well as the medium spatial resolution of each band, which makes it possible to estimate the un-scanned pixels in the ETM+ SLC-off image considering the CBERS-02B as the fill image. After the main procedures, including image resampling, geometrical registration, radiometric correction, several methods (e.g. Simple Filling, GLHM, LLHM, and AWLHM) were applied. Findings show the availability that using CBERS image as the fill data, and the superiority of AWLHM compared to the rest methods. However, further researches should be conducted, such as recovering all multispectral bands of SLC-off ETM+, and improving the estimated accuracy in urban or sub-urban areas with obvious heterogeneity.

Generally, AWLHM along with CBERS-02B estimated un-scanned pixels well around which the neighborhood was relatively homogeneous, however, was less accurate for pixels in the context of heterogeneous land use/cover. It is clear that the procedure performed well near the International Airport (Fig.6 (B2), (B4)) but less properly near the mixture places (Fig.6 (U2), (U4)) with incompatible appearance, no matter which date is considered. Setting recovered results of ETM+ 021 as an example, Fig.7 demonstrates that the linear relationship is less proper between pixels around P1 in SLC-off ETM+ and corresponding ones in CBERS-02B, compared with the good linear relationship for the relatively homogeneous neighborhood around P2, shown in Fig.8. The imprecise relationship might impact the accuracy of estimation at P1.These findings suggest the necessity to resolve the issues associated with heterogeneity to recover the SLC-off images in urban and sub-urban regions. According to the previous researches, ideas incorporated into the NSPI method (J. Chen et al., 2011) may be worth learning.

Another problem is that the number of multispectral bands validly provided by CBERS (here is CBERS-02B) is less than that of Landsat 7 ETM+. It may limit the full usage of the

#### 332 Data Acquisition Applications

recovered results; because recovering procedures are always operated band-by-band, except the recovering method based on projection transformation (see Section 2.4). The simple method by using the intra-bands relationship is possible, in addition to the methodology based on projection transformation. Reza and Ali (2008) adopted the simple method to fully recover the multispectral bands of the SLC-off ETM+ image using IRS/1D LISS-III as the fill image through two stages.

**Figure 5.** Comparison of relative spectral response (RSR) between CBERS-02B and ETM+ (Original data were provided by CRESDA (*www.cresda.com*) and NASA respectively, and each ETM+ RSR exhibited above was resampled to a spectral resolution of 10nm so as to compare)

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 333

**Figure 6.** Detailed exhibition of small extracts (R:band4,G:band3,B:band2) (U1:from CBERS-02B, U2:from original ETM+ 021,U3:from recovered ETM+021,U4:from original ETM+ 309,U5: from recovered ETM+ 309; B1:from CBERS-02B,B2:from original ETM+021,B3:from recovered ETM+

**Figure 7.** Scatter plots of corresponding bands for scanned pixels around P1 (in F. Chen, et al., 2010)

021,B4:from original ETM+ 309,B5:from recovered ETM+ 309) (in F. Chen, et al., 2010)

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 333

332 Data Acquisition Applications

image through two stages.

recovered results; because recovering procedures are always operated band-by-band, except the recovering method based on projection transformation (see Section 2.4). The simple method by using the intra-bands relationship is possible, in addition to the methodology based on projection transformation. Reza and Ali (2008) adopted the simple method to fully recover the multispectral bands of the SLC-off ETM+ image using IRS/1D LISS-III as the fill

**Figure 5.** Comparison of relative spectral response (RSR) between CBERS-02B and ETM+ (Original data were provided by CRESDA (*www.cresda.com*) and NASA respectively, and each ETM+ RSR exhibited

above was resampled to a spectral resolution of 10nm so as to compare)

**Figure 6.** Detailed exhibition of small extracts (R:band4,G:band3,B:band2) (U1:from CBERS-02B, U2:from original ETM+ 021,U3:from recovered ETM+021,U4:from original ETM+ 309,U5: from recovered ETM+ 309; B1:from CBERS-02B,B2:from original ETM+021,B3:from recovered ETM+ 021,B4:from original ETM+ 309,B5:from recovered ETM+ 309) (in F. Chen, et al., 2010)

**Figure 7.** Scatter plots of corresponding bands for scanned pixels around P1 (in F. Chen, et al., 2010)

Band number of MODIS

1 450-520 3 459-479 2 530-610 4 545-565 3 630-690 1 620-670 4 780-900 2 841-876 5 1550-1750 6 1628-1652 7 2090-2350 7 2105-2155

**Table 1.** The multispectral bands of Landsat 7 ETM+ and the corresponding ones of MODIS

According to previous comparisons, each method has its own relative advantages and disadvantages, compared with other ones. For example, geostatistical method is generally superior to several methods based on the linear relationship (e.g. GLHM, LLHM and AWLHM), but it consumes much more time. Mean while, data obtained by other sensors instead of ETM+ may provide useful auxiliary information for recovering the SLC-off ETM+ image, but the differences between these sensors and ETM+ should be considered, which are related to sensor geometry, spatial resolution, band settings, and so on. Pringle et al (2009) proposed a hybrid technique which incorporates the simple ones with the geostatistical method. For example, after implementing the LLHM the rest un-scanned pixels in the SLCoff ETM+ image can be estimated by means of kriging or cokriging (Pringle et al., 2009).

Currently, there have been few researches done to resolve the SLC-off thermal band image, although it had been used widely, as shown in Section 1. A method called the modified AWLHM (see Fig.9 )was proposed to fill the gaps in the thermal band of SLC-off ETM+ image, while data obtained by other sensors are used as fill image (here is CBERS).The experiment shows the possibility that using the modified AWLHM method and suitable band combinations to recover the thermal band of SLC-off ETM+ image. While giving the priority to the accuracy, it is more rational and practicable to get brightness temperature directly than to inverse brightness temperature from the recovered thermal band. Based on the detailed analysis on the validation results, we can assume that it is practicable to implement the recovered thermal band in the study of urban thermal environment, with certainty to some extent. However, further researches need to be done to enable more

Band wavelength(nm)

Band number of ETM+

**2.7. Integrated method**

Band wavelength(nm)

**2.8. Recovering the thermal band of SLC-off ETM+ image**

scientific use of the thermal band of SLC-off ETM+ data.

**Figure 8.** Scatter plots of corresponding bands for scanned pixels around P2 (F. Chen, et al., 2010)

MODIS is another data resource considered as the fill image. Landsat 7 ETM+ bands and the corresponding bands of MODIS are shown in Table 1. Roy et al (2008) indicated the possibility that recovering the SLC-off ETM+ image by means of a semi-physical fusion approach, when the MODIS BRDF/Albedo land surface characterization product was used as auxiliary data. Detailed analysis demonstrated the major advantages of this fusion method, the simplicity for application and the ability in accommodating for temporal variations due to surface change (Roy et al., 2008). The main disadvantages of this method are related to the requirement on adequate data co-registration, computation of geometry and the obvious scale discrepancy between MODIS BRDF/Albedo product and the Landsat 7 ETM+ data. Nevertheless, MODIS provides one more chance for recovering the SLC-off ETM+ image, mainly due to the abundant images it provides. Therefore, further researches are required to tackle the associated issues, then to make the full advantages of MODIS.

**Table 1.** The multispectral bands of Landsat 7 ETM+ and the corresponding ones of MODIS

### **2.7. Integrated method**

334 Data Acquisition Applications

MODIS.

**Figure 8.** Scatter plots of corresponding bands for scanned pixels around P2 (F. Chen, et al., 2010)

MODIS is another data resource considered as the fill image. Landsat 7 ETM+ bands and the corresponding bands of MODIS are shown in Table 1. Roy et al (2008) indicated the possibility that recovering the SLC-off ETM+ image by means of a semi-physical fusion approach, when the MODIS BRDF/Albedo land surface characterization product was used as auxiliary data. Detailed analysis demonstrated the major advantages of this fusion method, the simplicity for application and the ability in accommodating for temporal variations due to surface change (Roy et al., 2008). The main disadvantages of this method are related to the requirement on adequate data co-registration, computation of geometry and the obvious scale discrepancy between MODIS BRDF/Albedo product and the Landsat 7 ETM+ data. Nevertheless, MODIS provides one more chance for recovering the SLC-off ETM+ image, mainly due to the abundant images it provides. Therefore, further researches are required to tackle the associated issues, then to make the full advantages of According to previous comparisons, each method has its own relative advantages and disadvantages, compared with other ones. For example, geostatistical method is generally superior to several methods based on the linear relationship (e.g. GLHM, LLHM and AWLHM), but it consumes much more time. Mean while, data obtained by other sensors instead of ETM+ may provide useful auxiliary information for recovering the SLC-off ETM+ image, but the differences between these sensors and ETM+ should be considered, which are related to sensor geometry, spatial resolution, band settings, and so on. Pringle et al (2009) proposed a hybrid technique which incorporates the simple ones with the geostatistical method. For example, after implementing the LLHM the rest un-scanned pixels in the SLCoff ETM+ image can be estimated by means of kriging or cokriging (Pringle et al., 2009).

### **2.8. Recovering the thermal band of SLC-off ETM+ image**

Currently, there have been few researches done to resolve the SLC-off thermal band image, although it had been used widely, as shown in Section 1. A method called the modified AWLHM (see Fig.9 )was proposed to fill the gaps in the thermal band of SLC-off ETM+ image, while data obtained by other sensors are used as fill image (here is CBERS).The experiment shows the possibility that using the modified AWLHM method and suitable band combinations to recover the thermal band of SLC-off ETM+ image. While giving the priority to the accuracy, it is more rational and practicable to get brightness temperature directly than to inverse brightness temperature from the recovered thermal band. Based on the detailed analysis on the validation results, we can assume that it is practicable to implement the recovered thermal band in the study of urban thermal environment, with certainty to some extent. However, further researches need to be done to enable more scientific use of the thermal band of SLC-off ETM+ data.

**Figure 10.** RGB colour composite of the recovered and original ETM+ images and CBERS-02B ((A) CBERS-02B; (B) original ETM+021; (C) original ETM+309; (D) recovered ETM+309 using ETM+ 021 as auxiliary data; (E) recovered ETM+021 using CBERS-02B as auxiliary data; (F) recovered ETM+309 using

**Figure 11.** Results of UIS estimation accuracy assessment for recovered ETM+ 021: (A) accuracy assessment for filled pixels; (B) accuracy assessment for scanned pixels; (C) residual analysis for filled

pixels; (D) residual analysis for scanned pixels (in F. Chen, et al., 2010)

CBERS-02B as auxiliary data) (in F. Chen, et al., 2010)

**Figure 9.** Schematic diagram of the modified AWLHM method for thermal band (in F. Chen, et al., 2011a)

### **3. Experiments and applications**

The possible usage of the recovered ETM+ images either the multispectral bands or the thermal band is an important issue when talking about recovering the SLC-off ETM+ image. However, few researches associated have discussed the possible application of the recovered images. For example, Boloorani et al (2008b) and J. Chen et al (2011) demonstrated the possibility of applying the recovered multispectral bands in land cover/use classification, although they just conducted these studies based on the simulated data. F. Chen et al (2010) recovered two SLC-off ETM+ images acquired at different times and demonstrated the usage of the recovered images in mapping urban impervious surface. The possible usage of the recovered thermal band in urban thermal environment study was discussed (F. Chen et al., 2011a), while its application has also been illustrated (F. Chen et al., 2011b).

Fig.10 shows two recovered ETM+ images for Xiamen Island, locating in Fujian Province, China, which is highly urbanized. Urban impervious surface modelled from these recovered images indicates that similar estimation accuracy was obtained at the filled pixels and scanned ones, as shown in Fig.11 (F. Chen et al, 2010).

Fig.12 shows the simulated results of recovering the SLC-off thermal band. The recovered results are visually acceptable, even in high-contrast areas. Furthermore, the validation reveals that unbiased estimation can be obtained through our recovering procedure at most of the un-scanned pixels (about 80%) in the thermal band (Chen et al, 2011). According to these findings, we confidently assume that the recovered thermal band can be applied in the issues associated with urban thermal environment. Several recovered thermal bands were applied in urban thermal environment studies (F. Chen et al., 2011b). Fig.13 demonstrates the land surface temperature results obtained from four recovered SLC-off thermal bands.

336 Data Acquisition Applications

2011a)

**3. Experiments and applications**

**Figure 9.** Schematic diagram of the modified AWLHM method for thermal band (in F. Chen, et al.,

The possible usage of the recovered ETM+ images either the multispectral bands or the thermal band is an important issue when talking about recovering the SLC-off ETM+ image. However, few researches associated have discussed the possible application of the recovered images. For example, Boloorani et al (2008b) and J. Chen et al (2011) demonstrated the possibility of applying the recovered multispectral bands in land cover/use classification, although they just conducted these studies based on the simulated data. F. Chen et al (2010) recovered two SLC-off ETM+ images acquired at different times and demonstrated the usage of the recovered images in mapping urban impervious surface. The possible usage of the recovered thermal band in urban thermal environment study was discussed (F. Chen et

Fig.10 shows two recovered ETM+ images for Xiamen Island, locating in Fujian Province, China, which is highly urbanized. Urban impervious surface modelled from these recovered images indicates that similar estimation accuracy was obtained at the filled pixels and

Fig.12 shows the simulated results of recovering the SLC-off thermal band. The recovered results are visually acceptable, even in high-contrast areas. Furthermore, the validation reveals that unbiased estimation can be obtained through our recovering procedure at most of the un-scanned pixels (about 80%) in the thermal band (Chen et al, 2011). According to these findings, we confidently assume that the recovered thermal band can be applied in the issues associated with urban thermal environment. Several recovered thermal bands were applied in urban thermal environment studies (F. Chen et al., 2011b). Fig.13 demonstrates the land surface temperature results obtained from four recovered SLC-off thermal bands.

al., 2011a), while its application has also been illustrated (F. Chen et al., 2011b).

scanned ones, as shown in Fig.11 (F. Chen et al, 2010).

**Figure 10.** RGB colour composite of the recovered and original ETM+ images and CBERS-02B ((A) CBERS-02B; (B) original ETM+021; (C) original ETM+309; (D) recovered ETM+309 using ETM+ 021 as auxiliary data; (E) recovered ETM+021 using CBERS-02B as auxiliary data; (F) recovered ETM+309 using CBERS-02B as auxiliary data) (in F. Chen, et al., 2010)

**Figure 11.** Results of UIS estimation accuracy assessment for recovered ETM+ 021: (A) accuracy assessment for filled pixels; (B) accuracy assessment for scanned pixels; (C) residual analysis for filled pixels; (D) residual analysis for scanned pixels (in F. Chen, et al., 2010)

happened or is happing at local, regional and global scales. Therefore, as NASA administrator Dr. James Fletcher predicted in 1975, if one space age development would save the world, it would be Landsat and its successor satellites

In addition, based on the free data policy announced in 2008, all new and archived Landsat data held by the USGS have been made freely obtainable over the internet for any user (Woodcock, et al., 2008). In the short time since this policy was put into effect, significant benefits are already being realized within the Landsat data user community (Loveland & Dwyer, 2012). So, it is highly possible that Landsat data will experience more widespread usage especially for long-term and large-area environmental issues. Furthermore, the subsequent Landsat satellites (e.g. Landsat 8, Landsat 9, and Landsat 10 and so on) make the possibility to be realized. As Loveland & Dwyer states, the next few years are quite possibly going to be Landsat' s 'golden years' and could be the time in which the Landsat program

However, the SLC failure of Landsat 7 ETM+ sensor occurred in 2003 may impact the Landsat data archive to some extent, and even results in a data gap period, especially under the condition that Landsat 5 has also suffered problems with its solar array drive sometimes and the failure of its electronic component currently. Therefore, suitable ways are desirable to resolve the SLC-off problem accurately and robustly, and then enable the usage of SLC-off ETM+. Much effort has been done to meet this goal, widely by different institutions and individuals. Currently, methods based on different assumptions have been proposed and demonstrated, some of which were also discussed in this chapter. Generally, for areas with spatially homogeneous property and less temporal fluctuation, most of them can perform well and the un-scanned pixels in the SLC-off ETM+ images are able to be recovered accurately. Meanwhile, in practice, the un-scanned pixels, locating in heterogeneous areas with obvious temporal changes, are difficult to be estimated. Proper selection of the fill images is important for the recovering procedure; nevertheless, the important criteria suggested by USGS & NASA (2004) are difficult to meet usually. In practice, for a specific application, method and recovering procedure should be determined by balancing its performance and efficiency, besides taking into account the availability of the fill image and land surface properties in SLC-off image. In some cases, images available from other sensors may provide valuable auxiliary information for tackling the SLC-off issue, after being

It is worth to note here that, much attention should be paid to recover the SLC-off ETM+ images acquired over urban and suburban areas, although few researches have been conducted. Making full use of the recovered SLC-off ETM+ images is desirable for investigating changes in regions, which have experienced rapid urbanization and consequently suffered environmental deterioration at present. This is a very important and valuable issue, especially for many developing countries or regions, for whom financial

(*http://landsat.gsfc.nasa.gov/about/*).

properly processed.

achieves its full potential (Loveland & Dwyer, 2012).

**Figure 12.** Simulated experiment on recovering the SLC-off thermal band (O): the original one acquired on January 2, 2002, (S): the simulated one obtained by using the gap mask of another SLC-off ETM+ image (acquired on January 21, 2009), (R): the recovered results based on the modified AWLHM method. Additionally, (O1), (S1), (R1), (O2), (S2) and (R2) are extracted parts for illustration (in F. Chen, et al., 2011a)

**Figure 13.** Spatial distribution of LST over Xiamen Island at different times (A, B, C and D are for 21 January, 11 April, 16 July and 5 November, 2009 respectively), and the overlying layer is the detailed land use map digitized manually from the sharpened IKONOS image (in F. Chen, et al., 2012b)

### **4. Discussion and conclusion**

Since the launch of its first satellite in 1972, Landsat mission has continuously and consistently collected images of Earth with global coverage, due to the continuous series (see Fig.1). The moderate spatial resolution of the Landsat sensors is important for scientists or common users, because it is either coarse enough for observing global environment or detailed enough for monitoring human-scale processes. This specifically spatial resolution is sensitive to both natural and human changes, although abundant information is missing for some individual objects. The special characteristics, both data archive with long history and suitable spatial resolution, make the Landsat an important tool, which gives scientist the ability to assess environment changes happened or is happing at local, regional and global scales. Therefore, as NASA administrator Dr. James Fletcher predicted in 1975, if one space age development would save the world, it would be Landsat and its successor satellites (*http://landsat.gsfc.nasa.gov/about/*).

338 Data Acquisition Applications

et al., 2011a)

**4. Discussion and conclusion**

**Figure 12.** Simulated experiment on recovering the SLC-off thermal band (O): the original one acquired on January 2, 2002, (S): the simulated one obtained by using the gap mask of another SLC-off ETM+ image (acquired on January 21, 2009), (R): the recovered results based on the modified AWLHM method. Additionally, (O1), (S1), (R1), (O2), (S2) and (R2) are extracted parts for illustration (in F. Chen,

**Figure 13.** Spatial distribution of LST over Xiamen Island at different times (A, B, C and D are for 21 January, 11 April, 16 July and 5 November, 2009 respectively), and the overlying layer is the detailed land use map digitized manually from the sharpened IKONOS image (in F. Chen, et al., 2012b)

Since the launch of its first satellite in 1972, Landsat mission has continuously and consistently collected images of Earth with global coverage, due to the continuous series (see Fig.1). The moderate spatial resolution of the Landsat sensors is important for scientists or common users, because it is either coarse enough for observing global environment or detailed enough for monitoring human-scale processes. This specifically spatial resolution is sensitive to both natural and human changes, although abundant information is missing for some individual objects. The special characteristics, both data archive with long history and suitable spatial resolution, make the Landsat an important tool, which gives scientist the ability to assess environment changes In addition, based on the free data policy announced in 2008, all new and archived Landsat data held by the USGS have been made freely obtainable over the internet for any user (Woodcock, et al., 2008). In the short time since this policy was put into effect, significant benefits are already being realized within the Landsat data user community (Loveland & Dwyer, 2012). So, it is highly possible that Landsat data will experience more widespread usage especially for long-term and large-area environmental issues. Furthermore, the subsequent Landsat satellites (e.g. Landsat 8, Landsat 9, and Landsat 10 and so on) make the possibility to be realized. As Loveland & Dwyer states, the next few years are quite possibly going to be Landsat' s 'golden years' and could be the time in which the Landsat program achieves its full potential (Loveland & Dwyer, 2012).

However, the SLC failure of Landsat 7 ETM+ sensor occurred in 2003 may impact the Landsat data archive to some extent, and even results in a data gap period, especially under the condition that Landsat 5 has also suffered problems with its solar array drive sometimes and the failure of its electronic component currently. Therefore, suitable ways are desirable to resolve the SLC-off problem accurately and robustly, and then enable the usage of SLC-off ETM+. Much effort has been done to meet this goal, widely by different institutions and individuals. Currently, methods based on different assumptions have been proposed and demonstrated, some of which were also discussed in this chapter. Generally, for areas with spatially homogeneous property and less temporal fluctuation, most of them can perform well and the un-scanned pixels in the SLC-off ETM+ images are able to be recovered accurately. Meanwhile, in practice, the un-scanned pixels, locating in heterogeneous areas with obvious temporal changes, are difficult to be estimated. Proper selection of the fill images is important for the recovering procedure; nevertheless, the important criteria suggested by USGS & NASA (2004) are difficult to meet usually. In practice, for a specific application, method and recovering procedure should be determined by balancing its performance and efficiency, besides taking into account the availability of the fill image and land surface properties in SLC-off image. In some cases, images available from other sensors may provide valuable auxiliary information for tackling the SLC-off issue, after being properly processed.

It is worth to note here that, much attention should be paid to recover the SLC-off ETM+ images acquired over urban and suburban areas, although few researches have been conducted. Making full use of the recovered SLC-off ETM+ images is desirable for investigating changes in regions, which have experienced rapid urbanization and consequently suffered environmental deterioration at present. This is a very important and valuable issue, especially for many developing countries or regions, for whom financial

#### 340 Data Acquisition Applications

supports given to afford abundant satellite images are limited. The recovered SLC-off ETM+ images, along with other Landsat data will provide an opportunity for these countries and regions to monitor, study and manage their own urbanized issues.

Making Use of the Landsat 7 SLC-off ETM+ Image Through Different Recovering Approaches 341

*Postgraduate Conference on Infrastructure and Environment (3rd IPCIE),* Vol.2, pp.557-

Chen, J.; Zhu, X. L.; Vogelmann, J. E. & et al. (2011).A simple and effective method for filling gaps in Landsat ETM+ SLC-off images. *Remote Sensing of Environment*, Vol.115, No.4,

Gao, F.; Masek, J.; Schwaller, M. & et al. (2006). On the blending of the Landsat and MODIS surface reectance: Predicting daily Landsat surface reectance. *IEEE Transactions on*

Loveland, T.R. & Dwyer, J.L. (2012).Landsat: Building a strong future. *Remote Sensing of*

Maxwell, S. K.; Schmidt, G. L. & Storey, J. C. (2007).A multi-scale segmentation approach to lling gaps in Landsat ETM+ SLC-off images. *International Journal of Remote Sensing*,

Pringle, M.; Schmidt, M. & Muir, J. (2009). Geostatistical interpolation of SLC-off Landsat ETM+ images. *ISPRS Journal of Photogrammetry and Remote Sensing*, Vol.64,No.6,pp.654-

Rajasekar, U. & Weng, Q. (2009).Spatio-temporal modelling and analysis of urban heat island by using Landsat TM and ETM+ imagery. *International Journal of Remote Sensing*,

Reza, M. & Ali, S. N. (2008).Using IRS Products to Recover Landsat7 ETM+ Defective

Roy, D. P.; Ju, J.; Lewis, P. & et al. (2008).Multi-temporal MODIS-Landsat data fusion for relative radiometric normalization, gap lling, and prediction of Landsat data. *Remote*

Scaramuzza, P. & Micijevic,E.(March 2004).SLC Gap-Filled Products Phase One

USGS & NASA. (June 2003). Preliminary Assessment of the Value of Landsat 7 ETM+ Data

USGS & NASA.(October 2004). SLC-off Gap-Filled Products Gap-fill Algorithm

Wloczyk, C.; Richert, R.; Borg, E. & et al. (2006).Sea and lake surface temperature retrieval from Landsat thermal data in Northern Germany. *International Journal of Remote Sensing,*

Woodcock, C.E.; Richard, A.; Martha, A.; & et al. (2008).Free Access to Landsat Imagery.

Wulder, M.A.; & Masek, J.G. (2012).Preface to Landsat Legacy Special Issue: Continuing the

Landsat Legacy. *Remote Sensing of Environment*, *doi:10.1016/j.rse.2012.01.009*

Available from http://landsat.usgs.gov/documents/SLC\_Gap\_Fill\_Methodology.pdf

following Scan Line Corrector Malfunction, Available from www.ga.gov.au/servlet/BigObjFileManager?bigobjid= GA3430

Methodology: Phase 2 Gap-fill Algorithm,Available from www.ga.gov.au/servlet/BigObjFileManager? bigobjid=GA4861

Images. *American Journal of Applied Sciences*, Vol.5, No .6, pp.618-625

*Geoscience and Remote Sensing*, Vol.44, pp.2207−2218

*Environment, doi:10.1016/j.rse.2011.09.022*

563

664

Methodology

pp.1053-1064

Vol.28, pp.5339−5356

Vol. 30, No.13, pp. 3531-3548

Vol.27, No.12, pp.2489-2502

*Science*, Vol.320, pp.1011

*Sensing of Environment*, Vol.112, pp.3112−3130

### **Author details**

Feng Chen, Xiaofeng Zhao and Hong Ye *Key Lab of Urban Environment and Health, Institute of Urban Environment, CAS, The People's Republic of China*

*Xiamen Key Lab of Urban Metabolism, The People's Republic of China*

### **Acknowledgement**

This work was supported by the Knowledge Innovation Program of Chinese Academy of Sciences, CAS (Grant No. 09L4401D10), the National Science Foundation of China (40901218) and (41101551). Thanks are given to data providers (e.g. CRESDA, USGS and NASA) for providing the images used in this work. The authors would like to acknowledge all who have contributed to this work, practically Dr. Jingzhu Zhao, Dr. Lina Tang and Dr. Quanyi Qiu, with the Institute of Urban Environment, Chinese Academy of Sciences. Many thanks to all authors of whose scientific publications or reports their work has profited in our manuscript.

### **5. References**

*Postgraduate Conference on Infrastructure and Environment (3rd IPCIE),* Vol.2, pp.557- 563

Chen, J.; Zhu, X. L.; Vogelmann, J. E. & et al. (2011).A simple and effective method for filling gaps in Landsat ETM+ SLC-off images. *Remote Sensing of Environment*, Vol.115, No.4, pp.1053-1064

340 Data Acquisition Applications

**Author details**

**Acknowledgement**

our manuscript.

**5. References**

4440

No.6, pp.1086-1093

Feng Chen, Xiaofeng Zhao and Hong Ye *Key Lab of Urban Environment and Health,*

supports given to afford abundant satellite images are limited. The recovered SLC-off ETM+ images, along with other Landsat data will provide an opportunity for these countries and

This work was supported by the Knowledge Innovation Program of Chinese Academy of Sciences, CAS (Grant No. 09L4401D10), the National Science Foundation of China (40901218) and (41101551). Thanks are given to data providers (e.g. CRESDA, USGS and NASA) for providing the images used in this work. The authors would like to acknowledge all who have contributed to this work, practically Dr. Jingzhu Zhao, Dr. Lina Tang and Dr. Quanyi Qiu, with the Institute of Urban Environment, Chinese Academy of Sciences. Many thanks to all authors of whose scientific publications or reports their work has profited in

Boloorani, A.D.; Erasmi, S. & Kappas, M. (2008a).Multi-source image reconstruction: exploitation of EO-1/ALI in Landsat-7/ETM+ SLC-off gap filling, In: *Image Processing:*

Boloorani, A.D.; Erasmi,S. & Kappas, M. (2008b).Multi-Source Remotely Sensed Data Combination: Projection Transformation Gap-Fill Procedure. *Sensors*, Vol. 8, pp.4429-

Chen, X.; Zhao, H.; Li, P. & et al. (2006).Remote sensing image-based analysis of the relationship between urban heat island and land use/cover changes. *Remote Sensing*

Chen, F.; Tang, L. & Qiu, Q. (2010).Exploitation of CBERS-02B As Auxiliary Data in Recovering the Landsat7 ETM+ SLC-off Image, In: *Proceedings of the 18 International*

Chen, F.; Tang, L. N; Wang, C. P. & et al.(2011a).Recovering of the thermal band of Landsat7 SLC-off ETM+ image using CBERS as auxiliary data. *Advances in Space Research*, Vol.48,

Chen, F.; Zhao, X. F; Ye, H, & et al. (2011b).Exploring the Spatio-temporal Variations of Land Surface Temperature at the Land Use Unit Level. In: *Proceedings of the Third International*

*Conference on GeoInformatics*, 18-20 June, Peking University, Beijing, China

*Algorithms and Systems VI,* J.T.Egiazarian & K.O.Edward, (Ed.), SPIE

*Environment*, Vol.104, No.2, pp.133-146

regions to monitor, study and manage their own urbanized issues.

*Institute of Urban Environment, CAS, The People's Republic of China Xiamen Key Lab of Urban Metabolism, The People's Republic of China*

Zhang, C.; Li, W. & Travis, D. (2007).Gaps-ll of SLC-off Landsat ETM plus satellite image using a geostatistical approach. *International Journal of Remote Sensing*, Vol.28, pp.5103−5122

342 Data Acquisition Applications

pp.5103−5122

Zhang, C.; Li, W. & Travis, D. (2007).Gaps-ll of SLC-off Landsat ETM plus satellite image using a geostatistical approach. *International Journal of Remote Sensing*, Vol.28,

## *Edited by Zdravko Karakehayov*

Data acquisition systems have numerous applications. This book has a total of 13 chapters and is divided into three sections: Industrial applications, Medical applications and Scientific experiments. The chapters are written by experts from around the world, while the targeted audience for this book includes professionals who are designers or researchers in the field of data acquisition systems. Faculty members and graduate students could also benefit from the book.

Data Acquisition Applications

Data Acquisition

Applications

*Edited by Zdravko Karakehayov*

Photo by chombosan / iStock