<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Low-severity spruce beetle infestation mapped from high-resolution satellite imagery with a convolutional network</title></titleStmt>
			<publicationStmt>
				<publisher>ISPRS Journal of Photogrammetry and Remote Sensing</publisher>
				<date>06/01/2024</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10548008</idno>
					<idno type="doi">10.1016/j.isprsjprs.2024.05.013</idno>
					<title level='j'>ISPRS Journal of Photogrammetry and Remote Sensing</title>
<idno>0924-2716</idno>
<biblScope unit="volume">212</biblScope>
<biblScope unit="issue">C</biblScope>					

					<author>S Zwieback</author><author>J Young-Robertson</author><author>M Robertson</author><author>Y Tian</author><author>Q Chang</author><author>M Morris</author><author>J White</author><author>J Moan</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[Extensive mortality of susceptible spruce can be caused by spruce beetles at epidemic population levels, as in the ongoing outbreak in Southcentral Alaska. Although information on outbreak extent and severity underpins forest management and research, the data products available in Alaska have substantial gaps. Widely available high-resolution satellite imagery are a promising data source for detecting beetle kill because it is possible, though challenging, to identify individual trees. However, the applicability of automated deeplearning approaches for regional-scale mapping has not been evaluated. Here, we assess a deep convolutional network for mapping dead spruce in high-resolution (∼2 m) satellite imagery of Southcentral Alaska. The network identified dead spruce pixels across stand characteristics, achieving an average accuracy of 95%. To upscale to the stand scale, we mitigated overestimation of dead tree pixels at elevated severity by calibration. Stand-scale areal severity, the fraction of dead spruce pixels within a stand, was mapped with an RMSE of 0.02 at 90 m scale. The estimated severity exceeded 0.05 in fewer than 4% of the landscape, and approximately 90% of dead trees pixels were found in low-severity stands. Severity was weakly associated with stand-scale Landsat reflectance changes, a clear relation between SWIR reflectance change and severity only emerging above 0.1 severity. In conclusion, high-resolution satellite imagery are suited to automated mapping of beetle-associated kill at tree and stand scale across the severity spectrum. Such data products support forest and fire management and further understanding of the dynamics and consequences of beetle outbreaks.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.">Introduction</head><p>The spruce beetle (SB; Dendroctonus rufipennis) is the tree-killing insect that inflicts the greatest damage in Alaskan forests <ref type="bibr">(Werner et al., 2006)</ref>. The most recent, ongoing outbreak in Southcentral Alaska has affected &#8764;2 million acres since 2016 <ref type="bibr">(Fettig et al., 2022)</ref>. It had spread north to Cantwell and the surrounding Alaska Range by 2020 (FS-R10-FHP, 2021).</p><p>Regional mapping of infestation extent and severity is important for understanding and responding to outbreaks <ref type="bibr">(Fettig et al., 2022)</ref>. Existing maps have substantial gaps because operational monitoring in Alaska relies on survey flights, ground observations and manual interpretation of high-resolution imagery (FS-R10-FHP, 2021). Consequently, we lack baseline data for answering simple questions such as where and in what forest stands the majority of dead spruce are <ref type="bibr">found. et al., 2022)</ref>. In high-resolution (&#8764;2 m) satellite imagery, identifying individual trees is possible but more challenging <ref type="bibr">(White et al., 2005;</ref><ref type="bibr">Coops et al., 2006;</ref><ref type="bibr">Immitzer and Atzberger, 2014;</ref><ref type="bibr">Brandt et al., 2020)</ref>, but these data enable wide coverage and also automation through neural networks.</p><p>How accurately can convolutional networks identify dead spruce trees following a beetle outbreak from &#8764;2 m satellite imagery? Convolutional-network-based recognition of individual trees in &#8764;2 m resolution imagery is well established <ref type="bibr">(Li et al., 2016;</ref><ref type="bibr">Freudenberg et al., 2019;</ref><ref type="bibr">Mubin et al., 2019)</ref>, in particular in sparsely vegetated environments such as the Sahel <ref type="bibr">(Flood et al., 2019;</ref><ref type="bibr">Brandt et al., 2020;</ref><ref type="bibr">Reiner et al., 2023)</ref>. Identifying specific species or infested trees is more challenging, in particular in densely vegetated environments where partially overlapping tree crowns cannot be fully resolved in &#8764;2 m imagery <ref type="bibr">(Yao et al., 2021;</ref><ref type="bibr">Lassalle et al., 2022)</ref>. <ref type="bibr">Kislov et al. (2021)</ref> achieved a promising performance in mapping beetle-killed conifers in predominantly dense stands, emphasizing the network's ability to distinguish dead trees from spectrally similar objects such as boulders. However, the dependence of the accuracy on the infestation severity in pure and mixed stands remains unknown.</p><p>Here, we map dead spruce across the severity spectrum in Southcentral Alaska from high-resolution satellite images. We train and test a convolutional neural network to identify dead spruce pixels and upscale the results to stand-scale areal severity. As moderate-resolution satellite images could shed light on this and previous outbreaks of variable severity, we quantify pre-to post-outbreak changes in stand-scale reflectance. Our specific objectives are to:</p><p>1. evaluate the performance of convolutional network for identifying dead spruce pixels in high-resolution satellite imagery 2. determine the distribution of stand-scale areal severity derived from the tree-scale classification 3. assess the association of areal severity with changes in standscale Landsat reflectance</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.">Background</head><p>The spruce beetle is found in all forested regions in Alaska. Extended periods of low population levels can be interrupted by outbreaks, characterized by high beetle populations that can overcome and kill healthy trees <ref type="bibr">(Berg et al., 2006;</ref><ref type="bibr">Fettig et al., 2022)</ref>. In Alaska, large outbreaks have almost exclusively been recorded in Southcentral (SC) Alaska, south of the Alaska Range <ref type="bibr">(Holsten and Werner, 1990)</ref>. The ongoing outbreak started in SC Alaska in around 2016, moving north toward the Alaska Range (FS-R10-FHP, 2021). As of 2023, it approached the Alaskan Interior, where outbreaks have historically been smaller in size and number, with the exception of a &#8764;200,000-acre outbreak in the 1980s <ref type="bibr">(Holsten and Werner, 1990)</ref>.</p><p>During Alaskan outbreaks, SB preferentially attack and kill large, mature white spruce (Picea glauca) or Lutz spruce (P. &#215; lutzii). However, Sitka spruce (P. sitchensis), smaller white spruce and black spruce (P. mariana) are also attacked <ref type="bibr">(Berg et al., 2006)</ref>. SB larvae and adults consume the phloem, potentially girdling the tree and inducing carbon starvation <ref type="bibr">(Werner et al., 2006)</ref>. Successful colonization is conditional on SB and its symbiotic fungi's subjugation of the host's defense, the effectiveness of which varies with such factors as tree age and drought <ref type="bibr">(Doak, 2004;</ref><ref type="bibr">Ott et al., 2021)</ref>. The expansion of the current outbreak toward the Alaskan Interior raises questions about host tree defense and SB winter survival in a climate previously thought unconducive to large outbreaks <ref type="bibr">(Holsten and Werner, 1990)</ref>.</p><p>The controls on infestation severity include stand composition, tree defenses and SB population numbers. Dense, almost pure stands of large, slowly-growing hosts are most heavily affected in terms of killed trees per area and, to a lesser extent, individual tree mortality <ref type="bibr">(Doak, 2004)</ref>. Large trees in dense stands are thought to be more heavily attacked and less resistant to infestation <ref type="bibr">(Holsten and Werner, 1990;</ref><ref type="bibr">Werner et al., 2006)</ref>, but younger trees and trees in mixed stands are also affected, particularly in large outbreaks. Tree defenses are influenced by abiotic factors such as drought or wind damage and tree factors like bark thickness and phloem chemistry <ref type="bibr">(Reynolds and Holsten, 1996;</ref><ref type="bibr">Werner et al., 2006)</ref>. Stand composition and host resistance impact SB population dynamics, as do meteorological conditions and SB predators and parasites <ref type="bibr">(Berg et al., 2006)</ref>.</p><p>Spruce beetle outbreaks modify stand composition, ecosystem services and land surface processes. The death of large spruce promotes growth of the surviving trees <ref type="bibr">(Sherriff et al., 2011;</ref><ref type="bibr">Campbell et al., 2019)</ref>. Changes to the understory vegetation are varied, as <ref type="bibr">Matsuoka et al. (2001)</ref> reported increased abundance of shrubs in the Copper River Basin, whereas grasses increased on the Kenai Peninsula <ref type="bibr">(Holsten et al., 1995)</ref>. Dense grass, dead trees and associated litter can impact wildfire risk and behavior <ref type="bibr">(Schulz, 1995;</ref><ref type="bibr">Hicke et al., 2012)</ref>. Falling snags, changes in habitat, decreasing value of timber resources, and the aesthetic deterioration of the landscape are additional concerns for stakeholders and the public <ref type="bibr">(Matsuoka et al., 2001;</ref><ref type="bibr">Berg et al., 2006)</ref>.</p><p>Answering open questions about post-outbreak changes in water and carbon cycling and impacts on soil temperatures also requires regional remote sensing products on outbreak severity <ref type="bibr">(Brown et al., 2010;</ref><ref type="bibr">Pfeifer et al., 2011;</ref><ref type="bibr">Pugh and Small, 2012;</ref><ref type="bibr">Reed et al., 2018)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.">Materials and methods</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1.">Study area and period</head><p>Our study area is located in the Susitna Lowlands <ref type="bibr">(Wahrhaftig, 1965)</ref>, its east and northwest margins straddling the Talkeetna Mountains and the Alaska Range, respectively (Fig. <ref type="figure">1a</ref>). The elevation varies from less than 200 m in the central part to more than 1500 m in the northwest (Fig. <ref type="figure">1b</ref>). We restricted most quantitative analyses to the TBL region between Talkeetna and Byers Lake, constrained by image availability and clouds. The TBL is dominated by poorly drained lowlands in the center and areas of moderate relief at the margins.</p><p>The Subarctic climate features cold and long winters <ref type="bibr">(Shulski and Wendler, 2007)</ref>, with mean temperatures averaging -14 &#8226; C in January in Talkeetna. For comparison, average January temperatures on the Cook Inlet coast (Anchorage) are -8 &#8226; C, while Fairbanks in the Alaskan Interior north of the Alaska Range is colder at -22 &#8226; C (Alaska Climate Research Center, 2023). In Talkeetna, the mean July temperature is 16 &#8226; C. Average rainfall totals from June through September of 350 mm are intermediate between maritime Anchorage and continental Fairbanks. The region is in the isolated permafrost zone, with greater permafrost prevalence in and north of the Alaska Range <ref type="bibr">(Jorgenson et al., 2008)</ref>.</p><p>Spruce-dominated forests are rare in the study area, in contrast to mixed forests, wetlands, and -at higher elevations -scrub, meadows and sparsely vegetated terrain. Terrain, substrate and drainage conditions exert the strongest apparent controls on vegetation cover <ref type="bibr">(Battan, 1982)</ref>, as wildfires have historically been limited in frequency and size. Forest stands dominated by white spruce are rare and small in the TBL region, preferentially occurring in floodplains and at higher elevations in the Northwest where conifer fraction exceed 0.4 (Fig. <ref type="figure">1c</ref>; from <ref type="bibr">Macander et al., 2022)</ref>. The lowlands predominant in the TBL area were classified as Southern Alaska Spruce-Birch-Herb (SBH) Forests and Southern Alaska Sphagnum Bogs and Herbaceous Fens (wetlands) by <ref type="bibr">Jorgenson and Meidlinger (2015)</ref>. SBH forests have conifer fractions of 10%-30% according to the <ref type="bibr">Macander et al. (2022)</ref> product shown in Fig. <ref type="figure">1c</ref>, dominated by beetle-preferred white spruce. Conversely, tree and conifer cover is sparse in wetlands and largely restricted to black spruce in moderately drained positions such as the transitions to SBH forests <ref type="bibr">(Jorgenson and Meidlinger, 2015)</ref>.</p><p>The region has been heavily affected by the SB outbreak that started in the mid-2010s <ref type="bibr">(Fettig et al., 2022)</ref>. Aerial Detection and Survey (ADS) flights by the USDA Forest Service, Forest Health Protection et al. ( and its partners between (2015-2019 flightlines shown in Fig. <ref type="figure">1a</ref>) and ground observations showed the oubreak reached the TBL area within the first two years, with substantial tree mortality being noted in 2018 (FS-R10-FHP, 2018). By 2021, exhaustion of large white spruce hosts had diverted activity to smaller white spruce and also black spruce (FS-R10-FHP, 2021). Meanwhile, the outbreak has continued to move north into the Alaska Range, reaching Cantwell in approximately 2020.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.">O1: Tree-scale dead spruce mapping</head><p>The dead spruce we sought to identify were defoliated spruce trees, as these can be recognized on high-resolution imagery. After a lethal SB attack, the needles fade and are ultimately shed within two to three years <ref type="bibr">(Werner et al., 2006)</ref>. We recognize ambiguity in this definition, as death and defoliation do not coincide and partial defoliation can occur. Furthermore, attribution to SB requires external information <ref type="bibr">(Wulder et al., 2009)</ref>.</p><p>Dead spruce pixels were automatically identified using a deep neural network. In such a semantic segmentation task, the network takes as input a high-resolution satellite image and produces as output a pseudoprobability that a given pixel covers a dead spruce tree. To train and test the neural network, we manually delineated dead trees.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.1.">High-resolution imagery</head><p>We had three Maxar Worldview-2 images at our disposal (Fig. <ref type="figure">1b</ref>). Two post-outbreak images from 2021-08-02 (1403 km 2 ) and 2018-07-07 (976 km 2 ) were complemented by one pre-outbreak image from 2013-07-14 (1930 km 2 ). Each image consisted of a panchromatic and a multispectral image with a posting of 0.5 and 2.0 m, respectively. We used seven multispectral bands: blue (427 nm), green (546 nm), yellow (608 nm), red (659 nm), red edge (724 nm), near infrared-1 (831 nm) and near-infrared-2 (908 nm). We omitted the coastal band due to strong atmospheric influences.</p><p>We used pansharpening to obtain a seven-band multispectral image with a spatial resolution of &#8764;1.5 m at a posting of 0.5 m. The Gram-Schmidt pansharpening <ref type="bibr">(Aiazzi et al., 2007)</ref> took as input the panchromatic and the coarser multispectral image and replaced in each multispectral band that part that could be linearly explained by the panchromatic band with the sharper panchromatic band.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.2.">Training and test data</head><p>We designated 111 training areas in the pre-infestation and postinfestation image from 2013-07-14 and 2021-08-02, respectively. Each training area was 512 m&#215; 512 m in size, encompassing 1024 2 pixels. The areas were selected with the goal of covering a spectrum of land cover types (including areas without trees) and stand severity.</p><p>To evaluate the performance on independent data, we designated 228 test areas in the two training images (but at different locations) and in an independent image from 2018-07-16. The 2018 image was taken near the peak of the outbreak, predating the peak in mortality. The test areas were 90 &#215; 90 m, the smaller size facilitating assessment of the stand-scale areal fraction estimates for objective two. The independent image enabled us to assess the transferability of the trained network to different conditions (e.g., earlier stage of infestation; different insolation and atmospheric conditions) in the same area.</p><p>Manual delineation of dead spruce trees was based on spectral, spatial and contextual clues <ref type="bibr">(Coops et al., 2006;</ref><ref type="bibr">Hart and Veblen, 2015)</ref>. In the visible to near-infrared spectrum, dead spruce in our study area are characterized by greater red relative to near infrared reflectance when compared to healthy white spruce (see Appendix). We predominantly relied on near-infrared-red-green composites like Fig. <ref type="figure">2</ref>, due to the distinct teal appearance of dead spruce. Further clues of salience included: round to triangular shape; characteristic scale of &#8764;1-8 m; triangular shadow (where free standing); in an environment where trees can grow (e.g., excluding rivers). While expert interpretation of high-resolution imagery is a standard method for assessing bark beetle damage <ref type="bibr">(Coops et al., 2006;</ref><ref type="bibr">Senf et al., 2017;</ref><ref type="bibr">FS-R10-FHP, 2021)</ref>, it is inherently subjective and contingent on image quality and timing <ref type="bibr">(Kislov et al., 2021)</ref>.</p><p>We digitized dead trees in two steps designed to ensure consistency. First, the operator (SZ, JW or MM) delineated all dead spruce in the area by drawing polygons, annotating challenging instances. These were then discussed with another person. Second, SZ reviewed and edited the area after &gt;one week. Our goal was for each delineated polygon to comprise an individual tree crown, but two or more closely spaced individuals may be contained in a single polygon where the image resolution precluded their separation. Challenging instances mainly arose in mixed forests such as Fig. <ref type="figure">2</ref>, where partial occlusion by broadleaf trees impedes reliable identification. We did not delineate ambiguous cases of small size, predominantly in poorly drained areas where black spruce are common. The ambiguity was due to a slightly elevated visible reflectance, potentially indicating early or nonlethal infestation. The digitization yielded 9194 and 3148 dead-spruce polygons in the training and test areas, respectively.</p><p>The manually drawn polygons were rasterized for training the network. The output raster, aligned with the input raster, stored the pseudo-probability of the pixel containing dead spruce. To account for uncertainty in location of the polygons, we spatially smoothed the raster with a Gaussian filter with &#120590; = 0.5 m. To account for uncertainty in class assignment, we mixed the pseudo-probability with a uniform distribution (''label smoothing'') with an admixture weight of &#120572; = 10 -3 . This pseudo-probability raster was the target that the network was trained to replicate.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.3.">Training by transfer learning</head><p>The deep convolutional network for semantic segmentation is designed to incorporate complex spatial, spectral and contextual patterns such as those we relied on for manual delineation <ref type="bibr">(LeCun and Bengio, 1998)</ref>. We used the DeepLabV3 convolutional neural network architecture with a pre-trained Resnet50 backbone <ref type="bibr">(Chen et al., 2017)</ref>, as available through Pytorch. The input multichannel image is fed to the encoder, comprising the backbone and an atrous spatial pyramid pooling component for extracting multiscale information. Subsequently, the decoder produces the classification output. To account for the required characteristics of the input and output, we modified the encoder and decoder, respectively. The encoder's first layer was enlarged from three to seven bands, matching the imagery. We initialized its weights by copying those of the original layer (scaled by 0.7) <ref type="bibr">(Pan et al., 2019)</ref> and disturbing them with zero-mean uncorrelated Gaussian noise, keeping the variance constant. The last layer of the decoder was replaced by a fully connected layer that yielded an output image with two bands (0: no dead spruce, 1: dead spruce), a softmax operation yielding the pseudo-probability &#119901; of dead spruce occurrence.</p><p>We trained the network by adjusting the parameters so as to minimize the misfit between the network's prediction and the manually derived labels from the training set. The initial parameter values were taken from a network that had been pre-trained for detecting objects such as bicycles on photographs from the COCO dataset <ref type="bibr">(Lin et al., 2014)</ref>. Our transfer learning (Pires de Lima and Marfurt, 2020) leverages the ability of the pre-trained network to extract salient visual patterns but guides it to recognize dead spruce trees in satellite images.</p><p>Training was achieved by minimizing a weighted cross entropy loss with respect to the augmented training samples <ref type="bibr">(Jadon, 2020)</ref>. The weight of the dead spruce class 1 was set to 20 times that of class 0 to account for class imbalance. To minimize the loss, we employed the Adam optimizer with a learning rate of 10 -5 , batch size of eight, and 500 epochs. The data set was augmented <ref type="bibr">(Shorten and Khoshgoftaar, 2019)</ref> by random cropping to 512 &#215; 512 pixels (discarding three quarters of the input training image), flipping and changes in brightness and contrast for each input channel.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2.4.">Tree-scale evaluation</head><p>To quantify the classification performance, we compared the pseudo-probability &#119901; from the convolutional network with the independent, manually derived test data across pixels. From a binary classification result based on &#119901; &gt; 0.5, we computed the confusion matrix with respect to the test data by counting the pixels corresponding to true positives (TP; pixel contains a dead spruce and was classified as such), true negatives (TN), false negatives (FN) and false positives (FP) across all test areas. We computed three tree-scale (i.e., 0.5 m m pixels) metrics; first, the overall accuracy accuracy = TP + TN TP + TN + FP + FN .</p><p>(1)</p><p>Second, the false positive rate,</p><p>measures the fraction of pixels without dead spruce that were incorrectly classified as containing dead spruce. Third, the true positive rate,</p><p>measures what fraction of pixels containing dead spruce were recognized as such by the convolutional network.</p><p>We computed these three metrics separately for (i) the same images as were used for training <ref type="bibr">(2013,</ref><ref type="bibr">2021)</ref> and (ii) for the independent image (2018).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3.">O2: Stand-scale severity from tree-scale classification</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3.1.">Stand-scale severity</head><p>We upscaled the tree-scale binary classification to gridded areal severity estimates at the stand scale, focusing on three stand scales &#119904; between 30 and 250 m. In absence of reliable forest stand data products, we report the stand-scale results on grids with uniform sampling distance &#119904;.</p><p>Stand-scale areal severity <ref type="bibr">(Hart and Veblen, 2015)</ref>, f , was estimated from the network-derived tree-scale pseudo-probability through</p><p>where |&#8901;| denotes set cardinality. The set &#57916; &#119904; consists of all the 0.5 m pixels within a stand-scale pixel of size &#119904;&#215;&#119904;, and the pseudo-probability of the 0.5 m-pixel &#119898; is denoted by &#119901; &#119898; . The definition of areal severity differs from other common intensity metrics. The unitless f refers to the crown area of dead trees (estimated at a scale determined by the high-resolution image) within a given area, similar to the mortality area within a grid cell computed by <ref type="bibr">Meddens et al. (2013)</ref>. As the denominator in Eq. ( <ref type="formula">4</ref>) is the total area, f needs to be distinguished from metrics that normalize by the treed area, the number of suitable host trees or the number of trees. For instance, the ADS intensity classification the operator assigns is based on trees with canopy fading (as opposed to needle loss) per treed area (Jason Moan, personal communication), rendering direct comparison difficult.</p><p>We obtained calibrated severity estimates f c from the raw severity estimate f to compensate bias in f at elevated severity. The calibration curve f c ( f ) was established at 90 m and subsequently also applied at 30 and 250 m. Specifically, we modeled logit( f ), the logarithm of the odds of f , as</p><p>(5)</p><p>We estimated &#120573; &#8901; by minimizing the least-squares misfit with respect to &#119891; , the severity from the manually delineated polygons in the test areas in the training images. The constraints &#120573; 1 &#8805; 0 and &#120573; 3 &#8805; 0 were non-binding at the optimum. We evaluated the f c severity estimates at 90 m using the root mean square error (RMSE) and &#119877; 2 with respect to the test data for (i) the training images and (ii) the independent image.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.3.2.">Distribution of severity across scales</head><p>We quantified the distribution of areal severity across scales &#119904; &#8712; {30, 90, 250 m} from the 2021 post-infestation image in three ways. First, we derived spatial maps. Second, we computed cumulative histograms of f c over &#57909; &#119904; , the set of all stands of scale &#119904; in the TBL region. Third, we evaluated the cumulative areal mortality in dependence of the areal severity &#119891; through</p><p>where the Iverson bracket [&#119902;] evaluates to one when &#119902; is true and to zero otherwise. If half the dead-spruce pixels are in stands with areal severity of no more than 10%, then &#57903; &#119904; (0.1) = 0.5.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.4.">O3: Spectral changes in stand-scale reflectance</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.4.1.">Stand-scale spectral changes from landsat</head><p>We contrasted pre-to post-infestation Landsat spectral changes at the stand scale (30, 90, and 250 m). We opted for a simple differencing approach because of the paucity (&#8764;2/yr) of suitable Landsat images in this cloudy region. Increasing image availability favors time series approaches that account for changes on subseasonal to decadal time scales <ref type="bibr">(Senf et al., 2015;</ref><ref type="bibr">Hais et al., 2016;</ref><ref type="bibr">Ye et al., 2021)</ref>.</p><p>We mapped the difference &#120549; in shortwave infrared (SWIR) reflectance and a normalized difference index (NDI). These two quantities are proven indicators of beetle-killed trees, but including additional observables can enhance detection and attribution performance <ref type="bibr">(Cohen et al., 2018)</ref>. Increased SWIR reflectance is commonly used for identifying vegetation mortality <ref type="bibr">(Senf et al., 2017;</ref><ref type="bibr">Zhu et al., 2020)</ref>, and beetle-killed spruce show a pronounced increase in reflectance above 1.5 &#956; m in our study area (see Appendix). We also used a normalized index that compares the SWIR with the near infrared (NIR) reflectance,</p><p>exploiting the opposite direction of change in the NIR and SWIR upon tree death. It is the negative of the normalized burn ratio (NBR), historically the most popular indicator for bark beetle mapping <ref type="bibr">(Kennedy et al., 2012;</ref><ref type="bibr">Senf et al., 2015)</ref>. We computed the temporal difference in the SWIR reflectance and NDI mean from Landsat by subtracting the post-outbreak (2019-2021; day of year 175-227) mean from the pre-outbreak (2014-2016) mean. The standard error was computed assuming uncorrelated errors with constant variance. For Landsat, we processed Collection 2 Level 2 images from Landsat 8 and 5 with total cloud cover of less than 15%, retaining those NIR and SWIR2 surface reflectance measurements that met the pixel-level cloud Quality Assessment (QA) based on bits 1-5. In addition to the native 30 m posting, we also evaluated the differences at 90 m and 250 m scale.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.4.2.">Association with areal severity</head><p>Kernel density estimation was used to determine the stand-scale spatial association between the spectral changes and areal severity inferred from the convolutional neural network. We computed the kernel density for (i) those pixels with more than 10% conifer fraction according to <ref type="bibr">Macander et al. (2022)</ref> and (ii) all pixels in the TBL area.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.">Results</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1.">O1: Tree-scale dead spruce mapping</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1.1.">Classification results</head><p>Fig. <ref type="figure">3</ref> shows tree-scale classification results of eight test areas spanning a range of stand characteristics and infestation severity.</p><p>The network recognized dense white spruce across a range of areal severity (a-d). In the low-density stands in (a-b), all dead spruce were recognized. In (b), two spruce not included in the manual delineation due to insufficient spectral contrast were identified by the network. The network also identified dead spruce in stands with greater density and severity (c-d).</p><p>The network correctly assigned low &#119901; to healthy white spruce (e), black spruce (f) and wetlands (f).</p><p>Three weaknesses are apparent in Fig. <ref type="figure">3</ref>. First, the inflated size of dead spruce in the classification results, most pronounced in the high-severity stand (d). Second, in dense mixed forests dominated by deciduous broadleaf trees (g), the network missed dead spruce partially occluded by other trees. Third, panel (h) shows a rare example of a non-tree object that was assigned &#119901; &#8819; 0.5.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.1.2.">Performance assessment</head><p>The accuracy across all test areas was 0.95. Fig. <ref type="figure">4a</ref> shows that the network performance was almost identical for the images used during training (2021: late in outbreak; 2013: pre-outbreak) and for the 2018 image earlier in the outbreak. The accuracy decreased with the areal severity &#119891; determined from the manually delineated polygons.</p><p>The false positive rate FPR increased with severity &#119891; , exceeding 0.2 for elevated-severity stands (Fig. <ref type="figure">4b</ref>). In the examples from Fig. <ref type="figure">3</ref> imaged in 2021, the false positives corresponded to the inflated size of mapped dead trees.</p><p>The true positive rate TPR was on the order of 90%, with best performance for high-severity stands. TPR was lower for stands with low and moderate severity. In the mixed forest stand of Fig. <ref type="figure">3g</ref> imaged in 2021, the TPR was diminished because the network assigned lower &#119901; to partially occluded dead spruce.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2.">O2: Stand-scale severity and its distribution</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2.1.">Calibration and assessment</head><p>Calibration was required for upscaling tree-scale classification results to 90 m stand-scale areal severity. The uncalibrated severity estimates f overestimated the severity &#119891; from manual delineation in the test areas. Fig. <ref type="figure">5a</ref> shows that f over test areas in the same images as used for training <ref type="bibr">(2013,</ref><ref type="bibr">2021)</ref> was accurate for low &#119891; &#8818; 0.03 but overestimated &#119891; by more than a factor of 2 &#119891; &#8819; 0.1. We corrected for this by applying the calibration curve to obtain f c from f . The same curve (from the 2013 and 2021 test areas) also reduced the overestimation in the 2018 image (Fig. <ref type="figure">5b</ref>), reducing f &#8776; 0.2 to f c &#8776; 0.1 for &#119891; &#8776; 0.1.</p><p>The calibrated severity estimate f c achieved root-mean-square errors (RMSE) of better than 0.02 (Fig. <ref type="figure">5c</ref>). The performance was worse at elevated severity, with RMSEs of up to 0.03.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.2.2.">Distribution of areal severity</head><p>Areal severity f c at the 90 and 250 m stand scale was below 0.1 in most of the TBL area in 2021 (Fig. <ref type="figure">6a-b</ref>). Landscape fragmentation was associated with a narrower f c range at 250 m. Mixed-forest severity of 0.03 to 0.10 contrasts with negligible severity in wetlands, treeless floodplains and above the timberline (Fig. <ref type="figure">6c</ref>). Stands with elevated severity f c &#8819; 0.10 occurred at higher elevations toward the northwestern corner and also in mature floodplains.</p><p>A heterogeneous subregion shown in Fig. <ref type="figure">6d</ref>-g contains patches with elevated severity, including a dense, almost pure stand of white spruce with f c &#8819; 0.2 highlighted Fig. <ref type="figure">6g</ref>. The subregion illustrates the patchy nature of f c in mixed forests with 0.02 &#8818; f c &#8818; 0.10 and consistently low values on tree-less terrain such as floodplains (Fig. <ref type="figure">6e</ref>).</p><p>Moderate to large areal severity locations were rare, as the cumulative histogram in Fig. <ref type="figure">7a</ref> shows 97% of the area had severity below 0.05 at &#119904; = 90 m stand scale. At &#119904; = 30 m, 70% had negligible severity f c &lt; 0.01 and 6% had at least moderate severity f c &gt; 0.05. At a scale of 250 m, the distribution was more narrow. The vast majority of dead spruce trees were identified in lowseverity stands (Fig. <ref type="figure">7b</ref>). At 90 and 250 m stand scales, more than 85% of the tree-scale (0.5 m) pixels inferred to contain dead spruce were in stands with low severity f c &#8804; 0.05. The percentage dropped to 63 at 30 m, while 96% were in areas with f c &#8804; 0.10.   </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4.3.">O3: Spectral changes in stand-scale reflectance</head><p>Pre-to post-outbreak spectral changes are apparent in high-severity areas. At 30 m scale, the stands identified by the network to have high severity in Fig. <ref type="figure">6d</ref> increased in Landsat SWIR reflectance by &#8819;0.03 (Fig. <ref type="figure">6f</ref>). Increases of &#8764;0.01 were observed in mixed stands with moderate severity but also in low-severity sites dominated by black spruce or largely tree-free wetlands.</p><p>Stand-scale SWIR reflectance changes were less associated with areal severity than with wetland dynamics. Across the study area (Fig. <ref type="figure">8a</ref>), changes in mean SWIR reflectance were dominated by wetlands, the elevated standard error in (b) reflecting strong spectral fluctuations. An association with severity at 30 and 90 m scale emerges at elevated severity f c &#8819; 0.1 in Fig. <ref type="figure">8d</ref>: an increase in &#120549;SWIR from 0.01 to 0.02 correlated with an increase in severity from 0.1 to 0.2. However, &#120549;SWIR alone was poor predictor of severity, especially when not excluding locations with low conifer cover such as most wetlands.</p><p>A noticeable SWIR reflectance change is only apparent in the highseverity stand in Fig. <ref type="figure">8e</ref>. It exhibited a sustained 0.02 increase between 2017 and 2019, in contrast to low and moderate severity stands.</p><p>The association between severity and change in NDI was weaker than that with the SWIR reflectance at 30 and 90 m scale (Fig. <ref type="figure">8d</ref>). While there was a tendency for increasing &#120549;NDI with increasing severity f c , the distribution of &#120549;NDI conditional on f c remained wide.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.">Discussion</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.1.">O1: Tree-scale dead spruce mapping performance</head><p>The classification performance from &#8764;2 m resolution satellite imagery was deemed satisfactory in stands from low to high severity. The overall accuracy of 95% (Fig. <ref type="figure">4</ref>) was comparable to the 94% balanced accuracy obtained by <ref type="bibr">Kislov et al. (2021)</ref>'s deep network for spruce trees killed by Ips typographus. Across our study area, false positives in locations without dead spruce were rare, in agreement with Kislov   <ref type="formula">2021</ref>)'s finding that convolutional networks accurately differentiate dead spruce from spectrally similar features such as boulders. Transferability of the network, as evidenced by comparable accuracy on an independent image, can expedite operational mapping.</p><p>The principal limitations were false negatives in dense mixed forests and the inflated size in elevated-severity stands (false positives). There is a trade-off between the two types of errors, as changing, say, the loss function tends to improve one to the detriment of the other <ref type="bibr">(Jadon, 2020)</ref>. Future studies could benefit from improved network architectures, post-classification cleaning, and -especially in mixed forestswinter scenes or higher-resolution satellite imagery with near-nadir viewing geometries <ref type="bibr">(Shrestha and Vanneschi, 2018;</ref><ref type="bibr">Brandt et al., 2020;</ref><ref type="bibr">Pires de Lima and Marfurt, 2020)</ref>. At the stand scale, the calibrated upscaling compensated for the dependence of false positives and negatives on severity, achieving a severity RMSE of better than 0.02 (Fig. <ref type="figure">5c</ref>).</p><p>Interpretation of the mapping performance needs to consider two limitations of the independent test data. First, the lack of spatially distributed ground data precludes an assessment of how accurately the training and test data captured partially or completely occluded dead spruce. Second, we were not able to directly identify a tree's species, whether it was alive or dead, or the mortality agent when assembling the test data. Ambiguities in mixed black-spruce-dominated stands highlight the inherent ambiguities in identifying beetle-killed spruce from high-resolution imagery alone <ref type="bibr">(Hart and Veblen, 2015)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.2.">O2: Most dead spruce in low-severity stands</head><p>In our study area, approximately 90% of dead spruce tree pixels were inferred in stands of low areal severity f c &#8818; 0.05 at 90 m scale. In this region with few dense stands of susceptible spruce, areal severity exceeding 0.10 was rare, such stands containing 1% of dead spruce (pixels). Conversely, stands with high SB-associated areal severity were more prevalent after an outbreak in Colorado <ref type="bibr">(Hart and Veblen, 2015)</ref>.</p><p>The low density of susceptible spruce hosts in mixed forests seemingly did not impede infestation. While dense stands of large white spruce have been observed to be preferentially attacked <ref type="bibr">(Werner et al., 2006)</ref>, <ref type="bibr">Doak (2004)</ref> did not find a significant relationship between stand density and the fraction of white spruce killed by SB in the Copper River Valley in Alaska during a 1990s outbreak. Conversely, a classification tree predicting SB-induced mortality on the Kenai peninsula trained by <ref type="bibr">Reynolds and Holsten (1996)</ref> identified spruce basal area relative to the total basal area and basal area of large-diameter spruce relative to spruce basal area as top-level predictors, both being positively associated with mortality. Owing to the incommensurability of field-based per-tree and remotely sensed per-area metrics such as our f c , development of remotely sensed estimates of the fraction of susceptible trees killed is necessary to enhance understanding of outbreak dynamics and consequences <ref type="bibr">(Senf et al., 2017)</ref>. While lighter SB consequences are expected in areas of low rather than high severity <ref type="bibr">(Wulder et al., 2009)</ref>, the impacts on the energy and water balance, biogeochemical cycling, succession, and habitat are poorly understood in Alaska <ref type="bibr">(Werner et al., 2006;</ref><ref type="bibr">Fettig et al., 2022)</ref>. Safety hazards from beetle-killed trees at the Byers Lake campground in our study area further illustrate that low to moderate areal severity infestation poses a concern to the public, land managers and stakeholders (Department of Natural Resources, State of Alaska, 2019). </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5.3.">O3: Suitability of stand-scale reflectance for mapping low-severity infestation</head><p>We identified major limitations. At low to moderate areal severity, Fig. <ref type="figure">8d</ref> shows poor association between severity and temporal changes in Landsat SWIR (reflectance and NDI), even when excluding locations with low conifer cover. Conversely, the increased SWIR reflectance in the few high-severity stands (Figs. <ref type="figure">6f</ref>, <ref type="figure">8e</ref>) supports the suitability of SWIR-based indices for tracking severe beetle infestations <ref type="bibr">(Senf et al., 2017;</ref><ref type="bibr">Cohen et al., 2018;</ref><ref type="bibr">Zhu et al., 2020)</ref>.</p><p>Mapping past and future outbreaks of low severity from Landsat alone will be challenging. The subtle reflectance changes (Fig. <ref type="figure">8d</ref>) are compounded by data sparsity due to frequent cloud cover, curtailing time series analysis to account for subseasonal variability. In contrast to historical outbreaks, the growing availability of hyperspectral, Cubesat multispectral, thermal infrared and synthetic aperture radar hold promise for early-stage infestation and mortality mapping <ref type="bibr">(Lausch et al., 2013;</ref><ref type="bibr">Immitzer and Atzberger, 2014;</ref><ref type="bibr">Einzmann et al., 2021;</ref><ref type="bibr">Zakrzewska and Kope&#263;, 2022)</ref>. The richness and frequency of data opens opportunities for machine learning approaches <ref type="bibr">(Cohen et al., 2018;</ref><ref type="bibr">Ye et al., 2021)</ref>, trained with, among other data sources, independent machine learning predictions from high-resolution imagery <ref type="bibr">(Kislov et al., 2021)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="6.">Conclusion</head><p>To map dead spruce at tree and stand scale across the severity spectrum in Southcentral Alaska, we trained, assessed and applied a convolutional neural network using satellite imagery of &#8764;2 m resolution. Our work addressed the knowledge gap of how well convolutional networks perform on such satellite images in which individual trees are more difficult to recognize than in &#8764;0.1 m drone images. Our principal findings are as follows. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Declaration of competing interest</head><p>The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Appendix. Shoot-scale spectra of healthy and dead spruce</head><p>To characterize spectral differences between healthy and dead white spruce, we collected shoot-scale field spectra using a PSR+ 3500 Field Spectroradiometer. The reflectance factor as a function of wavelength was determined by dividing the raw shoot-scale observations obtained using the fiber-optic probe (without lens, 10 cm distance) by white spectralon reference measurements. Data were acquired north of the TBL study region in July 2022.   <ref type="figure">A</ref>.9 compares the reflectance spectra for healthy (no signs of infestation) and dead (needles shed; signs of SB infestation). The clearest differences for dead versus healthy trees are the weakening of the green peak and red edge (residual red edge from understory vegetation?); decreased reflectance in the near-infrared; increased reflectance in the shortwave infrared; and weaker water absorption features.</p></div></body>
		</text>
</TEI>
