skip to main content


Title: Growth Stage Classification and Harvest Scheduling of Snap Bean Using Hyperspectral Sensing: A Greenhouse Study
The agricultural industry suffers from a significant amount of food waste, some of which originates from an inability to apply site-specific management at the farm-level. Snap bean, a broad-acre crop that covers hundreds of thousands of acres across the USA, is not exempt from this need for informed, within-field, and spatially-explicit management approaches. This study aimed to assess the utility of machine learning algorithms for growth stage and pod maturity classification of snap bean (cv. Huntington), as well as detecting and discriminating spectral and biophysical features that lead to accurate classification results. Four major growth stages and six main sieve size pod maturity levels were evaluated for growth stage and pod maturity classification, respectively. A point-based in situ spectroradiometer in the visible-near-infrared and shortwave-infrared domains (VNIR-SWIR; 400–2500 nm) was used and the radiance values were converted to reflectance to normalize for any illumination change between samples. After preprocessing the raw data, we approached pod maturity assessment with multi-class classification and growth stage determination with binary and multi-class classification methods. Results from the growth stage assessment via the binary method exhibited accuracies ranging from 90–98%, with the best mathematical enhancement method being the continuum-removal approach. The growth stage multi-class classification method used raw reflectance data and identified a pair of wavelengths, 493 nm and 640 nm, in two basic transforms (ratio and normalized difference), yielding high accuracies (~79%). Pod maturity assessment detected narrow-band wavelengths in the VIS and SWIR region, separating between not ready-to-harvest and ready-to-harvest scenarios with classification measures at the ~78% level by using continuum-removed spectra. Our work is a best-case scenario, i.e., we consider it a stepping-stone to understanding snap bean harvest maturity assessment via hyperspectral sensing at a scalable level (i.e., airborne systems). Future work involves transferring the concepts to unmanned aerial system (UAS) field experiments and validating whether or not a simple multispectral camera, mounted on a UAS, could incorporate < 10 spectral bands to meet the need of both growth stage and pod maturity classification in snap bean production.  more » « less
Award ID(s):
1827551
NSF-PAR ID:
10290131
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Remote Sensing
Volume:
12
Issue:
22
ISSN:
2072-4292
Page Range / eLocation ID:
3809
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Accurate, precise, and timely estimation of crop yield is key to a grower’s ability to proactively manage crop growth and predict harvest logistics. Such yield predictions typically are based on multi-parametric models and in-situ sampling. Here we investigate the extension of a greenhouse study, to low-altitude unmanned aerial systems (UAS). Our principal objective was to investigate snap bean crop (Phaseolus vulgaris) yield using imaging spectroscopy (hyperspectral imaging) in the visible to near-infrared (VNIR; 400–1000 nm) region via UAS. We aimed to solve the problem of crop yield modelling by identifying spectral features explaining yield and evaluating the best time period for accurate yield prediction, early in time. We introduced a Python library, named Jostar, for spectral feature selection. Embedded in Jostar, we proposed a new ranking method for selected features that reaches an agreement between multiple optimization models. Moreover, we implemented a well-known denoising algorithm for the spectral data used in this study. This study benefited from two years of remotely sensed data, captured at multiple instances over the summers of 2019 and 2020, with 24 plots and 18 plots, respectively. Two harvest stage models, early and late harvest, were assessed at two different locations in upstate New York, USA. Six varieties of snap bean were quantified using two components of yield, pod weight and seed length. We used two different vegetation detection algorithms. the Red-Edge Normalized Difference Vegetation Index (RENDVI) and Spectral Angle Mapper (SAM), to subset the fields into vegetation vs. non-vegetation pixels. Partial least squares regression (PLSR) was used as the regression model. Among nine different optimization models embedded in Jostar, we selected the Genetic Algorithm (GA), Ant Colony Optimization (ACO), Simulated Annealing (SA), and Particle Swarm Optimization (PSO) and their resulting joint ranking. The findings show that pod weight can be explained with a high coefficient of determination (R2 = 0.78–0.93) and low root-mean-square error (RMSE = 940–1369 kg/ha) for two years of data. Seed length yield assessment resulted in higher accuracies (R2 = 0.83–0.98) and lower errors (RMSE = 4.245–6.018 mm). Among optimization models used, ACO and SA outperformed others and the SAM vegetation detection approach showed improved results when compared to the RENDVI approach when dense canopies were being examined. Wavelengths at 450, 500, 520, 650, 700, and 760 nm, were identified in almost all data sets and harvest stage models used. The period between 44–55 days after planting (DAP) the optimal time period for yield assessment. Future work should involve transferring the learned concepts to a multispectral system, for eventual operational use; further attention should also be paid to seed length as a ground truth data collection technique, since this yield indicator is far more rapid and straightforward. 
    more » « less
  2. Farmers and growers typically use approaches based on the crop environment and local meteorology, many of which are labor-intensive, to predict crop yield. These approaches have found broad acceptance but lack real-time and physiological feedback for near-daily management purposes. This is true for broad-acre crops, such as snap bean, which is valued at hundreds of millions of dollars in the annual agricultural market. We aim to investigate the relationships between snap bean yield and plant spectral and biophysical information, collected using a hyperspectral spectroradiometer (400 to 2500 nm). The experiment focused on 48 single snap bean plants (cv. Huntington) in a controlled greenhouse environment during the growth period (69 days). We used applicable accuracy and precision metrics from partial least squares regression and cross-validation methods to evaluate the predictive ability of two harvest stages, namely an early-harvest and late-harvest stage, against our yield indicator (bean pod weight). Four different spectral data sets were used to investigate whether such oversampled, hyperspectral data sets could accurately and precisely model observed variability in yield, in terms of the coefficient of determination (R2) and root-mean-square error (RMSE). The objective of our approach hinges on the philosophy that selected spectral bands from this study, i.e., those that best explain yield variability, can be downsampled from a hyperspectral system for use in a more cost-effective, operational multispectral sensor. Our results suggested the optimal period for spectral evaluation of snap bean yield is 20 to 25 or 32 days prior to harvest for the early- and late-harvest stages, respectively, with the best model performing at a low RMSE (3.02 g/plant) and a high coefficient of determination (R2 = 0.72). An unmanned aerial systems-mounted, affordable, and wavelength-programmable multispectral imager, with bands corresponding to those identified, could provide a near real-time and reliable yield estimate prior to harvest. 
    more » « less
  3. Abstract Background Remote sensing instruments enable high-throughput phenotyping of plant traits and stress resilience across scale. Spatial (handheld devices, towers, drones, airborne, and satellites) and temporal (continuous or intermittent) tradeoffs can enable or constrain plant science applications. Here, we describe the technical details of TSWIFT (Tower Spectrometer on Wheels for Investigating Frequent Timeseries), a mobile tower-based hyperspectral remote sensing system for continuous monitoring of spectral reflectance across visible-near infrared regions with the capacity to resolve solar-induced fluorescence (SIF). Results We demonstrate potential applications for monitoring short-term (diurnal) and long-term (seasonal) variation of vegetation for high-throughput phenotyping applications. We deployed TSWIFT in a field experiment of 300 common bean genotypes in two treatments: control (irrigated) and drought (terminal drought). We evaluated the normalized difference vegetation index (NDVI), photochemical reflectance index (PRI), and SIF, as well as the coefficient of variation (CV) across the visible-near infrared spectral range (400 to 900 nm). NDVI tracked structural variation early in the growing season, following initial plant growth and development. PRI and SIF were more dynamic, exhibiting variation diurnally and seasonally, enabling quantification of genotypic variation in physiological response to drought conditions. Beyond vegetation indices, CV of hyperspectral reflectance showed the most variability across genotypes, treatment, and time in the visible and red-edge spectral regions. Conclusions TSWIFT enables continuous and automated monitoring of hyperspectral reflectance for assessing variation in plant structure and function at high spatial and temporal resolutions for high-throughput phenotyping. Mobile, tower-based systems like this can provide short- and long-term datasets to assess genotypic and/or management responses to the environment, and ultimately enable the spectral prediction of resource-use efficiency, stress resilience, productivity and yield. 
    more » « less
  4. Salt marshes are highly productive ecosystems relevant for Blue Carbon assessments, but information for estimating gross primary productivity (GPP) from proximal remote sensing (PRS) is limited. Temperate salt marshes have seasonal canopy structure and metabolism changes, defining different canopy phenological phases, GPP rates, and spectral reflectance. We combined multi-annual PRS data (i.e., PhenoCam, discrete hyperspectral measurements, and automated spectral reflectance sensors) with GPP derived from eddy covariance. We tested the performance of empirical models to predict GPP from 12 common vegetation indices (VIs; e.g., NDVI, EVI, PSRI, GCC), Sun-Induced Fluorescence (SIF), and reflectance from different areas of the electromagnetic spectrum (i.e., VIS-IR, RedEdge, IR, and SIF) across the annual cycle and canopy phenological phases (i.e., Greenup, Maturity, Senescence, and Dormancy). Plant Senescence Reflectance Index (PSRI) from hyperspectral data and the Greenness Index (GCC) from PhenoCam, showed the strongest relationship with daily GPP across the annual cycle and within phenological phases (r2=0.30–0.92). Information from the visible-infrared electromagnetic region (VIS-IR) coupled with a partial least square approach (PLSR) showed the highest data-model agreement with GPP, mainly because of its relevance to respond to physiological and structural changes in the canopy, compared with indices (e.g., GCC) that particularly react to changes in the greenness of the canopy. The most relevant electromagnetic regions to model GPP were ∼550 nm and ∼710 nm. Canopy phenological phases impose challenges for modeling GPP with VIs and the PLSR approach, particularly during Maturity, Senescence, and Dormancy. As more eddy covariance sites are established in salt marshes, the application of PRS can be widely tested. Our results highlight the potential to use canopy reflectance from the visible spectrum region for modeling annual GPP in salt marshes as an example of advances within the AmeriFlux network. 
    more » « less
  5. Summary

    Leaf optical properties impact leaf energy balance and thus leaf temperature. The effect of leaf development on mid‐infrared (MIR) reflectance, and hence thermal emissivity, has not been investigated in detail.

    We measured a suite of morphological characteristics, as well as directional‐hemispherical reflectance from ultraviolet to thermal infrared wavelengths (250 nm to 20 µm) of leaves from five temperate deciduous tree species over the 8 wk following spring leaf emergence.

    By contrast to reflectance at shorter wavelengths, the shape and magnitude of MIR reflectance spectra changed markedly with development. MIR spectral differences among species became more pronounced and unique as leaves matured. Comparison of reflectance spectra of intact vs dried and ground leaves points to cuticular development – and not internal structural or biochemical changes – as the main driving factor. Accompanying the observed spectral changes was a drop in thermal emissivity from about 0.99 to 0.95 over the 8 wk following leaf emergence.

    Emissivity changes were not large enough to substantially influence leaf temperature, but they could potentially lead to a bias in radiometrically measured temperatures of up to 3 K. Our results also pointed to the potential for using MIR spectroscopy to better understand species‐level differences in cuticular development and composition.

     
    more » « less