skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Deep learning-based high-throughput phenotyping can drive future discoveries in plant reproductive biology
Abstract Key message Advances in deep learning are providing a powerful set of image analysis tools that are readily accessible for high-throughput phenotyping applications in plant reproductive biology. High-throughput phenotyping systems are becoming critical for answering biological questions on a large scale. These systems have historically relied on traditional computer vision techniques. However, neural networks and specifically deep learning are rapidly becoming more powerful and easier to implement. Here, we examine how deep learning can drive phenotyping systems and be used to answer fundamental questions in reproductive biology. We describe previous applications of deep learning in the plant sciences, provide general recommendations for applying these methods to the study of plant reproduction, and present a case study in maize ear phenotyping. Finally, we highlight several examples where deep learning has enabled research that was previously out of reach and discuss the future outlook of these methods.  more » « less
Award ID(s):
1832186
PAR ID:
10252261
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Plant Reproduction
Volume:
34
Issue:
2
ISSN:
2194-7953
Page Range / eLocation ID:
81 to 89
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Raza, Mudassar (Ed.)
    Cosegmentation is a newly emerging computer vision technique used to segment an object from the background by processing multiple images at the same time. Traditional plant phenotyping analysis uses thresholding segmentation methods which result in high segmentation accuracy. Although there are proposed machine learning and deep learning algorithms for plant segmentation, predictions rely on the specific features being present in the training set. The need for a multi-featured dataset and analytics for cosegmentation becomes critical to better understand and predict plants’ responses to the environment. High-throughput phenotyping produces an abundance of data that can be leveraged to improve segmentation accuracy and plant phenotyping. This paper introduces four datasets consisting of two plant species, Buckwheat and Sunflower, each split into control and drought conditions. Each dataset has three modalities (Fluorescence, Infrared, and Visible) with 7 to 14 temporal images that are collected in a high-throughput facility at the University of Nebraska-Lincoln. The four datasets (which will be collected under the CosegPP data repository in this paper) are evaluated using three cosegmentation algorithms: Markov random fields-based, Clustering-based, and Deep learning-based cosegmentation, and one commonly used segmentation approach in plant phenotyping. The integration of CosegPP with advanced cosegmentation methods will be the latest benchmark in comparing segmentation accuracy and finding areas of improvement for cosegmentation methodology. 
    more » « less
  2. Phenotyping plants is an essential component of any effort to develop new crop varieties. As plant breeders seek to increase crop productivity and produce more food for the future, the amount of phenotype information they require will also increase. Traditional plant phenotyping relying on manual measurement is laborious, time-consuming, error-prone, and costly. Plant phenotyping robots have emerged as a high-throughput technology to measure morphological, chemical and physiological properties of large number of plants. Several robotic systems have been developed to fulfill different phenotyping missions. In particular, robotic phenotyping has the potential to enable efficient monitoring of changes in plant traits over time in both controlled environments and in the field. The operation of these robots can be challenging as a result of the dynamic nature of plants and the agricultural environments. Here we discuss developments in phenotyping robots, and the challenges which have been overcome and others which remain outstanding. In addition, some perspective applications of the phenotyping robots are also presented. We optimistically anticipate that autonomous and robotic systems will make great leaps forward in the next 10 years to advance the plant phenotyping research into a new era. 
    more » « less
  3. Proximal remote sensing offers a powerful tool for high-throughput phenotyping of plants for assessing stress response. Bean plants, an important legume for human consumption, are often grown in regions with limited rainfall and irrigation and are therefore bred to further enhance drought tolerance. We assessed physiological (stomatal conductance and predawn and midday leaf water potential) and ground- and tower-based hyperspectral remote sensing (400 to 2,400 nm and 400 to 900 nm, respectively) measurements to evaluate drought response in 12 common bean and 4 tepary bean genotypes across 3 field campaigns (1 predrought and 2 post-drought). Hyperspectral data in partial least squares regression models predicted these physiological traits ( R 2 = 0.20 to 0.55; root mean square percent error 16% to 31%). Furthermore, ground-based partial least squares regression models successfully ranked genotypic drought responses similar to the physiologically based ranks. This study demonstrates applications of high-resolution hyperspectral remote sensing for predicting plant traits and phenotyping drought response across genotypes for vegetation monitoring and breeding population screening. 
    more » « less
  4. Abstract The presence of Arbuscular Mycorrhizal Fungi (AMF) in vascular land plant roots is one of the most ancient of symbioses supporting nitrogen and phosphorus exchange for photosynthetically derived carbon. Here we provide a multi-scale modeling approach to predict AMF colonization of a worldwide crop from a Recombinant Inbred Line (RIL) population derived fromSorghum bicolorandS. propinquum. The high-throughput phenotyping methods of fungal structures here rely on a Mask Region-based Convolutional Neural Network (Mask R-CNN) in computer vision for pixel-wise fungal structure segmentations and mixed linear models to explore the relations of AMF colonization, root niche, and fungal structure allocation. Models proposed capture over 95% of the variation in AMF colonization as a function of root niche and relative abundance of fungal structures in each plant. Arbuscule allocation is a significant predictor of AMF colonization among sibling plants. Arbuscules and extraradical hyphae implicated in nutrient exchange predict highest AMF colonization in the top root section. Our work demonstrates that deep learning can be used by the community for the high-throughput phenotyping of AMF in plant roots. Mixed linear modeling provides a framework for testing hypotheses about AMF colonization phenotypes as a function of root niche and fungal structure allocations. 
    more » « less
  5. Abstract Nondestructive plant phenotyping forms a key technique for unraveling molecular processes underlying plant development and response to the environment. While the emergence of high-throughput phenotyping facilities can further our understanding of plant development and stress responses, their high costs greatly hinder scientific progress. To democratize high-throughput plant phenotyping, we developed sets of low-cost image- and weight-based devices to monitor plant shoot growth and evapotranspiration. We paired these devices to a suite of computational pipelines for integrated and straightforward data analysis. The developed tools were validated for their suitability for large genetic screens by evaluating a cowpea (Vigna unguiculata) diversity panel for responses to drought stress. The observed natural variation was used as an input for a genome-wide association study, from which we identified nine genetic loci that might contribute to cowpea drought resilience during early vegetative development. The homologs of the candidate genes were identified in Arabidopsis (Arabidopsis thaliana) and subsequently evaluated for their involvement in drought stress by using available T-DNA insertion mutant lines. These results demonstrate the varied applicability of this low-cost phenotyping system. In the future, we foresee these setups facilitating the identification of genetic components of growth, plant architecture, and stress tolerance across a wide variety of plant species. 
    more » « less