skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A cost‐effective maize ear phenotyping platform enables rapid categorization and quantification of kernels
SUMMARY High‐throughput phenotyping systems are powerful, dramatically changing our ability to document, measure, and detect biological phenomena. Here, we describe a cost‐effective combination of a custom‐built imaging platform and deep‐learning‐based computer vision pipeline. A minimal version of the maize (Zea mays) ear scanner was built with low‐cost and readily available parts. The scanner rotates a maize ear while a digital camera captures a video of the surface of the ear, which is then digitally flattened into a two‐dimensional projection. Segregating GFP and anthocyanin kernel phenotypes are clearly distinguishable in ear projections and can be manually annotated and analyzed using image analysis software. Increased throughput was attained by designing and implementing an automated kernel counting system using transfer learning and a deep learning object detection model. The computer vision model was able to rapidly assess over 390 000 kernels, identifying male‐specific transmission defects across a wide range of GFP‐marked mutant alleles. This includes a previously undescribed defect putatively associated with mutation of Zm00001d002824, a gene predicted to encode a vacuolar processing enzyme. Thus, by using this system, the quantification of transmission data and other ear and kernel phenotypes can be accelerated and scaled to generate large datasets for robust analyses.  more » « less
Award ID(s):
1832186
PAR ID:
10385123
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
The Plant Journal
Volume:
106
Issue:
2
ISSN:
0960-7412
Page Range / eLocation ID:
p. 566-579
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Key message Advances in deep learning are providing a powerful set of image analysis tools that are readily accessible for high-throughput phenotyping applications in plant reproductive biology. High-throughput phenotyping systems are becoming critical for answering biological questions on a large scale. These systems have historically relied on traditional computer vision techniques. However, neural networks and specifically deep learning are rapidly becoming more powerful and easier to implement. Here, we examine how deep learning can drive phenotyping systems and be used to answer fundamental questions in reproductive biology. We describe previous applications of deep learning in the plant sciences, provide general recommendations for applying these methods to the study of plant reproduction, and present a case study in maize ear phenotyping. Finally, we highlight several examples where deep learning has enabled research that was previously out of reach and discuss the future outlook of these methods. 
    more » « less
  2. Abstract Maize ear size and kernel number differ among lines, however, little is known about the molecular basis of ear length and its impact on kernel number. Here, we characterize a quantitative trait locus,qEL7, to identify a maize gene controlling ear length, flower number and fertility.qEL7encodes 1-aminocyclopropane-1- carboxylate oxidase2 (ACO2), a gene that functions in the final step of ethylene biosynthesis and is expressed in specific domains in developing inflorescences. Confirmation ofqEL7by gene editing ofZmACO2leads to a reduction in ethylene production in developing ears, and promotes meristem and flower development, resulting in a ~13.4% increase in grain yield per ear in hybrids lines. Our findings suggest that ethylene serves as a key signal in inflorescence development, affecting spikelet number, floral fertility, ear length and kernel number, and also provide a tool to improve grain productivity by optimizing ethylene levels in maize or in other cereals. 
    more » « less
  3. Abstract The developmental genetics of reproductive structure control in maize must consider both the staminate florets of the tassel and the pistillate florets of the ear synflorescences. Pistil abortion takes place in the tassel florets, and stamen arrest is affected in ear florets to give rise to the monoecious nature of maize. Gibberellin (GA) deficiency results in increased tillering, a dwarfed plant syndrome, and the retention of anthers in the ear florets of maize. Thesilkless1mutant results in suppression of silks in the ear. We demonstrate in this study that jasmonic acid (JA) and GA act independently and show additive phenotypes resulting in androeciousdwarf1;silkless1double mutant plants. The persistence of pistils in the tassel can be induced by multiple mechanisms, including JA deficiency, GA excess, genetic control of floral determinacy, and organ identity. Thesilkless1mutant can suppress both silks in the ear and the silks in the tassel of JA‐deficient and AP2 transcription factortasselseedmutants. We previously demonstrated that GA production was required for brassinosteroid (BR) deficiency to affect persistence of pistils in the tassel. We find that BR deficiency affects pistil persistence by an independent mechanism from thesilkless1mutant and JA pathway. Thesilkless1mutant did not prevent the formation of pistils in the tassel bynana plant2in double mutants. In addition, we demonstrate that there is more to thesilkless1mutant than just a suppression of pistil growth. We document novel phenotypes ofsilkless1mutants including weakly penetrant ear fasciation and anther persistence in the ear florets. Thus, the JA/AP2 mechanism of pistil retention in the tassel and silk growth in the ear are similarly sensitive to loss of the SILKLESS1 protein, while the BR/GA mechanism is not. 
    more » « less
  4. IntroductionComputer vision and deep learning (DL) techniques have succeeded in a wide range of diverse fields. Recently, these techniques have been successfully deployed in plant science applications to address food security, productivity, and environmental sustainability problems for a growing global population. However, training these DL models often necessitates the large-scale manual annotation of data which frequently becomes a tedious and time-and-resource- intensive process. Recent advances in self-supervised learning (SSL) methods have proven instrumental in overcoming these obstacles, using purely unlabeled datasets to pre-train DL models. MethodsHere, we implement the popular self-supervised contrastive learning methods of NNCLR Nearest neighbor Contrastive Learning of visual Representations) and SimCLR (Simple framework for Contrastive Learning of visual Representations) for the classification of spatial orientation and segmentation of embryos of maize kernels. Maize kernels are imaged using a commercial high-throughput imaging system. This image data is often used in multiple downstream applications across both production and breeding applications, for instance, sorting for oil content based on segmenting and quantifying the scutellum’s size and for classifying haploid and diploid kernels. Results and discussionWe show that in both classification and segmentation problems, SSL techniques outperform their purely supervised transfer learning-based counterparts and are significantly more annotation efficient. Additionally, we show that a single SSL pre-trained model can be efficiently finetuned for both classification and segmentation, indicating good transferability across multiple downstream applications. Segmentation models with SSL-pretrained backbones produce DICE similarity coefficients of 0.81, higher than the 0.78 and 0.73 of those with ImageNet-pretrained and randomly initialized backbones, respectively. We observe that finetuning classification and segmentation models on as little as 1% annotation produces competitive results. These results show SSL provides a meaningful step forward in data efficiency with agricultural deep learning and computer vision. 
    more » « less
  5. Abstract BackgroundMaize (Zea mays ssp. mays) is 1 of 3 crops, along with rice and wheat, responsible for more than one-half of all calories consumed around the world. Increasing the yield and stress tolerance of these crops is essential to meet the growing need for food. The cost and speed of plant phenotyping are currently the largest constraints on plant breeding efforts. Datasets linking new types of high-throughput phenotyping data collected from plants to the performance of the same genotypes under agronomic conditions across a wide range of environments are essential for developing new statistical approaches and computer vision–based tools. FindingsA set of maize inbreds—primarily recently off patent lines—were phenotyped using a high-throughput platform at University of Nebraska-Lincoln. These lines have been previously subjected to high-density genotyping and scored for a core set of 13 phenotypes in field trials across 13 North American states in 2 years by the Genomes 2 Fields Consortium. A total of 485 GB of image data including RGB, hyperspectral, fluorescence, and thermal infrared photos has been released. ConclusionsCorrelations between image-based measurements and manual measurements demonstrated the feasibility of quantifying variation in plant architecture using image data. However, naive approaches to measuring traits such as biomass can introduce nonrandom measurement errors confounded with genotype variation. Analysis of hyperspectral image data demonstrated unique signatures from stem tissue. Integrating heritable phenotypes from high-throughput phenotyping data with field data from different environments can reveal previously unknown factors that influence yield plasticity. 
    more » « less