An official website of the United States government
Differences in canopy architecture play a role in determining both the light and water use efficiency. Canopy architecture is determined by several component traits, including leaf length, width, number, angle, and phyllotaxy. Phyllotaxy may be among the most difficult of the leaf canopy traits to measure accurately across large numbers of individual plants. As a result, in simulations of the leaf canopies of grain crops such as maize and sorghum, this trait is frequently approximated as alternating 180 angles between sequential leaves. We explore the feasibility of extracting direct measurements of the phyllotaxy of sequential leaves from 3D reconstructions of individual sorghum plants generated from 2D calibrated images and test the assumption of consistently alternating phyllotaxy across a diverse set of sorghum genotypes. Using a voxel-carving-based approach, we generate 3D reconstructions from multiple calibrated 2D images of 366 sorghum plants representing 236 sorghum genotypes from the sorghum association panel. The correlation between automated and manual measurements of phyllotaxy is only modestly lower than the correlation between manual measurements of phyllotaxy generated by two different individuals. Automated phyllotaxy measurements exhibited a repeatability of R2 ¼ 0.41 across imaging timepoints separated by a period of two days. A resampling based genome wide association study (GWAS) identified several putative genetic associations with lower-canopy phyllotaxy in sorghum. This study demonstrates the potential of 3D reconstruction to enable both quantitative genetic investigation and breeding for phyllotaxy in sorghum and other grain crops with similar lant architectures.
more »
« less
Field‐based robotic leaf angle detection and characterization of maize plants using stereo vision and deep convolutional neural networks
Maize (Zea mays L.) is one of the three major cereal crops in the world. Leaf angle is an important architectural trait of crops due to its substantial role in light interception by the canopy and hence photosynthetic efficiency. Traditionally, leaf angle has been measured using a protractor, a process that is both slow and laborious. Efficiently measuring leaf angle under field conditions via imaging is challenging due to leaf density in the canopy and the resulting occlusions. However, advances in imaging technologies and machine learning have provided new tools for image acquisition and analysis that could be used to characterize leaf angle using three-dimensional (3D) models of field-grown plants. In this study, PhenoBot 3.0, a robotic vehicle designed to traverse between pairs of agronomically spaced rows of crops, was equipped with multiple tiers of PhenoStereo cameras to capture side-view images of maize plants in the field. PhenoStereo is a customized stereo camera module with integrated strobe lighting for high-speed stereoscopic image acquisition under variable outdoor lighting conditions. An automated image processing pipeline (AngleNet) was developed to measure leaf angles of nonoccluded leaves. In this pipeline, a novel representation form of leaf angle as a triplet of keypoints was proposed. The pipeline employs convolutional neural networks to detect each leaf angle in two-dimensional images and 3D modeling approaches to extract quantitative data from reconstructed models. Our study demonstrates the feasibility of using stereo vision to investigate the distribution of leaf angles in maize under field conditions. The proposed system is an efficient alternative to traditional leaf angle phenotyping and thus could accelerate breeding for improved plant architecture.
more »
« less
- Award ID(s):
- 2210259
- PAR ID:
- 10427901
- Date Published:
- Journal Name:
- Journal of Field Robotics
- ISSN:
- 1556-4959
- Page Range / eLocation ID:
- 1-20
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Understanding three‐dimensional (3D) root traits is essential to improve water uptake, increase nitrogen capture, and raise carbon sequestration from the atmosphere. However, quantifying 3D root traits by reconstructing 3D root models for deeper field‐grown roots remains a challenge due to the unknown tradeoff between 3D root‐model quality and 3D root‐trait accuracy. Therefore, we performed two computational experiments. We first compared the 3D model quality generated by five state‐of‐the‐art open‐source 3D model reconstruction pipelines on 12 contrasting genotypes of field‐grown maize roots. These pipelines included COLMAP, COLMAP+PMVS (Patch‐based Multi‐View Stereo), VisualSFM, Meshroom, and OpenMVG+MVE (Multi‐View Environment). The COLMAP pipeline achieved the best performance regarding 3D model quality versus computational time and image number needed. In the second test, we compared the accuracy of 3D root‐trait measurement generated by the Digital Imaging of Root Traits 3D pipeline (DIRT/3D) using COLMAP‐based 3D reconstruction with our current DIRT/3D pipeline that uses a VisualSFM‐based 3D reconstruction on the same dataset of 12 genotypes, with 5–10 replicates per genotype. The results revealed that (1) the average number of images needed to build a denser 3D model was reduced from 3000 to 3600 (DIRT/3D [VisualSFM‐based 3D reconstruction]) to around 360 for computational test 1, and around 600 for computational test 2 (DIRT/3D [COLMAP‐based 3D reconstruction]); (2) denser 3D models helped improve the accuracy of the 3D root‐trait measurement; (3) reducing the number of images can help resolve data storage problems. The updated DIRT/3D (COLMAP‐based 3D reconstruction) pipeline enables quicker image collection without compromising the accuracy of 3D root‐trait measurements.more » « less
-
Stimulated Raman projection tomography is a label-free volumetric chemical imaging technology allowing three-dimensional (3D) reconstruction of chemical distribution in a biological sample from the angle-dependent stimulated Raman scattering projection images. However, the projection image acquisition process requires rotating the sample contained in a capillary glass held by a complicated sample rotation stage, limiting the volumetric imaging speed, and inhibiting the study of living samples. Here, we report a tilt-angle stimulated Raman projection tomography (TSPRT) system which acquires angle-dependent projection images by utilizing tilt-angle beams to image the sample from different azimuth angles sequentially. The TSRPT system, which is free of sample rotation, enables rapid scanning of different views by a tailor-designed four-galvo-mirror scanning system. We present the design of the optical system, the theory, and calibration procedure for chemical tomographic reconstruction. 3D vibrational images of polystyrene beads and C. elegans are demonstrated in the C-H vibrational region.more » « less
-
Bucksch, Alexander Clarke (Ed.)Understanding root traits is essential to improve water uptake, increase nitrogen capture and accelerate carbon sequestration from the atmosphere. High-throughput phenotyping to quantify root traits for deeper field-grown roots remains a challenge, however. Recently developed open-source methods use 3D reconstruction algorithms to build 3D models of plant roots from multiple 2D images and can extract root traits and phenotypes. Most of these methods rely on automated image orientation (Structure from Motion)[1] and dense image matching (Multiple View Stereo) algorithms to produce a 3D point cloud or mesh model from 2D images. Until now the performance of these methods when applied to field-grown roots has not been compared tested commonly used open-source pipelines on a test panel of twelve contrasting maize genotypes grown in real field conditions[2-6]. We compare the 3D point clouds produced in terms of number of points, computation time and model surface density. This comparison study provides insight into the performance of different open-source pipelines for maize root phenotyping and illuminates trade-offs between 3D model quality and performance cost for future high-throughput 3D root phenotyping. DOI recognition was not working: https://doi.org/10.1002/essoar.10508794.2more » « less
-
Abstract Optimizing leaf angle and other canopy architecture traits has helped modern maize (Zea maysL.) become adapted to higher planting densities over the last 60 years. Traditional investigations into genetic control of leaf angle have focused on one leaf or the average of multiple leaves; as a result, our understanding of genetic control across multiple canopy levels is still limited. To address this, genetic mapping across four canopy levels was conducted in the present study to investigate the genetic control of leaf angle across the canopy. We developed two populations of doubled haploid lines derived from three inbreds with distinct leaf angle phenotypes. These populations were genotyped with genotyping‐by‐sequencing and phenotyped for leaf angle at four different canopy levels over multiple years. To understand how leaf angle changes across the canopy, the four measurements were used to derive three additional traits. Composite interval mapping was conducted with the leaf‐specific measurements and the derived traits. A set of 59 quantitative trait loci (QTLs) were uncovered for seven traits, and two genomic regions were consistently detected across multiple canopy levels. Additionally, seven genomic regions were found to contain consistent QTLs with either relatively stable or dynamic effects at different canopy levels. Prioritizing the selection of QTLs with dynamic effects across the canopy will aid breeders in selecting maize hybrids with the ideal canopy architecture that continues to maximize yield on a per area basis under increasing planting densities.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1002/rob.22166
