skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: PhenoVision : A framework for automating and delivering research‐ready plant phenology data from field images
Abstract Plant phenology plays a fundamental role in shaping ecosystems, and global change‐induced shifts in phenology have cascading impacts on species interactions and ecosystem structure and function. Detailed, high‐quality observations of when plants undergo seasonal transitions such as leaf‐out, flowering and fruiting are critical for tracking causes and consequences of phenology shifts, but these data are often sparse and biased globally. These data gaps limit broader generalizations and forecasting improvements in the face of continuing disturbance. One solution to closing such gaps is to document phenology on field images taken by public participants. iNaturalist, in particular, provides global‐scale research‐grade data and is expanding rapidly.Here we utilize over 53 million field images of plants and millions of human annotations from iNaturalist—data spanning all angiosperms and drawn from across the globe—to train a computer vision model (PhenoVision) to detect the presence of fruits and flowers. PhenoVision utilizes a vision transformer architecture pretrained with a masked autoencoder to improve classification success, and it achieves high accuracy on held‐out test images for flower (98.5%) and fruit presence (95%), as well as a high level of agreement with an expert annotator (98.6% for flowers and 90.4% for fruits).Key to producing research‐ready phenology data is post‐calibration tuning and validation focused on reducing noise inherent in field photographs, and maximizing the true positive rate. We also develop a standardized set of quality metrics and metadata so that results can be used effectively by the community. Finally, we showcase how this effort vastly increases phenology data coverage, including regions of the globe where data have been limited before.Our end products are tuned models, new data resources and an application streamlining discovery and use of those data for the broader research and management community. We close by discussing next steps, including automating phenology annotations, adding new phenology targets, for example leaf phenology, and further integration with other resources to form a global central database integrating all in situ plant phenology resources.  more » « less
Award ID(s):
2514928 2223509 2419155
PAR ID:
10607983
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  ;  ;  ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Methods in Ecology and Evolution
Volume:
16
Issue:
8
ISSN:
2041-210X
Format(s):
Medium: X Size: p. 1763-1780
Size(s):
p. 1763-1780
Sponsoring Org:
National Science Foundation
More Like this
  1. Summary Plant phenology, the timing of recurrent biological events, shows key and complex response to climate warming, with consequences for ecosystem functions and services. A key challenge for predicting plant phenology under future climates is to determine whether the phenological changes will persist with more intensive and long‐term warming.Here, we conducted a meta‐analysis of 103 experimental warming studies around the globe to investigate the responses of four phenophases – leaf‐out, first flowering, last flowering, and leaf coloring.We showed that warming advanced leaf‐out and flowering but delayed leaf coloring across herbaceous and woody plants. As the magnitude of warming increased, the response of most plant phenophases gradually leveled off for herbaceous plants, while phenology responded in proportion to warming in woody plants. We also found that the experimental effects of warming on plant phenology diminished over time across all phenophases. Specifically, the rate of changes in first flowering for herbaceous species, as well as leaf‐out and leaf coloring for woody species, decreased as the experimental duration extended.Together, these results suggest that the real‐world impact of global warming on plant phenology will diminish over time as temperatures continue to increase. 
    more » « less
  2. Abstract Plant functional strategies change considerably as plants develop, driven by intraindividual variability in anatomical, morphological, physiological and architectural traits.Developmental trait variation arises through the complex interplay among genetically regulated phase change (i.e. ontogeny), increases in plant age and size, and phenotypic plasticity to changing environmental conditions. Although spatial drivers of intraspecific trait variation have received extensive research attention, developmentally driven intraspecific trait variation is largely overlooked, despite widespread occurrence.Ontogenetic trait variation is genetically regulated, leads to dramatic changes in plant phenotypes and evolves in response to predictable changes in environmental conditions as plants develop.Evidence has accumulated to support a general shift from fast to slow relative growth rates and from shade to sun leaves as plants develop from the highly competitive but shady juvenile niche to the stressful adult niche in the systems studied to date.Nonetheless, there are major gaps in our knowledge due to examination of only a few environmental factors selecting for the evolution of ontogenetic trajectories, variability in how ontogeny is assigned, biogeographic sampling biases on trees in temperate biomes, dependencies on a few broadly sampled leaf morphological traits and a lack of longitudinal studies that track ontogeny within individuals. Filling these gaps will enhance our understanding of plant functional ecology and provide a framework for predicting the effects of global change threats that target specific ontogenetic stages. Read the freePlain Language Summaryfor this article on the Journal blog. 
    more » « less
  3. Summary Heat waves occurring during droughts can have a devastating impact on yield, especially if they happen during the flowering and seed set stages of the crop cycle. Global warming and climate change are driving an alarming increase in the frequency and intensity of combined drought and heat stress episodes, critically threatening global food security.Because high temperature is detrimental to reproductive processes, essential for plant yield, we measured the inner temperature, transpiration, sepal stomatal aperture, hormone concentrations and transcriptomic response of closed soybean flowers developing on plants subjected to a combination of drought and heat stress.Here, we report that, during a combination of drought and heat stress, soybean plants prioritize transpiration through flowers over transpiration through leaves by opening their flower stomata, while keeping their leaf stomata closed. This acclimation strategy, termed ‘differential transpiration’, lowers flower inner temperature by about 2–3°C, protecting reproductive processes at the expense of vegetative tissues.Manipulating stomatal regulation, stomatal size and/or stomatal density of flowers could serve as a viable strategy to enhance the yield of different crops and mitigate some of the current and future impacts of global warming and climate change on agriculture. 
    more » « less
  4. Summary Leaf angle distribution (LAD) in forest canopies affects estimates of leaf area, light interception, and global‐scale photosynthesis, but is often simplified to a single theoretical value. Here, we present TLSLeAF (Terrestrial Laser Scanning Leaf Angle Function), an automated open‐source method of deriving LADs from terrestrial laser scanning.TLSLeAF produces canopy‐scale leaf angle and LADs by relying on gridded laser scanning data. The approach increases processing speed, improves angle estimates, and requires minimal user input. Key features are automation, leaf–wood classification, beta parameter output, and implementation in R to increase accessibility for the ecology community.TLSLeAF precisely estimates leaf angle with minimal distance effects on angular estimates while rapidly producing LADs on a consumer‐grade machine. We challenge the popular spherical LAD assumption, showing sensitivity to ecosystem type in plant area index and foliage profile estimates that translate toc. 25% andc. 11% increases in canopy net photosynthesis (c. 25%) and solar‐induced chlorophyll fluorescence (c. 11%).TLSLeAF can now be applied to the vast catalog of laser scanning data already available from ecosystems around the globe. The ease of use will enable widespread adoption of the method outside of remote‐sensing experts, allowing greater accessibility for addressing ecological hypotheses and large‐scale ecosystem modeling efforts. 
    more » « less
  5. Summary Foliar fungal endophytes are one of the most diverse guilds of symbiotic fungi found in the photosynthetic tissues of every plant lineage, but it is unclear how plant environments and leaf resource availability shape their diversity.We explored correlations between leaf nutrient availability and endophyte diversity amongPinus muricataandVaccinium ovatumplants growing across a soil nutrient gradient spanning a series of coastal terraces in Mendocino, California.Endophyte richness decreased in plants with higher leaf nitrogen‐to‐phosphorus ratios for both host species, but increased with sodium, which may be toxic to fungi at high concentrations. Isolation frequency, a proxy of fungal biomass, was not significantly predicted by any of the same leaf constituents in the two plant species.We propose that stressed plants can exhibit both low foliar nutrients or high levels of toxic compounds, and that both of these stress responses predict endophyte species richness. Stressful conditions that limit growth of fungi may increase their diversity due to the suppression of otherwise dominating species. Differences between the host species in their endophyte communities may be explained by host specificity, leaf phenology, or microclimates. 
    more » « less