skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Simulation Tests of Methods in Evolution, Ecology, and Systematics: Pitfalls, Progress, and Principles
Complex statistical methods are continuously developed across the fields of ecology, evolution, and systematics (EES). These fields, however, lack standardized principles for evaluating methods, which has led to high variability in the rigor with which methods are tested, a lack of clarity regarding their limitations, and the potential for misapplication. In this review, we illustrate the common pitfalls of method evaluations in EES, the advantages of testing methods with simulated data, and best practices for method evaluations. We highlight the difference between method evaluation and validation and review how simulations, when appropriately designed, can refine the domain in which a method can be reliably applied. We also discuss the strengths and limitations of different evaluation metrics. The potential for misapplication of methods would be greatly reduced if funding agencies, reviewers, and journals required principled method evaluation. Expected final online publication date for the Annual Review of Ecology, Evolution, and Systematics, Volume 53 is November 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.  more » « less
Award ID(s):
1655701 2043905 1655344
PAR ID:
10348276
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Annual Review of Ecology, Evolution, and Systematics
Volume:
53
Issue:
1
ISSN:
1543-592X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Analyses of morphological disparity have been used to characterize and investigate the evolution of variation in the anatomy, function and ecology of organisms since the 1980s. While a diversity of methods have been employed, it is unclear whether they provide equivalent insights. Here, we review the most commonly used approaches for characterizing and analysing morphological disparity, all of which have associated limitations that, if ignored, can lead to misinterpretation. We propose best practice guidelines for disparity analyses, while noting that there can be no ‘one-size-fits-all’ approach. The available tools should always be used in the context of a specific biological question that will determine data and method selection at every stage of the analysis. 
    more » « less
  2. With decades of intensive study, Anolis lizards have emerged as a biological model system. We review how new research on anoles has advanced our understanding of ecology and evolution, challenging long-standing paradigms and opening new areas of inquiry. Recent anole research reveals how changes in behavior can restructure ecological communities and can both stimulate and stymie evolution, sometimes simultaneously. Likewise, investigation of anoles as spatial or phylogenetic evolutionary experiments has documented evolutionary repeatability across spatiotemporal scales, while also illuminating its limits. Current research places anoles as an emerging model for Anthropocene biology, with recent work illustrating how species respond as humans reconfigure natural habitats, alter the climate, and create novel environments and communities through urbanization and species introduction. Combined with ongoing methodological developments in genomics, phylogenetics, and ecology, the growing foundational knowledge of Anolis positions them as a powerful model system in ecology and evolution for years to come. Expected final online publication date for the Annual Review of Ecology, Evolution, and Systematics, Volume 54 is November 2023. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates. 
    more » « less
  3. Abstract Myrsidea Waterston, 1915 (Phthiraptera: Menoponidae) is the most diverse genus of avian chewing lice. Myrsidea has a global distribution, is thought to be highly host-specific, and parasitizes mostly passerine birds. However, the rate of taxonomic studies describing new species is relatively low, and it is thought that much of the diversity of Myrsidea is yet to be discovered. This low rate of taxonomic description for this genus, and many others, may be related to the time-consuming nature of morphological species description and a lack of expertise in louse taxonomy. Furthermore, most of the taxonomic revisions and reviews have focused on specific host families, and no comprehensive review of the morphology and molecular work of Myrsidea has been completed in the last 20 years. Here, we review the taxonomy and systematics of Myrsidea to (i) describe this chewing louse genus and its biological importance; (ii) describe current problems with its taxonomy; (iii) simplify and summarize morphological descriptions; (iv) summarize molecular data; and (v) provide a comprehensive checklist of the Myrsidea species, with all publications and localities of occurrence included. Together, we hope that this information will provide researchers with a single source of information on the genus Myrsidea, making it easier for work to proceed on its taxonomy, systematics, ecology, and evolution. Importantly, our work highlights important gaps in our knowledge of Myrsidea, providing guideposts on where future work on Myrsidea is needed. 
    more » « less
  4. Artificial intelligence (AI) is an emerging technology that has great potential in reducing energy consumption, environmental burdens, and operational risks of chemical production. However, large-scale applications of AI are still limited. One barrier is the lack of quantitative understandings of the potential benefits and risks of different AI applications. This study reviewed relevant AI literature and categorized those case studies by application types, impact categories, and application modes. Most studies assessed the energy, economic, and safety implications of AI applications, while few of them have evaluated the environmental impacts of AI, given the large data gaps and difficulties in choosing appropriate assessment methods. Based on the reviewed case studies in the chemical industry, we proposed a conceptual framework that encompasses approaches from industrial ecology, economics, and engineering to guide the selection of performance indicators and evaluation methods for a holistic assessment of AI's impacts. This framework could be a valuable tool to support the decision-making related to AI in the fundamental research and practical production of chemicals. Although this study focuses on the chemical industry, the insights of the literature review and the proposed framework could be applied to AI applications in other industries and broad industrial ecology fields. In the end, this study highlights future research directions for addressing the data challenges in assessing AI's impacts and developing AI-enhanced tools to support the sustainable development of the chemical industry. 
    more » « less
  5. Engineers are societal caregivers, solving problems for the betterment of society. However, both practitioners and students of engineering struggle to make concrete connections between empathy and their role as engineers. While general empathy scales exist, these scales do not describe empathy in specific engineering scenarios and other helping professions have unique empathy scales. To address both the empathetic nature of the engineering discipline and the lack of discipline specific empathy understanding, our research team has set out to create an engineering empathy scale (EES) funded by the National Science Foundation. Our research is guided by two research questions: How is empathy conceptually perceived, experienced, and shown in engineering specific situations? and Can engineering specific situations be used to measure empathy in engineering students, faculty, and practitioners? In this article, we present a systematic literature review of empathy in engineering and engineering education. Based on our selection criteria, we found 48 peer reviewed articles. Three themes of the articles emerged focusing on empathy in engineering: teaching and learning, design, and the role of empathy in engineering. We analyzed the articles to determine what areas of connection to the constructs of empathy and the current model of empathy in engineering are supported and which need more research to support. Lastly, we present our research plan to create and validate the EES, which will be aided by this literature review. 
    more » « less