skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Missing Data Reporting and Analysis in Motor Learning and Development: A Systematic Review of Past and Present Practices
Missing data incidents are common in experimental studies of motor learning and development. Inadequate handling of missing data may lead to serious problems, such as addition of bias, reduction in power, and so on. Thus, this study aimed to conduct a systematic review of the past (2007) and present (2017) practices used for reporting and analyzing missing data in motor learning and development. For this purpose, the authors reviewed 309 articles from five journals focusing on motor learning and development studies and published in 2007 and 2017. The authors carefully reviewed each article using a six-stage review process to assess the reporting and analyzing practices. Reporting of missing data along with reasons for their presence was consistently high across time, which slightly increased in 2017. Researchers predominantly used older methods (mainly deletion) for analysis, which only showed a small increase in the use of newer methods in 2017. While reporting practices were exemplary, missing data analysis calls for serious attention. Improvements in missing data handling may have the merit to address some of the major issues, such as underpowered studies, in motor learning and development.  more » « less
Award ID(s):
1654929
PAR ID:
10317539
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Journal of Motor Learning and Development
Volume:
9
Issue:
1
ISSN:
2325-3193
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Since their introduction to North America in the 1980s, research to develop effective control tools for invasive mussels (Dreissena polymorpha and D. rostriformis bugensis) has been ongoing across various research institutions using a range of testing methods. Inconsistencies in experimental methods and reporting present challenges for comparing data, repeating experiments, and applying results. The Invasive Mussel Collaborative established the Toxicity Testing Work Group (TTWG) in 2019 to identify “best practices” and guide development of a standard framework for dreissenid mussel toxicity testing protocols. We reviewed the literature related to laboratory-based dreissenid mussel toxicity tests and determined the degree to which standard guidelines have been used and their applicability to dreissenid mussel testing. We extracted detailed methodology from 99 studies from the peer-reviewed and gray literature and conducted a separate analysis for studies using presettlement and postsettlement mussels. We identified specific components of methods and approaches that could be refined or standardized for dreissenid mussels. These components included species identification, collection methods, size/age class distinction, maintenance practices, testing criteria, sample size, response measures, reporting parameters, exposure methods, and mortality criteria. We consulted experts in the field of aquatic toxicology and dreissenid mussel biology on our proposed. The final recommendations contained in the present review are based on published standard guidelines, methods reported in the published and gray literature, and the expertise of TTWG members and an external panel. In addition, our review identifies research needs for dreissenid mussel testing including improved methods for early–life stage testing, comparative data on life stages and between dreissenid mussel species, inclusion of a reference toxicant, and additional testing of nontarget species (i.e., other aquatic organisms). Environ Toxicol Chem 2023;00:1–18. © 2023 His Majesty the King in Right of Canada. Environmental Toxicology and Chemistry published by Wiley Periodicals LLC on behalf of SETAC. Reproduced with the permission of the Minister of Environment and Climate Change Canada. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA. 
    more » « less
  2. The objective of this article was to review existing research to assess the evidence for predictive processing (PP) in sign language, the conditions under which it occurs, and the effects of language mastery (sign language as a first language, sign language as a second language, bimodal bilingualism) on the neural bases of PP. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework. We searched peer-reviewed electronic databases (SCOPUS, Web of Science, PubMed, ScienceDirect, and EBSCO host) and gray literature (dissertations in ProQuest). We also searched the reference lists of records selected for the review and forward citations to identify all relevant publications. We searched for records based on five criteria (original work, peer-reviewed, published in English, research topic related to PP or neural entrainment, and human sign language processing). To reduce the risk of bias, the remaining two authors with expertise in sign language processing and a variety of research methods reviewed the results. Disagreements were resolved through extensive discussion. In the final review, 7 records were included, of which 5 were published articles and 2 were dissertations. The reviewed records provide evidence for PP in signing populations, although the underlying mechanism in the visual modality is not clear. The reviewed studies addressed the motor simulation proposals, neural basis of PP, as well as the development of PP. All studies used dynamic sign stimuli. Most of the studies focused on semantic prediction. The question of the mechanism for the interaction between one’s sign language competence (L1 vs. L2 vs. bimodal bilingual) and PP in the manual-visual modality remains unclear, primarily due to the scarcity of participants with varying degrees of language dominance. There is a paucity of evidence for PP in sign languages, especially for frequency-based, phonetic (articulatory), and syntactic prediction. However, studies published to date indicate that Deaf native/native-like L1 signers predict linguistic information during sign language processing, suggesting that PP is an amodal property of language processing. Systematic Review Registration [ https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021238911 ], identifier [CRD42021238911]. 
    more » « less
  3. Abstract While the traditional goals of undergraduate courses are often content-based, the development of career-readiness and professional skills, such as those listed by the National Association of Colleges and Employers, are increasingly recognized as important learning outcomes. As Mammalogy courses embrace more hands-on learning activities, they provide the opportunity to embed these professional skills, which are directly relevant to many careers in science. For example, many Mammalogy courses may include projects that incorporate experimental design and data analysis that focus on quantitative literacy, in addition to technical skills including small mammal trapping and handling, or preparing voucher specimens, that focus on problem-solving and attention to detail. Here, we review the professional skills that can be developed through a Mammalogy course and evaluate evidence-based approaches to build those skills into our courses. One approach, using Course-based Undergraduate Research Experiences (CUREs), provides opportunities for both student skill development and instructor research program development. Because they invite students to participate in authentic scientific inquiry—from study design and data collection, to analysis and reporting of results—students participating in CUREs reported significant gains in their comfort with several important professional skills, including conducting field procedures, formulating and analyzing data, normalizing failure, and attempting new procedures on their own. Finally, we review the literature to demonstrate how active learning approaches inherent in CUREs can help students to build familiarity with technologies and techniques for collecting and assessing data from wild mammal populations, as well as to build important professional skills such as teamwork, leadership, problem-solving, and written and oral communication. 
    more » « less
  4. A series of international workshops held in 2014, 2017, 2019, and 2022 focused on improving tephra studies from field collection through publication and encouraging FAIR (findable, accessible, interoperable, reusable) data practices for tephra data and metadata. Two consensus needs for tephra studies emerged from the 2014 and 2017 workshops: (a) standardization of tephra field data collection, geochemical analysis, correlation, and data reporting, and (b) development of next generation computer tools and databases to facilitate information access across multidisciplinary communities. To achieve (a), we developed a series of recommendations for best practices in tephra studies, from sample collection through analysis and data reporting (https://zenodo.org/record/3866266). A 4-part virtual workshop series (https://tephrochronology.org/cot/Tephra2022/) was held in February and March, 2022, to update the tephra community on these developments, to get community feedback, to learn of unmet needs, and to plan a future roadmap for open and FAIR tephra data. More than 230 people from 25 nations registered for the workshop series. The community strongly emphasized the need for better computer systems, including physical infrastructure (repositories and servers), digital infrastructure (software and tools) and human infrastructure (people, training, and professional assistance), to store, manage and serve global tephra datasets. Some desired attributes of improved computer systems include: 1) user friendliness 2) ability to easily ingest multiparameter tephra data (using best practice recommended data fields); 3) interoperability with existing data repositories; 4) development of tool add-ons (plotting and statistics); 5) improved searchability 6) development of a tephra portal with access to distributed data systems, and 7) commitments to long-term support from funding agencies, publishers and the cyberinfrastructure community. 
    more » « less
  5. There has been considerable investment in pre-college educational interventions for all areas of STEM (including computer science). The goal of many of these initiatives is to engage and interest students early in their educational career. In this study, a systematic literature review was undertaken to determine the demographic and program data collected and reported for the field of computing education and for other STEM disciplines for activities that were not designed as part of the formal in-class curriculum (e.g., outreach activities). A comparison-contrast analysis of the resulting 342 articles found similarities and key differences in the reporting of this data as well as overarching characteristics of missing or incomplete reporting across disciplines. Authors from both fields reported equally well in the four categories studied: information about evaluation, participant gender, participant race and/or ethnicity, and activity demographics. However, the computing education articles were more likely to have clearly stated research questions and comparative analysis based on demographic characteristics. They were less likely to include the number of participants in the study, participant age/grade level, socioeconomic status, disability information, location of intervention, and instructor demographics. Through this analysis, it was determined that reporting can be improved across all disciplines to improve the quantity of data needed to replicate studies and to provide complete data sets that provide for the comparison of collected data. 
    more » « less