An official website of the United States government
This full “research” paper presents an overview of results of a systematic literature review of students' affective responses to active learning in undergraduate STEM courses. We considered 2,364 abstracts of conference papers and journal articles published since 1990, and 412 studies met our inclusion criteria. The studies span the STEM disciplines and report various types of active learning. Their research designs include primarily quantitative methods (especially instructor-designed surveys and course evaluations), and they find that students’ affective responses are overwhelmingly positive. Few studies excelled on our quality score metric, and there few statistically significant differences by discipline (but biology studies and chemistry studies scored significantly higher in quality than electrical engineering studies). We include several possible directions for future work.
more »
« less
WIP: How do students respond to active learning? A coding guide for a systematic review of the literature
This work in progress paper presents an example of conducting a systematic literature review (SLR) to understand students’ affective response to active learning practices, and it focuses on the development and testing of a coding form for analyzing the literature. Specifically, the full paper seeks to answer: (1) what affective responses do instructors measure, (2) what evidence is used to study those responses, and (3) how are course features connected with student response. We conducted database searches with carefully-defined search queries which resulted in 2,365 abstracts from 1990 to 2015. Each abstract was screened by two researchers based on meeting inclusion criteria, with an adjudication round in the case of disagreement. We used RefWorks, an online citation management program, to track abstracts during this process. We identified over 480 abstracts which satisfied our criteria. Following abstract screening, we developed and tested a manuscript coding guide to capture the salient characteristics of each paper. We created an initial coding form by determining what paper topics would address our research questions and reviewing the literature to determine the most frequent response categories. We then piloted and tested the reliability of the form over three rounds of independent pair-coding, with each round resulting in clarifications to the form and mutual agreement on terms’ meanings. This process of developing a manuscript coding guide demonstrates how to use free online tools, such as Google Forms and Google Sheets, to inexpensively manage a large SLR team with significant turnover. Currently, we are in the process of applying the coding guide to the full texts. When complete, the resulting data will be synthesized by creating and testing relationships between variables, using each primary source as a case study to support or refute the hypothesized relationship.
more »
« less
- Award ID(s):
- 1744407
- PAR ID:
- 10074673
- Date Published:
- Journal Name:
- Proceedings of 2018 ASEE Annual Conference & Exposition
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract BackgroundAminoglycosides are potent bactericidal antibiotics naturally produced by soil microorganisms and are commonly used in agriculture. Exposure to these antibiotics has the potential to cause shifts in the microorganisms that impact plant health. The systematic review described in this protocol will compile and synthesize literature on soil and plant root-associated microbiota, with special attention to aminoglycoside exposure. The systematic review should provide insight into how the soil and plant microbiota are impacted by aminoglycoside exposure with specific attention to the changes in the overall species richness and diversity (microbial composition), changes of the resistome (i.e. the changes in the quantification of resistance genes), and maintenance of plant health through suppression of pathogenic bacteria. Moreover, the proposed contribution will provide comprehensive information about data available to guide future primary research studies. This systematic review protocol is based on the question, “What is the impact of aminoglycoside exposure on the soil and plant root-associated microbiota?”. MethodsA boolean search of academic databases and specific websites will be used to identify research articles, conference presentations and grey literature meeting the search criteria. All search results will be compiled and duplicates removed before title and abstract screening. Two reviewers will screen all the included titles and abstracts using a set of predefined inclusion criteria. Full-texts of all titles and abstracts meeting the eligibility criteria will be screened independently by two reviewers. Inclusion criteria will describe the eligible soil and plant root-associated microbiome populations of interest and eligible aminoglycosides constituting our exposure. Study validity will be evaluated using the CEE Critical Appraisal Tool Version 0.2 (Prototype) to evaluate the risk of bias in publications. Data from studies with a low risk of bias will be extracted and compiled into a narrative synthesis and summarized into tables and figures. If sufficient evidence is available, findings will be used to perform a meta-analysis.more » « less
-
How do Google Search results change following an impactful real-world event, such as the U.S. Supreme Court decision on June 24, 2022 to overturn Roe v. Wade? And what do they tell us about the nature of event-driven content, generated by various participants in the online information environment? In this paper, we present a dataset of more than 1.74 million Google Search results pages collected between June 24 and July 17, 2022, intended to capture what Google Search surfaced in response to queries about this event of national importance. These search pages were collected for 65 locations in 13 U.S. states, a mix of red, blue, and purple states, with respect to their voting patterns. We describe the process of building a set of circa 1,700 phrases used for searching Google, how we gathered the search results for each location, and how these results were parsed to extract information about the most frequently encountered web domains. We believe that this dataset, which comprises raw data (search results as HTML files) and processed data (extracted links organized as CSV files) can be used to answer research questions that are of interest to computational social scientists as well as communication and media studies scholars.more » « less
-
null (Ed.)In this paper, we share our approach and the process for qualitative analysis of online video data recorded during an after-school robotics program that emphasized computational thinking (CT). Online research strategies may be necessary for various reasons such as when working with a geographically distributed research team, when conducting research with students in an online program, or when resources are inaccessible due to campus closures like those experienced during the COVID-19 pandemic. We followed a three-stage process during qualitative analysis of the videos that included planning and setup, online analysis of videos, and structural coding of memos to explore patterns across the data. Analysis was conducted with a combination of technologies including Google Drive for collaborative coding online and NVivo to collate and summarize findings. The methods and process we describe are readily applicable to other research studies that include video as part of the data set.more » « less
-
Abstract Journal editors have a large amount of power to advance open science in their respective fields by incentivising and mandating open policies and practices at their journals. The Data PASS Journal Editors Discussion Interface (JEDI, an online community for social science journal editors:www.dpjedi.org) has collated several resources on embedding open science in journal editing (www.dpjedi.org/resources). However, it can be overwhelming as an editor new to open science practices to know where to start. For this reason, we created a guide for journal editors on how to get started with open science. The guide outlines steps that editors can take to implement open policies and practices within their journal, and goes through the what, why, how, and worries of each policy and practice. This manuscript introduces and summarizes the guide (full guide:https://doi.org/10.31219/osf.io/hstcx).more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
