More Like this

1. Exploring an Online Simulation Before Lecture Improves Undergraduate Chemistry Learning

   DeCaro, Marci S. ; McClellan, Derek K. ; Powe, Aleeta ; Franco, Danielle ; Chastain, Raymond J. ; Hieb, Jeffrey L. ; Fuselier, Linda ( January 2022 , International Society of the Learning Sciences)

   This study tested whether exploring with simulations before instruction offers the conceptual benefits of “productive failure,” compared to a more traditional lecture-then-practice method. Undergraduate students (N=218) in introductory chemistry courses completed an activity using an online simulation about atomic structure. Students either completed the simulation activity before (explore-first condition) or after (instruct-first condition) a lecture on the topic. Students in both conditions scored equally on an assessment of basic facts taught in the instruction. However, students in the explore-first condition scored significantly higher on assessments of conceptual understanding and transfer to a new concept, compared to students in the instruct-first condition. Students in the explore-first condition also reported experiencing greater competence and curiosity during the learning activities. A guided simulation activity prior to instruction can have both motivational benefits and deepen students’ understanding.
2. The Effects of Gist Information and Scientific Quality on Damages in a Civil Trial

   Dellapaolera, K.S. ( March 2020 , Annual Conference of the American Psychology-Law Society.)

   Abstract: 100 words Jurors are increasingly exposed to scientific information in the courtroom. To determine whether providing jurors with gist information would assist in their ability to make well-informed decisions, the present experiment utilized a Fuzzy Trace Theory-inspired intervention and tested it against traditional legal safeguards (i.e., judge instructions) by varying the scientific quality of the evidence. The results indicate that jurors who viewed high quality evidence rated the scientific evidence significantly higher than those who viewed low quality evidence, but were unable to moderate the credibility of the expert witness and apply damages appropriately resulting in poor calibration. Summary: <1000 words Jurors and juries are increasingly exposed to scientific information in the courtroom and it remains unclear when they will base their decisions on a reasonable understanding of the relevant scientific information. Without such knowledge, the ability of jurors and juries to make well-informed decisions may be at risk, increasing chances of unjust outcomes (e.g., false convictions in criminal cases). Therefore, there is a critical need to understand conditions that affect jurors’ and juries’ sensitivity to the qualities of scientific information and to identify safeguards that can assist with scientific calibration in the courtroom. The current project addresses thesemore »issues with an ecologically valid experimental paradigm, making it possible to assess causal effects of evidence quality and safeguards as well as the role of a host of individual difference variables that may affect perceptions of testimony by scientific experts as well as liability in a civil case. Our main goal was to develop a simple, theoretically grounded tool to enable triers of fact (individual jurors) with a range of scientific reasoning abilities to appropriately weigh scientific evidence in court. We did so by testing a Fuzzy Trace Theory-inspired intervention in court, and testing it against traditional legal safeguards. Appropriate use of scientific evidence reflects good calibration – which we define as being influenced more by strong scientific information than by weak scientific information. Inappropriate use reflects poor calibration – defined as relative insensitivity to the strength of scientific information. Fuzzy Trace Theory (Reyna & Brainerd, 1995) predicts that techniques for improving calibration can come from presentation of easy-to-interpret, bottom-line “gist” of the information. Our central hypothesis was that laypeople’s appropriate use of scientific information would be moderated both by external situational conditions (e.g., quality of the scientific information itself, a decision aid designed to convey clearly the “gist” of the information) and individual differences among people (e.g., scientific reasoning skills, cognitive reflection tendencies, numeracy, need for cognition, attitudes toward and trust in science). Identifying factors that promote jurors’ appropriate understanding of and reliance on scientific information will contribute to general theories of reasoning based on scientific evidence, while also providing an evidence-based framework for improving the courts’ use of scientific information. All hypotheses were preregistered on the Open Science Framework. Method Participants completed six questionnaires (counterbalanced): Need for Cognition Scale (NCS; 18 items), Cognitive Reflection Test (CRT; 7 items), Abbreviated Numeracy Scale (ABS; 6 items), Scientific Reasoning Scale (SRS; 11 items), Trust in Science (TIS; 29 items), and Attitudes towards Science (ATS; 7 items). Participants then viewed a video depicting a civil trial in which the defendant sought damages from the plaintiff for injuries caused by a fall. The defendant (bar patron) alleged that the plaintiff (bartender) pushed him, causing him to fall and hit his head on the hard floor. Participants were informed at the outset that the defendant was liable; therefore, their task was to determine if the plaintiff should be compensated. Participants were randomly assigned to 1 of 6 experimental conditions: 2 (quality of scientific evidence: high vs. low) x 3 (safeguard to improve calibration: gist information, no-gist information [control], jury instructions). An expert witness (neuroscientist) hired by the court testified regarding the scientific strength of fMRI data (high [90 to 10 signal-to-noise ratio] vs. low [50 to 50 signal-to-noise ratio]) and gist or no-gist information both verbally (i.e., fairly high/about average) and visually (i.e., a graph). After viewing the video, participants were asked if they would like to award damages. If they indicated yes, they were asked to enter a dollar amount. Participants then completed the Positive and Negative Affect Schedule-Modified Short Form (PANAS-MSF; 16 items), expert Witness Credibility Scale (WCS; 20 items), Witness Credibility and Influence on damages for each witness, manipulation check questions, Understanding Scientific Testimony (UST; 10 items), and 3 additional measures were collected, but are beyond the scope of the current investigation. Finally, participants completed demographic questions, including questions about their scientific background and experience. The study was completed via Qualtrics, with participation from students (online vs. in-lab), MTurkers, and non-student community members. After removing those who failed attention check questions, 469 participants remained (243 men, 224 women, 2 did not specify gender) from a variety of racial and ethnic backgrounds (70.2% White, non-Hispanic). Results and Discussion There were three primary outcomes: quality of the scientific evidence, expert credibility (WCS), and damages. During initial analyses, each dependent variable was submitted to a separate 3 Gist Safeguard (safeguard, no safeguard, judge instructions) x 2 Scientific Quality (high, low) Analysis of Variance (ANOVA). Consistent with hypotheses, there was a significant main effect of scientific quality on strength of evidence, F(1, 463)=5.099, p=.024; participants who viewed the high quality evidence rated the scientific evidence significantly higher (M= 7.44) than those who viewed the low quality evidence (M=7.06). There were no significant main effects or interactions for witness credibility, indicating that the expert that provided scientific testimony was seen as equally credible regardless of scientific quality or gist safeguard. Finally, for damages, consistent with hypotheses, there was a marginally significant interaction between Gist Safeguard and Scientific Quality, F(2, 273)=2.916, p=.056. However, post hoc t-tests revealed significantly higher damages were awarded for low (M=11.50) versus high (M=10.51) scientific quality evidence F(1, 273)=3.955, p=.048 in the no gist with judge instructions safeguard condition, which was contrary to hypotheses. The data suggest that the judge instructions alone are reversing the pattern, though nonsignificant, those who received the no gist without judge instructions safeguard awarded higher damages in the high (M=11.34) versus low (M=10.84) scientific quality evidence conditions F(1, 273)=1.059, p=.30. Together, these provide promising initial results indicating that participants were able to effectively differentiate between high and low scientific quality of evidence, though inappropriately utilized the scientific evidence through their inability to discern expert credibility and apply damages, resulting in poor calibration. These results will provide the basis for more sophisticated analyses including higher order interactions with individual differences (e.g., need for cognition) as well as tests of mediation using path analyses. [References omitted but available by request] Learning Objective: Participants will be able to determine whether providing jurors with gist information would assist in their ability to award damages in a civil trial.« less
3. Work in Progress: Interactive Introductory Online Modules on Wireless Communications and Radio-frequency Spectrum Sharing

   Dietrich, C. B. ; Polys, N. F. ; Reid, K. ; García Sheridan, J. A. ; Emenonye, D. ; Gomez, X. ; Tolley, J. ; Makin, C. ; Gaeddert, J. ( July 2021 , ASEE Annual Conference proceedings)

   1. Description of the objectives and motivation for the contribution to ECE education The demand for wireless data transmission capacity is increasing rapidly and this growth is expected to continue due to ongoing prevalence of cellular phones and new and emerging bandwidth-intensive applications that encompass high-definition video, unmanned aerial systems (UAS), intelligent transportation systems (ITS) including autonomous vehicles, and others. Meanwhile, vital military and public safety applications also depend on access to the radio frequency spectrum. To meet these demands, the US federal government is beginning to move from the proven but inefficient model of exclusive frequency assignments to a more-efficient, shared-spectrum approach in some bands of the radio frequency spectrum. A STEM workforce that understands the radio frequency spectrum and applications that use the spectrum is needed to further increase spectrum efficiency and cost-effectiveness of wireless systems over the next several decades to meet anticipated and unanticipated increases in wireless data capacity. 2. Relevant background including literature search examples if appropriate CISCO Systems’ annual survey indicates continued strong growth in demand for wireless data capacity. Meanwhile, undergraduate electrical and computer engineering courses in communication systems, electromagnetics, and networks tend to emphasize mathematical and theoretical fundamentals and higher-layer protocols, withmore »less focus on fundamental concepts that are more specific to radio frequency wireless systems, including the physical and media access control layers of wireless communication systems and networks. An efficient way is needed to introduce basic RF system and spectrum concepts to undergraduate engineering students in courses such as those mentioned above who are unable to, or had not planned to take a full course in radio frequency / microwave engineering or wireless systems and networks. We have developed a series of interactive online modules that introduce concepts fundamental to wireless communications, the radio frequency spectrum, and spectrum sharing, and seek to present these concepts in context. The modules include interactive, JavaScript-based simulation exercises intended to reinforce the concepts that are presented in the modules through narrated slide presentations, text, and external links. Additional modules in development will introduce advanced undergraduate and graduate students and STEM professionals to configuration and programming of adaptive frequency-agile radios and spectrum management systems that can operate efficiently in congested radio frequency environments. Simulation exercises developed for the advanced modules allow both manual and automatic control of simulated radio links in timed, game-like simulations, and some exercises will enable students to select from among multiple pre-coded controller strategies and optionally edit the code before running the timed simulation. Additionally, we have developed infrastructure for running remote laboratory experiments that can also be embedded within the online modules, including a web-based user interface, an experiment management framework, and software defined radio (SDR) application software that runs in a wireless testbed initially developed for research. Although these experiments rely on limited hardware resources and introduce additional logistical considerations, they provide additional realism that may further challenge and motivate students. 3. Description of any assessment methods used to evaluate the effectiveness of the contribution, Each set of modules is preceded and followed by a survey. Each individual module is preceded by a quiz and followed by another quiz, with pre- and post-quiz questions drawn from the same pool. The pre-surveys allow students to opt in or out of having their survey and quiz results used anonymously in research. 4. Statement of results. The initial modules have been and are being used by three groups of students: (1) students in an undergraduate Introduction to Communication Systems course; (2) an interdisciplinary group of engineering students, including computer science students, who are participating in related undergraduate research project; and (3) students in a graduate-level communications course that includes both electrical and computer engineers. Analysis of results from the first group of students showed statistically significant increases from pre-quiz to post-quiz for each of four modules on fundamental wireless communication concepts. Results for the other students have not yet been analyzed, but also appear to show substantial pre-quiz to post-quiz increases in mean scores.« less
4. Strategies for Developing, Expanding, and Strengthening Community College Engineering Transfer Programs

   Enriquez, A. ; Langhoff, N. ; Dunmire, E. ; Rebold, T ; Pong, W. ( June 2018 , American Society for Engineering Education)

   Broadening participation in engineering among underrepresented minority students remains a big challenge for institutions of higher education. Since a large majority of underrepresented students attend community colleges, engineering transfer programs at these community colleges can play an important role in addressing this challenge. However, for most community college engineering programs, developing strategies and programs to increase the number and diversity of students successfully pursuing careers in engineering is especially challenging due to limited expertise, shrinking resources, and continuing budget crises. This paper is a description of how a small engineering transfer program at a Hispanic-Serving community college in California developed effective partnerships with high schools, other institutions of higher education, and industry partners in order to create opportunities for underrepresented community college students to excel in engineering. Developed through these partnerships are programs for high school students, current community college students, and community college engineering faculty. Programs for high school students include a) the Summer Engineering Institute – a two-week residential summer camp for sophomore and junior high school students, and b) the STEM Institute – a three-week program for high school freshmen to explore STEM fields. Academic and support programs for college students include: a) Math Jam – amore »one-week intensive math placement test review and preparation program; b) a scholarship and mentoring program academically talented and financially needy STEM students; c) a two-week introduction to research program held during the winter break to prepare students for research internships; d) a ten-week summer research internship program; e) Physics Jam – an intensive program to prepare students for success in Physics; f) Embedded Peer Instruction Cohort – a modified Supplemental Instruction program for STEM courses; g) STEM Speaker Series – a weekly presentation by professionals talking about their career and educational paths. Programs for community college STEM faculty and transfer programs include: a) Summer Engineering Teaching Institute – a two-day teaching workshop for community college STEM faculty; b) Joint Engineering Program – a consortium of 28 community college engineering programs all over California to align curriculum, improve teaching effectiveness, improve the engineering transfer process, and strengthen community college engineering transfer programs; c) Creating Alternative Learning Strategies for Transfer Engineering Programs – a collaborative program that aims to increase access to engineering courses for community college students through online instruction and alternative classroom models; and d) California Lower-Division Engineering Articulation Workshop – to align the engineering curriculum. In addition to describing the development and implementation of these programs, the paper will also provide details on how they have contributed to increasing the interest, facilitating the entry, improving the retention and enhancing the success of underrepresented minority students in engineering, as well as contributing to the strengthening of the community college engineering education pipeline.« less
5. Development of a Spatial Visualization Assessment Tool for Younger Students Using a Lego™ Assembly Task

   https://doi.org/10.18260/1-2--34452  

   Delson, Nathan ; Van Den Einde, Lelli ; Tuazon, Jessica ; Yang, Daniel ( June 2020 , 2020 ASEE Virtual Annual Conference Content Access)

   In recent years, it has increasingly been recognized that spatial visualization skills are important in supporting student success in Science, Technology, Engineering, and Math (STEM) education and retention of these students in STEM careers. Many first year college engineering programs and high schools with pre-engineering curriculum have incorporated spatial visualization training into their courses. However, there is no reason why spatial visualization training could not occur at a much younger age, like elementary school. Often at the high school and college level, the Purdue Spatial Visualization Test: Rotations (PSVT:R), which is recognized as a gold standard assessment tool, is used to measure students’ spatial skills learning gains. The PSVT:R is a 20 minute timed test consisting of 30 three-dimensional rotations problems. While the PSVT:R test has been well validated, there are benefits to developing alternative methods of assessing spatial visualization skills suitable for elementary school grades. Researchers at XXX developed an assembly pre- and post- test based upon a timed Lego™ exercise. Students are timed to see how long it would take them to build small Lego shapes using only a picture of the final assembly, but no instructions. The test was implemented at the beginning and then at themore »end of the quarter/semester. The beauty of this assessment is that it lends itself well to K-12 students. The 20 minute, timed PSVT:R test is too challenging for elementary aged children and is not engaging. In order to validate the new instrument, the Lego™ Assembly test was implemented in a pilot study in 2 college freshman engineering courses using students who could do both the PSVT:R and the Lego Assembly™ assessments. At the beginning of the class all students took the PSVT:R test, and half the students performed a Lego™ assembly of one shape and the other half did the assembly test with another shape. During the class the students completed spatial visualization training which taught them how to sketch orthographic and isometric assignments using a mobile sketching app. At the end of the class the PSVT:R test was repeated for all students. The Lego Assembly™ test was also completed, but the students switched which shape they were building. This approach allowed us to normalize the difficulty of the assembly tasks based upon the average time it took to build the shapes in the pre-test. The Lego Assembly™ test was first implemented in winter and spring of 2018. The data showed a correlation of the R-Squared of 0.11 between the assembly times and the PSVT:R scores in pre-test and 0.14 in post-test. However, analysis of the assembly times indicated that the difficulty of the 2 Lego shapes were significantly different, which could skew the normalization of the assembly times. Accordingly, the test was repeated in winter and spring 2019 with Lego shapes of similar difficulty. This paper describes the results of the assembly tess in all 4 classes, and its suitability for a spatial visualization assessment for elementary school age students.« less