skip to main content


Title: A Tale of Two Institutions: Analyzing the Impact of Gamified Student Response Systems on Student Anxiety in Two Different Introductory Biology Courses
Anxiety can impact overall performance and persistence in college. Student response systems (SRSs), real-time active-learning technologies used to engage students and gauge their understanding, have been shown to elicit anxiety for some students. Kahoot! is an SRS technology that differs from others in that it involves gamification, the use of gamelike elements. Recent studies have explored the impact of active-learning strategies on student anxiety across different institutions, but there is little known about how Kahoot! impacts student perceived anxiety, especially in comparison with other active-learning strategies. In two complementary yet parallel studies of introductory biology courses at a western research-intensive institution ( n = 694) and a southeastern research-intensive institution ( n = 60), we measured students’ perceived anxiety. We then explored how students were influenced by nongraded Kahoot! play and other elements of instruction. Using previously developed and course-specific pre- and post-course surveys, we found students at both universities agreed that nongraded Kahoot! play caused less anxiety compared with other pedagogical practices, such as working in small groups or reading the textbook. After playing Kahoot!, lower-performing students demonstrated greater engagement and lower levels of anxiety compared with their peers, suggesting that Kahoot! may be a particularly engaging active-learning strategy for these students.  more » « less
Award ID(s):
1826988
NSF-PAR ID:
10284492
Author(s) / Creator(s):
; ; ; ;
Editor(s):
Gardner, Stephanie
Date Published:
Journal Name:
CBE—Life Sciences Education
Volume:
20
Issue:
2
ISSN:
1931-7913
Page Range / eLocation ID:
ar19
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The Academy of Engineering Success (AcES) program, established in 2012 and supported by NSF S-STEM award number 1644119 throughout 2016-2021, employs literature-based, best practices to support and retain underprepared and underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. A total of 71 students, including 21 students supported by S-STEM scholarships, participated in the AcES program between 2016-2019 at a large R1 institution in the mid-Atlantic region. All AcES students participate in a common program during their first year, comprised of: a one-week summer bridge experience, a common fall professional development course and spring “Engineering in History” course, and a common academic advisor. These students also have opportunities for: (1) faculty-student, student-student, and industry mentor-student interaction, (2) academic support and student success education, and (3) major and career exploration – all designed to help students develop feelings of institutional inclusion, engineering self-efficacy and identity, and academic and professional success skills. They also participate in the GRIT, Longitudinal Assessment of Engineering Self-Efficacy (LAESE), and the Motivated Strategies for Learning Questionnaire (MSLQ) surveys plus individual and focus group interviews at the start, midpoint, and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, their beliefs related to the intrinsic value of engineering and learning, their feelings of inclusion and test anxiety, and their self-efficacy related to engineering, math, and coping skills. The interviews provide information related to the student experience, feelings of inclusion, and program impact. Institutional data, combined with the survey and interview responses, are used to examine four research questions designed to examine the relationship of the elements of the AcES program to participants’ academic success and retention in engineering. Early analyses of the student retention data and survey responses from the 2017 and 2018 cohorts indicated students who ultimately left engineering before the start of their second year initially scored higher in areas of engineering self-efficacy and test anxiety, than those who stayed in engineering, while those who retained to the second year began their engineering education with lower self-efficacy scores, but higher scores related to the belief in the intrinsic value of engineering, learning strategy use, and coping self-efficacy. These results suggest that students who start with unrealistically high expectations of their performance leave engineering at higher rates than students who start with lower personal performance expectations, but have stronger value of the field and strategies for meeting challenges. These data appear to support the Kruger-Dunning effect in which students with limited knowledge of a specific field overestimate their abilities to perform in that area or underestimate the level of effort success may require. This paper will add an analysis of the academic success and retention data from 2019 cohort to this research, discuss the impact of COVID-19 to this program and research, as well as illuminate the quantitative results with the qualitative data from individual and focus group interviews regarding the aspects of the AcES program that impact student success, their expectations and methods for overcoming academic challenges, and their feelings of motivation and inclusion. 
    more » « less
  2. This Innovative Practice Full Paper presents a novel, narrative, game-based approach to introducing first-year engineering students to concepts in ethical decision making. Approximately 250 first-year engineering students at the University of Connecticut played through our adventure, titled Mars: An Ethical Expedition, by voting weekly as a class on a presented dilemma. Literature shows that case studies still dominate learning sciences research on engineering ethical education, and that novel, active learning-based techniques, such as games, are infrequently used but can have a positive impact on both student engagement and learning. In this work, we suggest that games are a form of situated (context-based) learning, where the game setting provides learners with an authentic but safe space in which to explore engineering ethical choices and their consequences. As games normalize learning through failure, they present a unique opportunity for students to explore ethical decision making in a non-judgmental, playful, and safe way.We explored the situated nature of ethical decision making through a qualitative deconstruction of the weekly scenarios that students engaged with over the course of the twelve-week narrative. To assess their ethical reasoning, students took the Engineering Ethics Reasoning Instrument (EERI), a quantitative engineering ethics reasoning survey, at the beginning and end of the semester. The EERI scenarios were deconstructed to reveal their core ethical dilemmas, and then common elements between the EERI and our Mars adventure were compared to determine how students responded to similar ethical dilemmas presented in each context.We noted that students' responses to the ethical decisions in the Mars adventure scenarios were sometimes substantially different both from their response to the EERI scenario as well as from other decisions they made within the context of the game, despite the core ethical dilemma being the same. This suggests that they make ethical decisions in some situations that differ from a presumed abstract understanding of post-conventional moral reasoning. This has implications for how ethical reasoning can be taught and scaffolded in educational settings. 
    more » « less
  3. Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction. 
    more » « less
  4. A study conducted by the Mathematical Association of America showed that calculus not only has significant effects on students’ decision to pursue STEM fields, but also on their attitudes towards mathematics. Inspired by this large-scale study, the present study sought to deepen the current understanding of the impact of calculus on student attitudes towards mathematics. Results of an implementation of the Modeling Practices in Calculus (MPC) model, an innovative active learning in mathematics (ALM) approach, in Calculus I at a large, urban, research intensive (R1) institution are presented. Using a randomized-control trial research design, stu- dents were randomly assigned to either traditional, lecture-based classrooms, or MPC classrooms. The Attitudes Towards Mathematics Inventory (ATMI) was used to measure student attitudes at the begin- ning and end of the course and results were compared from both MPC and traditional sections. Overall, MPC sections showed improve- ment over traditional instruction by having less negative impact on student attitudes. The enjoyment and self-confidence ATMI sub- scales showed significant differences at course completion for both semesters, when controlling for pre-ATMI score and term. Further- more, the MPC model had a positive impact on female students’ self-confidence as opposed to male students, acting as a gender equalizer. 
    more » « less
  5. High levels of stress and anxiety are common amongst college students, particularly engineering students. Students report lack of sleep, grades, competition, change in lifestyle, and other significant stressors throughout their undergraduate education (1, 2). Stress and anxiety have been shown to negatively impact student experience (3-6), academic performance (6-8), and retention (9). Previous studies have focused on identifying factors that cause individual students stress while completing undergraduate engineering degree programs (1). However, it not well-understood how a culture of stress is perceived and is propagated in engineering programs or how this culture impacts student levels of identification with engineering. Further, the impact of student stress has not been directly considered in engineering regarding recruitment, retention, and success. Therefore, our guiding research question is: Does the engineering culture create stress for students that hinder their engineering identity development? To answer our research question, we designed a sequential mixed methods study with equal priority of quantitative survey data and qualitative individual interviews. Our study participants are undergraduate engineering students across all levels and majors at a large, public university. Our sample goal is 2000 engineering student respondents. We combined three published surveys to build our quantitative data collection instrument, including the Depression Anxiety Stress Scales (DASS), Identification with engineering subscale, and Engineering Department Inclusion Level subscale. The objective of the quantitative instrument is to illuminate individual perceptions of the existence of an engineering stress culture (ESC) and create an efficient tool to measure the impact ESC on engineering identity development. Specifically, we seek to understand the relationships among the following constructs; 1) identification with engineering, 2) stress and anxiety, and 3) feelings of inclusion within their department. The focus of this paper presents the results of the pilot of the proposed instrument with 20 participants and a detailed data collection and analysis process. In an effort to validate our instrument, we conducted a pilot study to refine our data collection process and the results will guide the data collection for the larger study. In addition to identifying relationships among construct, the survey data will be further analyzed to specify which demographics are mediating or moderating factors of these relationships. For example, does a student’s 1st generation status influence their perception of stress or engineering identity development? Our analysis may identify discipline-specific stressors and characterize culture components that promote student anxiety and stress. Our objective is to validate our survey instrument and use it to inform the protocol for the follow-up interviews to gain a deeper understanding of the responses to the survey instrument. Understanding what students view as stressful and how students identify stress as an element of program culture will support the development of interventions to mitigate student stress. References 1. Schneider L (2007) Perceived stress among engineering students. A Paper Presented at St. Lawrence Section Conference. Toronto, Canada. Retrieved from: www. asee. morrisville. edu. 2. Ross SE, Niebling BC, & Heckert TM (1999) Sources of stress among college students. Social psychology 61(5):841-846. 3. Goldman CS & Wong EH (1997) Stress and the college student. Education 117(4):604-611. 4. Hudd SS, et al. (2000) Stress at college: Effects on health habits, health status and self-esteem. College Student Journal 34(2):217-228. 5. Macgeorge EL, Samter W, & Gillihan SJ (2005) Academic Stress, Supportive Communication, and Health A version of this paper was presented at the 2005 International Communication Association convention in New York City. Communication Education 54(4):365-372. 6. Burt KB & Paysnick AA (2014) Identity, stress, and behavioral and emotional problems in undergraduates: Evidence for interaction effects. Journal of college student development 55(4):368-384. 7. Felsten G & Wilcox K (1992) Influences of stress and situation-specific mastery beliefs and satisfaction with social support on well-being and academic performance. Psychological Reports 70(1):291-303. 8. Pritchard ME & Wilson GS (2003) Using emotional and social factors to predict student success. Journal of college student development 44(1):18-28. 9. Zhang Z & RiCharde RS (1998) Prediction and Analysis of Freshman Retention. AIR 1998 Annual Forum Paper. 
    more » « less