More Like this

1. "I'm Not Teaching Them Per Se": Designing and Delivering Asynchronous Undergraduate Online STEM Courses

   https://doi.org/10.1007/s10755-023-09670-9  

   Garza Mitchell, Regina L.; DeCamp, Whitney; Horvitz, Brian S.; Kowalske, Megan Grunert; Singleton, Cherrelle (February 2024, Innovative Higher Education)

   Although online courses have been a part of academia for nearly 30 years, they are still perceived as "different" than face-to-face instruction. Through in-depth interviews with four instructors, we explored how STEM faculty approach teaching asynchronous online undergraduate STEM courses. The faculty interviewed for this study viewed online courses as "not regular class[es]" and teaching those classes as "not teaching per se." Each of the instructors had assumptions about what a classroom was and about good instruction, but even for instructors who taught online for multiple years, those assumptions remained grounded in the face-to-face environment. There is a need for greater discussion about what it means to teach in an online environment. 

   more » « less
2. Fusion of COPUS and DEI Tools for Equitable STEM Classroom Engagement

   https://doi.org/10.18260/1-2--56626  

   ADEIKA, Blessing; Owolabi, Oludare; Abiodun, Pelumi; Matthew, Kingsley; Althaus, Ellen Wang; Wright, Ashleigh; Goddard, Lynford; Shobowale, Olorunfunmi (June 2025, ASEE Conferences)

   This research paper investigates how classroom observation tools can be effectively combined to promote engagement in STEM education. Specifically, it explores the integration of the Classroom Observation Protocol for Undergraduate STEM (COPUS) and a culturally responsive Classroom Observation Instrument (COI) to evaluate and improve teaching practices. COPUS, developed by Smith et al. [21], captures instructional dynamics and student-faculty interactions, while the Classroom Observation Instrument COI, created by Dr. Jennifer G. Cromley and the University of Illinois Urbana-Champaign (UIUC) Developing Equity-Minded Engineering Practitioners (DEEP) research team [6], focuses on observing and assessing culturally responsive-related instructional practices. At Morgan State University (MSU), a Historically Black University (HBCU), coders formally trained by the UIUC DEEP team used both tools to analyze classroom recordings of faculty who had undergone professional development in engaging pedagogy. Findings indicate measurable improvements and balanced engagement in the classroom. This fusion of COPUS and COI tools offers a replicable framework for enhancing inclusive STEM instruction and cultivating more equitable learning environments. 

   more » « less
3. Developing an Instrument to Measure Online Engineering Undergraduate Students’ Learning Experiences and Intentions to Persist

   Lee, E.; Brunhaver, S.; Bekki, J. (January 2020, Proceedings of the American Society for Engineering Education)

   The purpose of this study is to develop an instrument to measure student perceptions about the learning experiences in their online undergraduate engineering courses. Online education continues to grow broadly in higher education, but the movement toward acceptance and comprehensive utilization of online learning has generally been slower in engineering. Recently, however, there have been indicators that this could be changing. For example, ABET has accredited online undergraduate engineering degrees at Stony Brook University and Arizona State University (ASU), and an increasing number of other undergraduate engineering programs also offer online courses. During this period of transition in engineering education, further investigation about the online modality in the context of engineering education is needed, and survey instrumentation can support such investigations. The instrument presented in this paper is grounded in a Model for Online Course-level Persistence in Engineering (MOCPE), which was developed by our research team by combining two motivational frameworks used to study student persistence: the Expectancy x Value Theory of Achievement Motivation (EVT), and the ARCS model of motivational design. The initial MOCPE instrument contained 79 items related to students’ perceptions about the characteristics of their courses (i.e., the online learning management system, instructor practices, and peer support), expectancies of course success, course task values, perceived course difficulties, and intention to persist in the course. Evidence of validity and reliability was collected using a three-step process. First, we tested face and content validity of the instrument with experts in online engineering education and online undergraduate engineering students. Next, the survey was administered to the online undergraduate engineering student population at a large, Southwestern public university, and an exploratory factor analysis (EFA) was conducted on the responses. Lastly, evidence of reliability was obtained by computing the internal consistency of each resulting scale. The final instrument has seven scales with 67 items across 10 factors. The Cronbach alpha values for these scales range from 0.85 to 0.97. The full paper will provide complete details about the development and psychometric evaluation of the instrument, including evidence of and reliability. The instrument described in this paper will ultimately be used as part of a larger, National Science Foundation-funded project investigating the factors influencing online undergraduate engineering student persistence. It is currently being used in the context of this project to conduct a longitudinal study intended to understand the relationships between the experiences of online undergraduate engineering students in their courses and their intentions to persist in the course. We anticipate that the instrument will be of interest and use to other engineering education researchers who are also interested in studying the population of online students. 

   more » « less
4. Bringing exploratory learning online: Problem-solving before instruction improves remote undergraduate physics learning

   https://doi.org/10.3389/feduc.2023.1215975  

   DeCaro, Marci S; Isaacs, Raina A; Bego, Campbell R; Chastain, Raymond J (August 2023, Frontiers in Education)

   STEM undergraduate instructors teaching remote courses often use traditional lecture-based instruction, despite evidence that active learning methods improve student engagement and learning outcomes. One simple way to use active learning online is to incorporate exploratory learning. In exploratory learning, students explore a novel activity (e.g., problem solving) before a lecture on the underlying concepts and procedures. This method has been shown to improve learning outcomes during in-person courses, without requiring the entire course to be restructured. The current study examined whether the benefits of exploratory learning extend to a remote undergraduate physics lesson, taught synchronously online. Undergraduate physics students (N = 78) completed a physics problem-solving activity either before instruction (explore-first condition) or after (instruct-first condition). Students then completed a learning assessment of the problem-solving procedures and underlying concepts. Despite lower accuracy on the learning activity, students in the explore-first condition demonstrated better understanding on the assessment, compared to students in the instruct-first condition. This finding suggests that exploratory learning can serve as productive failure in online courses, challenging students but improving learning, compared to the more widely-used lecture-then-practice method. 

   more » « less
5. Work in Progress – The Development of a K-12 Integrated STEM Observation Protocol.

   Roehrig, G.H; Ring-Whalen, E.A.; Wieselmann, J.R.; Dare, E.A.; Ellis, J.A. (January 2019, ASEE Annual Conference proceedings)

   This WIP presentation is intended to share and gather feedback on the development of an observation protocol for K-12 integrated STEM instruction, the STEM-OP. Specifically, the STEM-OP is being developed for use in K-12 science and/or engineering settings where integrated STEM instruction takes place. While the importance of integrated STEM education is established through national policy documents, there remains disagreement on models and effective approaches for integrated STEM instruction. Our broad definition of integrated STEM includes the use of two or more STEM disciplines to solve a real-world problem or design challenge that supports student development of 21st century skills. This issue is confounded by the lack of observation protocols sensitive to integrated STEM teaching and learning that can be used to inform research of the effectiveness of new models and strategies. Existing instruments most commonly used by researchers, such as the Reformed Teaching Observation Protocol (RTOP), were designed prior to the development of the Next Generation Science Standards and the integration of engineering into science standards. These instruments were also designed for use in reform-based science classrooms, not engineering or integrated STEM learning environments. While engineering-focused observation protocols do exist for K-12 classrooms, they do not evaluate beyond an engineering focus, making them limited tools to evaluate integrated STEM instruction. In order to facilitate the implementation of integrated STEM in K-12 classrooms and the development of the nascent integrated STEM education literature, our research team is developing a new integrated STEM observation protocol for use in K-12 science and engineering classrooms. This valid and reliable instrument will be designed for use in a variety of educational contexts and by different education stakeholders to increase the quality of K-12 STEM education. At the end of this project, the STEM-OP will be made available through an online platform that will include an embedded training program to facilitate its broad use. In the first year of this four-year project, we are working on the initial development of the STEM-OP through video analysis and exploratory factor analysis. We are utilizing existing classroom video from a previous project with approximately 2,000 unique classroom videos representing a variety of grade levels (4-9), science content (life, earth, and physical science), engineering design challenges, and school demographics (urban, suburban). The development of the STEM-OP is guided by published frameworks that focus on providing quality K-12 integrated STEM and engineering education, such as the Framework for Quality K-12 Engineering Education. Our anticipated results at the time the ASEE meeting will include a review of our item development process and finalized items included on the draft STEM-OP. Additionally, we anticipate being able to share findings from the exploratory factor analysis (EFA) on our video-coded data, which will identify distinct instructional dimensions responsible for integrated STEM instruction. We value the opportunity to gather feedback from the engineering education community as the integration of engineering design and practices is integral to quality integrated STEM instruction. 

   more » « less