skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A New Curriculum Development Model for Improving Undergraduate Students’ Data Literacy and Self-Efficacy in Online Astronomy Classrooms
There is a critical need for research-based active learning instructional materials for the teaching and learning of STEM in online courses. Every year, hundreds of thousands of undergraduate non-science majors enroll in general education astronomy courses to fulfill their institution’s liberal arts requirements. When designing instructional materials for this population of learners, a central focus must be to help learners become more scientifically and data literate. As such, we developed a new, three-part, curricular model that was used to inform the creation of active-learning instructional materials designed for use in online courses. The instructional materials were designed to help introductory astronomy students engage meaningfully with science while simultaneously improving their data literacy self-efficacy (especially as it pertained to making evidence-based conclusions when presented with a variety of data representations). We conducted a pilot study of these instructional materials at nine different colleges and universities to better understand whether students’ engagement with these materials lead to improved beliefs and self-efficacy. The results of our student survey analysis showed statistically significant changes on survey items that assessed students’ beliefs about science engagement, citizen science, and their data literacy skills. Additionally, we assessed whether faculty who implemented these materials were able to easily incorporate them into existing online astronomy courses. The instructor feedback emphasized that our curriculum development model did successfully inform the creation of easy-to-implement instructional materials, generating the potential for widespread dissemination and use at the undergraduate level.  more » « less
Award ID(s):
1821319
PAR ID:
10383508
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
AEJ
Date Published:
Journal Name:
Astronomy Education Journal
ISSN:
2004-2981
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Course-Based Undergraduate Research Experiences (CUREs) have been shown to provide students with a variety of learning benefits including better conceptual understanding, improved critical thinking and data literacy skills, and increased interest in pursuing scientific careers. Additionally, CUREs provide students with opportunities to participate in authentic research experiences that have a broader impact outside of the classroom. Despite the numerous benefits, the field of astronomy has lagged behind disciplines like biology and chemistry when it comes to including CUREs in the curriculum. Not limited to astronomy, however, is the lack of research opportunities and courses offered to students enrolled in undergraduate degree programs online. In the Fall of 2020, Arizona State University (ASU) introduced the nation’s first online bachelor’s degree program in astronomy and planetary sciences (APS). To make research accessible to a more diverse population of learners, it is imperative that students in this program have access to the same opportunities to participate in authentic research as those in the parallel in-person program. In this work, we describe the development, implementation, and assessment of a fully online CURE for astronomy majors as part of the APS program. We conducted a mixed methods analysis consisting of a Likert style survey administered pre- and postcourse as well as student interviews at the conclusion of the semester. Survey results from the course’s first two offerings (N ¼ 24) indicated that students’ research self-efficacy and science identity both improved. An exoplanet-specific multiple-choice assessment (N ¼ 26) showed statistically significant improvements in conceptual understanding postcourse. Additionally, student interview (N ¼ 11) responses relayed that students felt a stronger sense of belonging to both ASU and the larger astronomy community after participation in the course. The results from this study are encouraging and suggest that student participation in this online CURE led to similar improvements across a variety of outcomes previously identified in studies of in-person CUREs spanning multiple disciplines. 
    more » « less
  2. Computational modeling skills are critical for the success of both engineering students and practicing engineers and are increasingly included as part of the undergraduate curriculum. However, students' belief in the utility of these skills and their ability to succeed in learning them can vary significantly. This study hypothesizes that the self-efficacy and motivation of engineering students at the outset of their degree program varies significantly and that engineering students pursuing some disciplines (such as computer, software, and electrical engineering) will begin with a higher initial self-efficacy than others (such as materials science and engineering and biomedical engineering). In this pilot study, a survey was used to investigate the motivational and efficacy factors of approximately 70 undergraduate students in their first year of engineering studies at a large public university. Surveys were implemented after students were introduced to MATLAB in their first-year engineering design course. The data was analyzed for variations in baseline motivation based on the students' intended major. The results of this survey will help determine whether efficacy and interest related to computational modeling are indeed lower for certain engineering disciplines and will inform future studies in this area. 
    more » « less
  3. This paper presents the initial work of a recently funded NSF project on ethical and responsible research and practices in science and engineering. The objective of this research is to improve instructor training, interventions, and student outcomes in high schools and universities to improve awareness and commitment to ethical practices in STEM coursework. The project will generate a robust snapshot of the ethical knowledge, reasoning skills, attitudes, and practices of several thousand undergraduate engineering students. This snapshot will inform the development of a three-week enrichment opportunity for high school STEM teachers. Working with university faculty and graduate students, these teachers will develop learning modules on ethical issues related to their courses. The snapshot will also identify gaps and guide the creation of targeted interventions that will be used in second-, third-, and fourth-year engineering courses. This data-driven project uses a mixed-methods approach to generate a better understanding of the impact of ethics interventions at various points in a student's academic development by developing and using a set of instruments to measure cognitive, affective, and behavioral aspects of ethical competency and self-efficacy. To that end, a second snapshot will be taken by testing and surveying engineering students in their capstone courses to provide a broad overview of the competence and self-confidence that engineering students have in dealing with ethical STEM issues, to determine the efficacy of various interventions, and to improve future interventions. Utilizing repeated measures and possessing a longitudinal dimension, the project will generate extensive data about the development of ethical competency, ethical self-efficacy, and their relationship. The interventions designed for secondary and tertiary classrooms will build on best practices for micro-insertion of ethics content that are practical and help students understand how technical competencies fit within broader social, economic, and environmental contexts. The capstone snapshot will also provide some measure of the impact of other experiences (e.g., undergraduate research, internships, service learning) and courses (e.g., humanities, social science, and business courses) on development of ethical practices. This report marks the start of a five-year project; therefore, the results presented in this paper represent findings from the engineering ethics literature and baseline results from survey of engineering freshmen at Texas A&M University. The findings from the survey are being utilized in developing intervention modules that will be integrated in upper-level engineering courses and training materials for high school teachers. 
    more » « less
  4. Nehm, Ross (Ed.)
    Civic engagement is an individual’s active participation that is intended to improve a community’s socioeconomic status or help shape its future. Undergraduates who engage with a community during formal course work are more likely to participate civically later in life. This outcome is important for science, technology, engineering and math (STEM) students since they use STEM knowledge to make informed decisions about public health, national security and the environment. STEM courses that incorporate this idea actively engage students in helping communities, and yet, assessment of the civic outcomes in these courses, such as measuring important predictors of future civic engagement, has been inconsistent and challenging. To address this need, we designed and assessed a new survey by adapting and testing items from previously existing civic engagement measures. The result was a 14-item survey comprising the following scientific civic constructs, that predict future scientific civic engagement: value, self-efficacy, action, and knowledge. This survey has potential to provide insight into the development of scientific civic engagement for STEM disciplines among undergraduate populations and can be used with additional scales of interest, allowing for researchers to assess relationships between predictors of scientific civic engagement and other constructs. 
    more » « less
  5. Online learning is increasing in both enrollment and importance within engineering education. Online courses also continue to confront comparatively higher course dropout levels than face-to-face courses. This research paper thus aims to better understand the factors that contribute to students’ choices to remain in or drop out of their online undergraduate engineering courses. Path analysis was used to examine the impact of course perceptions and individual characteristics on students’ course-level persistence intentions. Specifically, whether students' course perceptions influenced their persistence intentions directly or indirectly, through their expectancies of course success, was tested. Data for this study were collected from three ABET-accredited online undergraduate engineering programs at a large public university in the Southwestern United States: electrical engineering, engineering management, and software engineering. A total of 138 students participated in the study during the fall 2019 (n=85) and spring 2020 (n=53) semesters. Participants responded to surveys twice weekly during their 7.5-week online course. The survey asked students about their course perceptions related to instructor practices, peer support, and course difficulty level, their expectancies in completing the course, and their course persistence intentions. This work is part of a larger National Science Foundation-funded research project dedicated to studying online student course-level persistence based on both students' self-report data and course learning management system (LMS) activity. The survey sample was consistent with reports indicating that online learners tend to be more diverse than face-to-face learners. Findings from the path analysis revealed that students' perceptions of course LMS fit, perceived course difficulty, and expectancies of course success positively and significantly predicted persistence intentions, making them the most important influences. Expectancies of course success had a direct effect on persistence intentions. The findings underscore the need to elucidate further the mechanisms through which expectancies of success influence persistence. 
    more » « less