skip to main content


Title: A New Curriculum Development Model for Improving Undergraduate Students’ Data Literacy and Self-Efficacy in Online Astronomy Classrooms
There is a critical need for research-based active learning instructional materials for the teaching and learning of STEM in online courses. Every year, hundreds of thousands of undergraduate non-science majors enroll in general education astronomy courses to fulfill their institution’s liberal arts requirements. When designing instructional materials for this population of learners, a central focus must be to help learners become more scientifically and data literate. As such, we developed a new, three-part, curricular model that was used to inform the creation of active-learning instructional materials designed for use in online courses. The instructional materials were designed to help introductory astronomy students engage meaningfully with science while simultaneously improving their data literacy self-efficacy (especially as it pertained to making evidence-based conclusions when presented with a variety of data representations). We conducted a pilot study of these instructional materials at nine different colleges and universities to better understand whether students’ engagement with these materials lead to improved beliefs and self-efficacy. The results of our student survey analysis showed statistically significant changes on survey items that assessed students’ beliefs about science engagement, citizen science, and their data literacy skills. Additionally, we assessed whether faculty who implemented these materials were able to easily incorporate them into existing online astronomy courses. The instructor feedback emphasized that our curriculum development model did successfully inform the creation of easy-to-implement instructional materials, generating the potential for widespread dissemination and use at the undergraduate level.  more » « less
Award ID(s):
1821319
NSF-PAR ID:
10383508
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
AEJ
Date Published:
Journal Name:
Astronomy Education Journal
ISSN:
2004-2981
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper presents the initial work of a recently funded NSF project on ethical and responsible research and practices in science and engineering. The objective of this research is to improve instructor training, interventions, and student outcomes in high schools and universities to improve awareness and commitment to ethical practices in STEM coursework. The project will generate a robust snapshot of the ethical knowledge, reasoning skills, attitudes, and practices of several thousand undergraduate engineering students. This snapshot will inform the development of a three-week enrichment opportunity for high school STEM teachers. Working with university faculty and graduate students, these teachers will develop learning modules on ethical issues related to their courses. The snapshot will also identify gaps and guide the creation of targeted interventions that will be used in second-, third-, and fourth-year engineering courses. This data-driven project uses a mixed-methods approach to generate a better understanding of the impact of ethics interventions at various points in a student's academic development by developing and using a set of instruments to measure cognitive, affective, and behavioral aspects of ethical competency and self-efficacy. To that end, a second snapshot will be taken by testing and surveying engineering students in their capstone courses to provide a broad overview of the competence and self-confidence that engineering students have in dealing with ethical STEM issues, to determine the efficacy of various interventions, and to improve future interventions. Utilizing repeated measures and possessing a longitudinal dimension, the project will generate extensive data about the development of ethical competency, ethical self-efficacy, and their relationship. The interventions designed for secondary and tertiary classrooms will build on best practices for micro-insertion of ethics content that are practical and help students understand how technical competencies fit within broader social, economic, and environmental contexts. The capstone snapshot will also provide some measure of the impact of other experiences (e.g., undergraduate research, internships, service learning) and courses (e.g., humanities, social science, and business courses) on development of ethical practices. This report marks the start of a five-year project; therefore, the results presented in this paper represent findings from the engineering ethics literature and baseline results from survey of engineering freshmen at Texas A&M University. The findings from the survey are being utilized in developing intervention modules that will be integrated in upper-level engineering courses and training materials for high school teachers. 
    more » « less
  2. Abstract  
    more » « less
  3. Nehm, Ross (Ed.)
    Civic engagement is an individual’s active participation that is intended to improve a community’s socioeconomic status or help shape its future. Undergraduates who engage with a community during formal course work are more likely to participate civically later in life. This outcome is important for science, technology, engineering and math (STEM) students since they use STEM knowledge to make informed decisions about public health, national security and the environment. STEM courses that incorporate this idea actively engage students in helping communities, and yet, assessment of the civic outcomes in these courses, such as measuring important predictors of future civic engagement, has been inconsistent and challenging. To address this need, we designed and assessed a new survey by adapting and testing items from previously existing civic engagement measures. The result was a 14-item survey comprising the following scientific civic constructs, that predict future scientific civic engagement: value, self-efficacy, action, and knowledge. This survey has potential to provide insight into the development of scientific civic engagement for STEM disciplines among undergraduate populations and can be used with additional scales of interest, allowing for researchers to assess relationships between predictors of scientific civic engagement and other constructs. 
    more » « less
  4. This research paper describes a study of elementary teacher learning in an online graduate program in engineering education for in-service teachers. While the existing research on teachers in engineering focuses on their disciplinary understandings and beliefs (Hsu, Cardella, & Purzer, 2011; Martin, et al., 2015; Nadelson, et al., 2015; Van Haneghan, et al., 2015), there is increasing attention to teachers' pedagogy in engineering (Capobianco, Delisi, & Radloff, 2018). In our work, we study teachers' pedagogical sense-making and reflection, which, we argue, is critical for teaching engineering design. This study takes place in [blinded] program, in which teachers take four graduate courses over fifteen months. The program was designed to help teachers not only learn engineering content, but also shift their thinking and practice to be more responsive to their students. Two courses focus on pedagogy, including what it means to learn engineering and instructional approaches to support this learning. These courses consist of four main elements, in which teachers: 1) Read data-rich engineering education articles to reflect on learning engineering; 2) Participate in online video clubs, looking at classroom videos of students’ engineering and commenting on what they notice; 3) Conduct interviews with learners about the mechanism of a pull-back car; and 4) Plan and teach engineering lessons, collecting and analyzing video from their classrooms. In the context of this program, we ask: what stances do teachers take toward learning and teaching engineering design? What shifts do we observe in their stances? We interviewed teachers at the start of the program and after each course. In addition to reflecting on their learning and teaching, teachers watched videos of students’ engineering and discussed what they saw as relevant for teaching engineering. We informally compared summaries from previous interviews to get a sense of changes in how participants talked about engineering, how they approached teaching engineering, and what they noticed in classroom videos. Through this process, we identified one teacher to focus on for this paper: Alma is a veteran 3rd-5th grade science teacher in a rural, racially-diverse public school in the southeastern region of the US. We then developed content logs of Alma's interviews and identified emergent themes. To refine these themes, we looked for confirming and disconfirming evidence in the interviews and in her coursework in the program. We coded each interview for these themes and developed analytic memos, highlighting where we saw variability and stability in her stances and comparing across interviews to describe shifts in Alma's reasoning. It was at this stage that we narrowed our focus to her stances toward the engineering design process (EDP). In this paper, we describe and illustrate shifts we observed in Alma's reasoning, arguing that she exhibited dramatic shifts in her stances toward teaching and learning the EDP. At the start of the program, she was stable in treating the EDP as a series of linear steps that students and engineers progress through. After engaging and reflecting on her own engineering in the first course, she started to express a more fluid stance when talking more abstractly about the EDP but continued to take it up as a linear process in her classroom teaching. By the end of the program, Alma exhibited a growing stability across contexts in her stance toward the EDP as a fluid set of overlapping practices that students and engineers could engage in. 
    more » « less
  5. Co-creation in higher education is the process where students collaborate with instructors in designing the curriculum and associated educational material. This can take place in different scenarios, such as integrating co-creation into an ongoing course, modifying a previously taken course, or while creating a new course. In this Work-In-Progress, we investigate training and formative assessment models for preparing graduate students in engineering to participate as co-creators of educational material on an interdisciplinary topic. The topic of cyber-physical systems engineering and product lifecycle management with application to structural health monitoring is considered in this co-creation project. This entails not only topics from different disciplines of civil, computer, electrical and environmental engineering, business, and information sciences, but also humanistic issues of sustainability, environment, ethical and legal concerns in data-driven decision-making that support the control of cyber-physical systems. Aside from the objective of creating modules accessible to students with different levels of disciplinary knowledge, the goal of this research is to investigate if the co-creation process and the resulting modules also promote interest and engagement in interdisciplinary research. A literature survey of effective training approaches for co-creation and associated educational theories is summarized. For students, essential training components include providing (i) opportunities to align their interests, knowledge, skills, and values with the topic presented; (ii) experiential learning on the topic to help develop and enhance critical thinking and question posing skills, and (iii) safe spaces to reflect, voice their opinions, concerns, and suggestions. In this research we investigate the adaption of project-based learning (PjBL) strategies and practices to support (i) and (ii) and focus groups for participatory action research (PAR) as safe spaces for reflection, feedback, and action in item (iii). The co-creation process is assessed through qualitative analysis of data collected through the PjBL activities and PAR focus groups and other qualitative data (i.e., focus group transcripts, interview transcripts, project materials, fieldnotes, etc.). The eventual outcome of the co-creation process will be an on-line course module that is designed to be integrated in existing engineering graduate and undergraduate courses at four different institutions, which includes two state universities and two that are historically black colleges and universities. 
    more » « less