skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Development and Application of Assessment Tools for a Research Experience for Teachers Site
In 2019, University of Houston (UH) at Houston, Texas was awarded an NSF Research Experience for Teachers (RET) site grant titled “RET Site: High School Teacher Experience in Engineering Design and Manufacturing.” The goal of the project is to host 12 high school teachers each summer to participate in engineering design and manufacturing research and then convert their experience into high school curriculum. Given the experience from the first year’s operation and assessment, it was noted that the extant teacher self-efficacy surveys need to be further improved according to the specific needs of RET site. As such, an updated set of assessment tools was developed to evaluate the impact of RET site on high school teacher participants. In particular, a new teacher self-efficacy survey was created from synthesizing multiple sources including Bandura’s Instrument Teacher Self-Efficacy Scale, Collective Teacher Beliefs, and Teachers’ Sense of Efficacy Scale (Ohio State Teacher Efficacy Scale). Besides the new self-efficacy survey, more specific questions were added to pre- and post-summer self-reported questionnaires to better understand the teachers’ perception and receptance of the summer experience. Interviews were conducted individually instead of using a focus group. This allows the interviewee to be more vocal during the interview, allowing more in-depth understanding of their perception for future improvement. The new assessment tools were applied to the second cohort of 12 teachers in summer 2022. The assessment results show that the assessment tools were able to effectively capture teachers’ change in perception and evaluate the affective impact of the RET site. In the future, the tools may be improved and used in similar teacher professional development activities.  more » « less
Award ID(s):
1855147
PAR ID:
10506433
Author(s) / Creator(s):
;
Publisher / Repository:
American Society of Engineering Education
Date Published:
Format(s):
Medium: X
Location:
Baltimore, Maryland
Sponsoring Org:
National Science Foundation
More Like this
  1. In 2019, University of Houston (UH) at Houston, Texas was awarded an NSF Research Experience for Teachers (RET) site grant titled “RET Site: High School Teacher Experience in Engineering Design and Manufacturing.” The goal of the project is to host 12 high school teachers each summer to participate in engineering design and manufacturing research and then convert their experience into high school curriculum. In summer of 2021, the first cohort of 12 teachers from Region 4 of Southeast Texas participated in the RET program at UH College of Technology (COT). This six-week program, open to local high school STEM teachers in Texas, sought to advance educators’ knowledge of concepts in design and manufacturing as a means of enriching high school curriculums and meeting foundational standards set by 2013’s Texas House Bill 5. These standards require enhanced STEM contents in high school curricula as a prerequisite for graduation, detailed in the Texas Essential Knowledge and Skills standard. Due to the pandemic situation, about 50% of the activities are online and the rest are face to face. About 40% of the time, teachers attended online workshops to enhance their knowledge of topics in engineering design and manufacturing before embarking on applicable research projects in the labs. Six UH COT engineering technology professors each led workshops in a week. The four tenure-track engineering mentors, assisted by student research assistants, each mentored three teachers on projects ranging from additive manufacturing to thermal/fluids, materials, and energy. The group also participated in field trips to local companies including ARC Specialties, Master Flo, Re:3D, and Forged Components. They worked with two instructional track engineering technology professors and one professor of education on applying their learnings to lesson plan design. Participants also met weekly for online Brown Bag teacher seminars to share their experiences and discuss curricula, which was organized by the RET master teacher. On the final day of the program, the teachers presented their curriculum prototype for the fall semester to the group and received completion certificates. The program assessment was led by the assessment specialist, Director of Assessment and Accreditation at UH COT. Teacher participants found the research experience with their mentors beneficial not only to them, but also to their students according to our findings from interviews. The mentors will visit their mentees’ classrooms to see the lesson plans being implemented. In the spring of 2022, the teachers will present their refined curricula at a RET symposium to be organized at UH and submit their standards-aligned plans to teachengineering.org for other K-12 educators to access. 
    more » « less
  2. Research Experience for Teachers (RET) programs have been placing K-12 teachers in university research labs for almost three decades (Pop et al., 2010). However, the long-term impacts are rarely explored. This paper summarizes data from a survey study of 135/158 teachers (88% response rate) who participated in Stanford University’s RET programs between 2005 and 2017. The purpose of the study was to gauge the lasting impact of RET, if any, on teacher retention and classroom and professional practices. The data strongly suggest that participants gain long-lasting personal and professional benefits from participation--value that seems to be especially magnified for mid- to late-career teachers who are well established in their teaching practices but committed to continuous improvement. Furthermore, if the self-reports are accurate, these results would presumably also accrue to teachers’ students. Findings are attributed to the efficacy of the RET model. The authors argue for a nationwide evaluation of the efficacy of RET for teacher retention and professional development. 
    more » « less
  3. The United Nations Sustainable Development Goals (UN SDGs) are the focus for a Research Experience for Teachers (RET) Site in Engineering at X University. The relevant and meaningful contexts of the SDGs allow middle and high school teachers and their students to easily make connections between research in a university lab setting to Science, Technology, Engineering, and Math (STEM) concepts in their classroom. Lesson plans inspired by the UN SDGs research experience were developed as an “integrated STEM” problem solving activity by each of the RET teachers. Ten (10) teachers comprising of both pre-service and in-service middle or high school teachers have participated in each cohort over the two years of the NSF RET grant thus far. Six weeks of authentic summer research takes place in 5 different faculty labs at X University under the mentorship of faculty and their graduate students or postdoc. Examples of the research projects include “Photocatalysis for Clean Energy and Environment,” “Genetically Engineering Plasmid DNA molecules to address Tuberculosis Antibiotic Resistance,” and “New Water-Based Technology for Plastic Recycling.” RET participants also attend a weekly coffee session to help guide the teachers through the research process and a weekly ½-day professional development (PD) session to translate the research experience into a classroom lesson plan that aligns to state standards, as well as evidence-backed curriculum design and teaching strategies. Teacher cohort building and community is fostered through group lunches and additional activities (e.g., coordinated lab visits, behind the scenes tour of a local science museum, and industry panel). For evaluation of the RET program, pre/post-surveys measured the teacher’s self-reported ability, confidence, understanding, and frequency of use of the Engineering Design Process (EDP), Integrated STEM, and the UN Sustainable Development Goals. Formative assessment was conducted throughout the summer on various aspects of the RET through surveys and regular check-ins with the teachers. At the end of the summer, focus groups were conducted by an external evaluator for both the teacher participants and the research mentors. Both teachers and mentors declared the program was well planned and executed. The teachers developed close bonds and connections, learned a lot from each other, had meaningful research experiences, and developed a sense of community. The research mentors reported that the teachers provided useful research contributions, were enthusiastic about the research, had genuine lab experiences, developed professional skills, and built good community connections. Areas for improvement included clear expectations for everyone, reducing steep learning curves, and consistency of mentoring across the labs. The RET program continues into the academic year with occasional meetings to report on the implementation of their research-inspired lesson plan in their classroom. The RET participants share that they are bringing in the “real world” relevance to their students with an integrated STEM lens (e.g., climate change and UN SDGs) and that they refer back to their own lab experiences (e.g., importance of measuring chemicals accurately). The research experience has made several positive impacts on the teacher participants that also benefit their students. 
    more » « less
  4. null (Ed.)
    Prekindergarten to 12th-grade teachers of computer science (CS) face many challenges, including isolation, limited CS professional development resources, and low levels of CS teaching self-efficacy that could be mitigated through communities of practice (CoPs). This study used survey data from 420 PK–12 CS teacher members of a virtual CoP, CS for All Teachers, to examine the needs of these teachers and how CS teaching self-efficacy, community engagement, and sharing behaviors vary by teachers’ instructional experiences and school levels taught. Results show that CS teachers primarily join the CoP to gain high-quality pedagogical, assessment, and instructional resources. The study also found that teachers with more CS teaching experience have higher levels of self-efficacy and are more likely to share resources than teachers with less CS teaching experience. Moreover, teachers who instruct students at higher grade levels (middle and high school) have higher levels of CS teaching self-efficacy than do teachers who instruct lower grade levels (elementary school). These results suggest that CoPs can help CS teachers expand their professional networks, gain more professional development resources, and increase CS teaching self-efficacy by creating personalized experiences that consider teaching experience and grade levels taught when guiding teachers to relevant content. This study lays the foundation for future explorations of how CS education–focused CoPs could support the expansion of CS education in PK–12 schools. 
    more » « less
  5. null (Ed.)
    Research Experience for Teachers (RET) programs are National Science Foundation (NSF) funded programs designed to provide K- 12 Science, Technology, Engineering, and Mathematics (STEM) teachers with immersive, hands-on research experiences at Universities around the country. The NSF RET in nanotechnology encourages teachers to translate cutting-edge research into culturally relevant Project-Based Learning (PjBL) and engineering curriculum. Traditionally, the evaluation of RET programs focuses on the growth and development of teacher self-efficacy, engineering content knowledge gains, or classroom implementation of developed curriculum materials. However, reported methods for evaluating the impact of RETs on their female, minority student populations' high school graduation and undergraduate STEM major rates are limited. This study's objective was to compare RET high school student graduation rates and undergraduate STEM major rates across gender, race, and ethnicity to a comparison sample to determine the RET program's long-term impact on students' likelihood of pursuing STEM careers. The approach of collecting and analyzing the Texas Education Research Center Database (EdRC) data is a novel methodology for assessing RET programs' effectiveness on students. The EdRC is a repository of K-12 student data from the Texas Education Agency (TEA) and Higher Education data from the Texas Higher Education Coordinating Board (THECB). This joint database contains demographic, course registration, graduation, standardized testing, and college major, among others, for all students that attended a K-12 public school in Texas and any college in Texas, public or private. The RET program participants at Rice University (2010 – 2018) taught numerous students, a sample size of 11,240 students. A propensity score matching generated the student comparison group within the database. Students' school campus, gender, race/ethnic status, and English proficiency status were applied to produce a graduation comparison sample size of 11,240 students of Non-RET participants. Linking the TEA database to the THECB database resulted in college STEM participants and comparison sample sizes of 4,029 students. The project team conducted a logistic regression using RET status to predict high school graduation rates as a whole and by individual variables: gender, Asian American, Black, Caucasian, and Latinx students. All models were significant at p less than 0.05, with models in favor of students RET teachers. The project team conducted a logistic regression using RET status to predict student STEM undergraduate major rates as a whole and by individual variables: Gender, Asian American, Black, Caucasian, and Latinx students. African American and Caucasian models were significant at p less than 0.05; Gender, Asian American, and Latinx models were marginally significant (0.05 less than p greater than 0.1), where RET students had higher STEM major rates than matched controls. The findings demonstrate that RET programs have a long-term positive impact on the students' high school graduation rates and undergraduate STEM major rates. As teachers who participate in the RET programs are more likely to conduct courses using PjBL strategies and incorporate real-world engineering practices, female and minority students are more likely to benefit from these practices and seek careers utilizing these skills. 
    more » « less