More Like this

1. Lessons Learned through Educational Research of a National Science Foundation Research Experiences for Undergraduates

   Colaninno, Carol E. ( April 2020 , Journal of archaeology and education)

   null (Ed.)

   Participation in an archaeological field school is the entry point to a professional career in the discipline. Despite the importance of field schools, few scholars have investigated achieved student-learning outcomes or lasting impacts on students from participation in archaeological field research. We report on the educational design, learning objectives, and results of three years of formative and summative assessments for an interdisciplinary, archaeology and ecology research program for undergraduate students. Our learning objectives include promoting scientific literacy and communication, critical thinking and STEM skills, and capacities in archaeological and ecological interdisciplinarity. Using developed rubrics that account for both critical thinking and STEM understanding, self-administered competency surveys, and program-developed items, we found significant gains in nearly all learning objectives. Students demonstrated growth in program specific content, perceived abilities in their scientific and discipline specific skills, critical thinking skills, and scientific communication skills. These educational outcomes and assessment tools have implications for how we design and evaluate field learning in archaeology and may be applied to field school instruction. 

   more » « less
2. Assessing the Impact of an REU Program on Students’ Intellectual Growth and Interest in Graduate School in Cybermanufacturing

   https://doi.org/10.18260/1-2--34183  

   Moturu, Pavan Kumar ; Nepal, Bimal ; Pagilla, Prabhakar ; Bukkapatnam, Satish ( June 2020 , 2020 ASEE Virtual Annual Conference)

   null (Ed.)

   Advancements in information technology and computational intelligence have transformed the manufacturing landscape, allowing firms to produce highly complex and customized product in a relatively short amount of time. However, our research shows that the lack of a skilled workforce remains a challenge in the manufacturing industry. To that end, providing research experience to undergraduates has been widely reported as a very effective approach to attract students to industry or graduate education in engineering and other STEM-based majors. This paper presents assessment results of two cohorts of Cybermanufacturing REU at a major university. Students were recruited from across the United States majoring in multiple engineering fields, such as industrial engineering, mechanical engineering, chemical engineering, mechatronics, manufacturing, and computer science. Several of the participants were rising sophomores or juniors who did not have any industry internship or prior research experience. In total 20 students (ten per year) participated in the program and worked on individual project topics under the guidance of faculty and graduate student mentors. Unlike a typical REU program, the Cybermanufacturing REU involved a few unique activities, such as a 48-hour intense design and prototype build experience (also known as Aggies Invent), industry seminars, and industry visits. Overall, the REU students demonstrated significant gains in all of the twelve research-related competencies that were assessed as a part of formative and summative evaluation process. While almost all of them wanted to pursue a career in advanced manufacturing, including Cybermanufacturing, the majority of the participants preferred industry over graduate school. The paper provides an in-depth discussion on the findings of the REU program evaluation and its impact on undergraduate students with respect to their future plans and career choice. The analysis is also done by gender, ethnicity, academic level (sophomore, junior, senior), and type of home institution (e.g., large research universities, rural and small schools) to explore if there was any significant difference in mean research competency scores based on these attributes. 

   more » « less
3. Impacts of a Sustainability-Focused REU Site on Student Products and Career Trajectory for Underrepresented Groups in Engineering

   Wittich, C.E. ; Bartelt-Hunt, S. ( June 2022 , 2022 ASEE Annual Conference & Exposition)

   This paper summarizes the overall approach and assessment of a National Science Foundation Research Experience for Undergraduates Site focused on sustainable civil and environmental infrastructure in rural areas. This site has hosted over 60 students over 5 years, including 1 year of virtual participation due to travel restrictions associated with the COVID-19 pandemic. Detailed discussion and results are provided with respect to the recruitment approach, including particular attention to first-generation college students, and the potential negative impacts of the COVID-19 pandemic on first-generation applicants. This site also incorporates targeted instruction on technical writing, which occurs over several weeks throughout the first half of the summer and culminates with a final conference paper deliverable. This approach has yielded over 20 peer-reviewed journal articles, conference papers, or national conference presentations, which have been co-authored by the undergraduate student participants. External evaluation of this site has included both formative and summative assessments, including pre-program, mid-program, and post-program surveys and focus groups, which has enabled a successful continuous improvement cycle, in which cohort-building activities, technical writing deliverables, and mentor training have been gradually incorporated or enhanced. Results of this assessment have also been used to quantify the site’s success with respect to student exposure and interest in research and graduate education. In addition to most participants persisting in STEM fields, many have gone on to pursue graduate school in civil and environmental engineering and win national fellowships. 

   more » « less
4. Toward A Framework for Formative Assessment of Conceptual Learning in K-12 Computer Science Classrooms

   https://doi.org/10.1145/3408877.3432460  

   Grover, Shuchi ( March 2021 , 52nd ACM Technical Symposium on Computer Science Education (SIGCSE ’21))

   null (Ed.)

   Unlike summative assessment that is aimed at grading students at the end of a unit or academic term, formative assessment is assess- ment for learning, aimed at monitoring ongoing student learning to provide feedback to both student and teacher, so that learning gaps can be addressed during the learning process. Education research points to formative assessment as a crucial vehicle for improving student learning. Formative assessment in K-12 CS and program- ming classrooms remains a crucial unaddressed need. Given that assessment for learning is closely tied to teacher pedagogical con- tent knowledge, formative assessment literacy needs to also be a topic of CS teacher PD. This position paper addresses the broad need to understand formative assessment and build a framework to understand the what, why, and how of formative assessment of introductory programming in K-12 CS. It shares specific pro- gramming examples to articulate the cycle of formative assessment, diagnostic evaluation, feedback, and action. The design of formative assessment items is informed by CS research on assessment design, albeit related largely to summative assessment and in CS1 contexts, and learning of programming, especially student misconceptions. It describes what teacher formative assessment literacy PD should entail and how to catalyze assessment-focused collaboration among K-12 CS teachers through assessment platforms and repositories. 

   more » « less
5. Predicting student science achievement using post‐unit assessment performances in a coherent high school chemistry project‐based learning system

   https://doi.org/10.1002/tea.21815  

   He, Peng ; Chen, I‐Chien ; Touitou, Israel ; Bartz, Kayla ; Schneider, Barbara ; Krajcik, Joseph ( September 2022 , Journal of Research in Science Teaching)

   Student science proficiency development demands sustainable and coherent learning environment support. Scholars argue that project‐based learning (PBL) is an efficient approach to promoting student science learning, compared to conventional instructions. Yet, few studies have delved into the learning process to explore how a coherent PBL system consisting of curriculum, instruction, assessment, and professional learning promotes student learning. To address the gap, this study investigated whether students' science proficiency on the three post‐unit assessments predicted their achievement on a third‐party‐designed end‐of‐year summative science test in a coherent high school chemistry PBL system aligned with the recent US science standards. The study employed a cluster randomized experimental design to test an intervention using our PBL system and only used data from the treatment group. The sample consisted of 1344 treatment students who participated in our PBL intervention and underwent the pretest and end‐of‐year summative test. Students' responses to the three post‐unit assessments were selected and rated to indicate their science proficiency. Two‐level hierarchical linear models were employed to explore the effects of students' performances of three post‐unit assessments on their end‐of‐year summative achievement, considering and controlling for student prior knowledge (i.e., pretest and prior post‐unit assessments). This study suggests two main findings. First, students' science proficiency in the three units could cumulatively and individually predict their summative science achievement. Second, students' performances on the two types of tasks (i.e., developing and using models) in the three post‐unit assessments could also be used to predict their summative science achievement. This research contributes to the field by showing that a coherent standards‐aligned PBL system can significantly and sustainably impact student science proficiency development.

    

   more » « less