skip to main content


Title: CEO: A Triangulated Evaluation of a Modeling-Based CT-Infused CS Activity for Non-CS Middle Grade Students
With the increased demand for introducing computational thinking (CT) in K-12 classrooms, educational researchers are developing integrated lesson plans that can teach CT fundamentals in non- computing specific classrooms. Although these lessons reach more students through the core curriculum, proper evaluation methods are needed to ensure the quality of the design and integration. As part of a research practice partnership, we work to infuse research- backed curricula into science courses. We find a three-pronged approach of evaluation can help us make better decisions on how to improve experimental curricula for active classrooms. This CEO model uses three data sources (student code traces, exit ticket responses, and field observations) as a triangulated approach that can be used to identify programming behavior among novice developers, preferred task ordering for the assignment, and scaffolding recommendations to teachers. This approach allows us to evaluate the practical implementations of our initiative and create a focused approach for designing more effective lessons.  more » « less
Award ID(s):
1837439 1640141
NSF-PAR ID:
10122992
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the 1st ACM Global Computing Education Conference
Page Range / eLocation ID:
58 to 64
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Despite the recent proliferation of research concerning integrating computational thinking (CT) into K-5th grade curriculum, there is little literature concerning how to evaluate the quality of CT integrated curricula, especially curricula integrating CT into language arts and social studies content areas. In this paper, we present a theoretically derived rubric for the evaluation of CT integrated curricula for grades K-5 across the curriculum (math, science, language arts, social studies). Our rubric is divided into two sections. The first section provides guidelines for identifying the integration type (disciplinary, multidisciplinary, interdisciplinary, or transdisciplinary). The second section presents six categories of evaluation that further subsume nine sub-categories. The principal categories of evaluation include the following: conceptual coherence, role of computational technology, assessment, use of multiple representations, play, and equity. We include the play category as an aspect of developmental appropriateness. Play is an important pedagogical approach for learning in the early grades. Our work takes place in the context of the Computer Science (CS) for All initiative in the United States which emphasizes the goal of improving racial and gender diversity in CS participation. Therefore, creating integrated lessons that address equity is important. Our paper describes rubric development from the theoretical perspectives that underlie the inclusion of each type, category, and sub-category. Our evaluative rubric can guide future efforts to integrate CT/CS into the elementary curricula. Researchers can utilize our rubric to evaluate and analyze CT-integrated curricula, and educators can benefit from using this rubric as a guideline for curriculum development. 
    more » « less
  2. Abstract. We investigated preservice teachers’ (PSTs) (N=13) experiences in a science teaching inquiry group professional learning experience on integrating computational thinking (CT) into elementary science. A subgroup of PSTs (n=6) participated alongside their mentor teachers. The others (n=7) participated independently. Our research question was: To what extent, if any, did participating in a professional learning experience on CT along with their mentor teachers appear to enhance PSTs’ learning and practice related to CT integration? We analyzed evaluation feedback, interviews, participant-developed lesson plans, surveys, and attendance data. Findings suggested that participants in both groups reacted positively to the learning experience’s content and approach, and expressed similar perceptions of their CT integration knowledge. PSTs participating with their mentor teachers felt slightly more successful in their CT integration efforts, and perceived CT integration as more feasible in their teaching contexts. However, differences between the groups were minimal. We also noted possible of influence of PSTs’ perceptions of the districts in which they were teaching. Our findings underscore the importance of PSTs’ perceptions of their teaching contexts when bringing a new innovation to the classroom - namely, perceptions of their mentors and curricula as supportive of the innovation. Through this ongoing work, we seek to identify empirically-supported strategies for preparing PSTs to integrate CT into their future classrooms. 
    more » « less
  3. The dearth of women and people of color in the field of computer science is a well-documented phenomenon. Following Obama's 2016 declaration of the need for a nationwide CS for All movement in the US, educators, school districts, states and the US-based National Science Foundation have responded with an explosion of activity directed at developing computer science learning opportunities in K-12 settings. A major component of this effort is the creation of equitable CS learning opportunities for underrepresented populations. As a result, there exists a strong need for educational research on the development of equity-based theory and practice in CS education. This poster session reports on a work-in-progress study that uses a case study approach to engage twenty in-service elementary school teachers in reflecting on issues of equity in CS education as part of a three-day CS professional development workshop. Our work is unfolding in the context of a four-year university/district research practice partnership in a mid-sized city in the Northeastern United States. Teachers in our project are working to co-design integrated CS curriculum units for K-5 classrooms. We developed four case studies, drawn from the first year of our project, that highlight equity challenges teachers faced in the classroom when implementing the CS lessons. The case studies follow the "Teacher Moments" template created by the Teaching Systems Lab in Open Learning at MIT. The case study activity is meant to deepen reflection and discussion on how to create equitable learning opportunities for elementary school students. We present preliminary findings. 
    more » « less
  4. In recent years, Wyoming has developed Computer Science (CS) standards for adoption and use within K-12 classrooms. These standards, adopted in January of 2022, go into effect for the 2022-2023 school year. The University of Wyoming has offered two different computer science week-long professional developments for teachers. Many K-12 teachers do not have a CS background, so developing CS lessons plans can be a challenge in these PDs.This research study is centered around three central questions: 1) To what extent did K-12 teachers integrate computing topics into their PD created lesson plans; 2) How do the teacher perceptions from the two CS PDs compare to each other; and 3) How was the CS PD translated to classroom activity? The first PD opportunity (n=14), was designed to give hands-on learning with CS topics focused on cybersecurity. The second PD opportunity (n=28), focused on integrating CS into existing curricula. At the end of each of these PDs, teacher K-12 teachers incorporated CS topics into their selected existing lesson plan(s). Additionally, a support network was implemented to support excellence in CS education throughout the state. This research study team evaluated the lesson plans developed during each PD event, by using a rubric on each lesson plan. Researchers collected exit surveys from the teachers. Implementation metrics were also gathered, including, how long each lesson lasted, how many students were involved in the implementation, what grades the student belonged to, the basic demographics of the students, the type of course the lesson plan was housed in, if the K-12 teacher reached their intended purpose, what evidence the K-12 teacher had of the success of their lesson plan, data summaries based on supplied evidence, how the K-12 teachers would change the lesson, the challenges and successes they experienced, and samples of student work. Quantitative analysis was basic descriptive statistics. Findings, based on evaluation of 40+ lessons, taught to over 1500 K-12 students, indicate that when assessed on a three point rubric of struggling, emerging, or excellent - certain components (e.g., organization, objectives, integration, activities & assessment, questions, and catch) of K-12 teacher created lessons plans varied drastically. In particular, lesson plan organization, integration, and questions each had a significant number of submissions which were evaluated as "struggling" [45%, 46%, 41%] through interesting integration, objectives, activities & assessment, and catch all saw submissions which were evaluated as "excellent" [43%, 48%, 43%, 48%]. The relationship between existing K-12 policies and expectations surfaces within these results and in combination with other findings leads to implications for the translation of current research practices into pre-collegiate PDs. 
    more » « less
  5. As the importance to integrate engineering into K12 curricula grows so does the need to develop teachers’ engineering teaching capabilities and knowledge. One method that has been used to aid this development is engineering professional development programs. This evaluation paper presents the successes and challenges of an engineering professional development program for teachers focused around the use of engineering problem-framing design activities in high school science classrooms. These activities were designed to incorporate the cross-cutting ideas published in the Next Generation Science Standards (NGSS) and draw on best practices for instructional design of problem-framing activities from research on design and model-eliciting activities (MEAs). The professional development (PD) was designed to include the following researched-based effective PD key elements: (1) is content focused, (2) incorporates active learning, (3) supports collaboration, (4) uses models of effective practice, (5) provides coaching and expert support, (6) offers feedback and reflection, and (7) is of sustained duration. The engineering PD, including in-classroom deployment of activities and data collection, was designed as an iterative process to be conducted over a three-year period. This will allow for improvement and refinement of our approach. The first iteration, reported in this paper, consisted of seven high school science teachers who have agreed to participate in the PD, implement the problem-framing activities, and collect student data over a period of one year. The PD itself consisted of the teachers comparing science and engineering, participating in problem-framing training and activities, and developing a design challenge scenario for their own courses. The participating teachers completed a survey at the end of the PD that will be used to inform enhancement of the PD and our efforts to recruit additional participants in the following year. The qualitative survey consisted of open-ended questions asking for the most valuable takeaways from the PD, their reasoning for joining the PD, reasons they would or would not recommend the PD, and, in their opinion, what would inspire their colleagues to attend the PD. The responses to the survey along with observations from the team presenting the PD were analyzed to identify lessons learned and future steps for the following iteration of the PD. From the data, three themes emerged: Development of PD, Teacher Motivation, and Teacher Experience. 
    more » « less