skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Computational Thinking Frameworks used in Computational Thinking Assessment in Higher Education. A Systematized Literature Review.
This research paper presents a literature review of Computational Thinking (CT) frameworks and assessment practices. CT is a 21st century way of solving a problem. It refers specifically to the methods that are effective when trying to solve a problem with a machine or other computational tools. In the past few years, CT researchers and educationists' significant movement started to look for a formal definition and composition of CT in K-12 and higher education. From this effort, over 20 different definitions and frameworks for CT have emerged. Although the availability of literature on CT has been increasing over the last decade, there is limited research synthesis available on how to assess CT better. Besides, it is known that in higher education designing assessments for CT is challenging and one of the primary reasons is that the precise meaning of CT is still unknown. This research paper, therefore, presents a systematized literature review on CT frameworks and assessment practice. We search three different databases and review 19 journal articles that address the assessment of CT in higher education to answer the following two research questions: 1) What does the literature inform us about practices and types of assessments used to evaluate CT in higher education? 2) Which frameworks of CT are present in literature to support CT assessment in higher education? The critical components of this review focus on frameworks and assessment practices based on CT. We develop a synthesis of suggestions and explanations to answer the proposed questions based on literature from recent research in CT. Based on our initial synthesis, we found a disconnect between theory and practice. Specifically, neither the ideas within CT frameworks nor those from CT assessment research are being utilized by the other. Therefore, there is a dire need to connect the two for practical implementation and further research in CT in higher education.  more » « less
Award ID(s):
1826099
PAR ID:
10289294
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
ASEE Annual Conference
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper examines the growing field of computational thinking (CT) in education. A review of the relevant literature shows a diversity in definitions, interventions, assessments, and models. After synthesizing various approaches used to develop the construct in K-16 settings, we have created the following working definition of CT: The conceptual foundation required to solve problems effectively and efficiently (i.e., algorithmically, with or without the assistance of computers) with solutions that are reusable in different contexts. This definition highlights that CT is primarily a way of thinking and acting, which can be exhibited through the use particular skills, which then can become the basis for performance-based assessments of CT skills. Based on the literature, we categorized CT into six main facets: decomposition, abstraction, algorithm design, debugging, iteration, and generalization. This paper shows examples of CT definitions, interventions, assessments, and models across a variety of disciplines, with a call for more extensive research in this area. 
    more » « less
  2. Research focusing on the integration of computational thinking (CT) into science, technology, engineering, and mathematics (STEM) education started to emerge. We conducted a semi-systematic literature review on 55 empirical studies on this topic. Our findings include: (a) the majority of the studies adopted domain-general definitions of CT and a few proposed domain-specific CT definitions in STEM education; (b) the most popular instructional model was problem-based instruction, and the most popular topic contexts included game design, robotics, and computational modelling; (c) while the assessments of student learning in integrated CT and STEM education targeted different objectives with different formats, about a third of them assessed integrated CT and STEM; (d) about a quarter of the studies reported differential learning processes and outcomes between groups, but very few of them investigated how pedagogical design could improve equity. Based on the findings, suggestions for future research and practice in this field are discussed in terms of operationalizing and assessing CT in STEM contexts, instructional strategies for integrating CT in STEM, and research for broadening participation in integrated CT and STEM education. 
    more » « less
  3. When President Obama unveiled his plan to give all students in America the opportunity to learn computer science [1], discussions about computational thinking (CT) began in earnest in many organizations across a wide range of disciplines. However, Jeannette Wing stated the importance of CT for everyone a decade earlier in her landmark essay [2]. In recent years, several people and organizations have posted their own definition of CT, which presents a challenge in being able to assess CT understanding and awareness in people. In an effort to build consensus on how to best assess CT, the authors are developing a web-based tool that will enable CT experts globally to populate, review and rate questions that address various attributes of CT. Teaching Engineering Concepts to Harness Future Innovators and Technologists (TECHFIT) is an NSF-funded project that is examining the impact of the TECHFIT intervention based on the educational program’s delivery context. The CT Assessment System is being developed for TECHFIT as a standard way for teacher participants to gauge CT understanding in their students. It has been designed as a functional, web-based tool that supports management of the CT assessment questions database and giving different levels of access to various stakeholders, including the TECHFIT project team and academicians all over the world. The CT Assessment System includes features to enable authorized users to review, insert, and update a variety of questions in different formats. The level of access to this system is determined by the roles/permissions granted by the administrator. It also enables users to have the ability to rate the questions. The ratings are then aggregated to yield an overall rating value. The CT Assessment system has the capability to provide a clean, authentic and acceptable way to assess CT abilities via a common platform across the world. Attendees of the paper presentation will be invited to sign up and explore this tool to provide feedback for improvement of the tool. 
    more » « less
  4. Few studies of computational thinking (CT) integration in elementary curricula have yet focused on supporting early elementary educators with implementing and assessing their young students’ application of these practices to content area work. This paper summarizes a collaborative research project that engaged researchers, K-second grade teachers, and professional development (PD) providers in implementing a hybrid PD model to answer the following research questions: (1) What kind of PD and guidance do teachers need to identify and support emergent computational thinking development in young students’ language and work process? (2) What kind of PD and guidance do teachers need to identify emergent computational thinking development in young students’ work products? This project employed a mixed-methods research design that included pre- and post-surveys and interviews with teachers to measure and understand how growth in teachers’ confidence, knowledge, and self-efficacy with CT prepared them to identify and support these concepts with young learners. Additionally, analysis was able to identify the key formative assessment strategies these teachers employed to generate insight into students’ understanding and application of CT during problem-solving. 
    more » « less
  5. Frank, Brian W.; Jones, Dyan; Ryan, Qing X. (Ed.)
    With the growing ubiquity of computation in STEM fields, understanding how to teach computational thinking (CT) practices has become an active research area in the last two decades, with particular emphasis on developing CT frameworks. In this paper, we apply one of these CT frameworks and compare the results with a task analysis to examine how CT practices relate to specific design features of an in-class problem. We have analyzed video data from two separate groups working on one computational class period, which utilizes a minimally working program to model magnetic field vectors. While still in the initial stages of the study, our preliminary results indicate that what is left out of the minimally working program will impact the CT practices students use, particularly around building computational models. Ultimately, we hope this work will help instructors to design activities that can target & build specific CT practices. 
    more » « less