- NSF-PAR ID:
- 10054119
- Date Published:
- Journal Name:
- Educational research review
- Volume:
- 22
- ISSN:
- 1747-938X
- Page Range / eLocation ID:
- 142-158
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
null (Ed.)This research paper presents a literature review of Computational Thinking (CT) frameworks and assessment practices. CT is a 21st century way of solving a problem. It refers specifically to the methods that are effective when trying to solve a problem with a machine or other computational tools. In the past few years, CT researchers and educationists' significant movement started to look for a formal definition and composition of CT in K-12 and higher education. From this effort, over 20 different definitions and frameworks for CT have emerged. Although the availability of literature on CT has been increasing over the last decade, there is limited research synthesis available on how to assess CT better. Besides, it is known that in higher education designing assessments for CT is challenging and one of the primary reasons is that the precise meaning of CT is still unknown. This research paper, therefore, presents a systematized literature review on CT frameworks and assessment practice. We search three different databases and review 19 journal articles that address the assessment of CT in higher education to answer the following two research questions: 1) What does the literature inform us about practices and types of assessments used to evaluate CT in higher education? 2) Which frameworks of CT are present in literature to support CT assessment in higher education? The critical components of this review focus on frameworks and assessment practices based on CT. We develop a synthesis of suggestions and explanations to answer the proposed questions based on literature from recent research in CT. Based on our initial synthesis, we found a disconnect between theory and practice. Specifically, neither the ideas within CT frameworks nor those from CT assessment research are being utilized by the other. Therefore, there is a dire need to connect the two for practical implementation and further research in CT in higher education.more » « less
-
Research focusing on the integration of computational thinking (CT) into science, technology, engineering, and mathematics (STEM) education started to emerge. We conducted a semi-systematic literature review on 55 empirical studies on this topic. Our findings include: (a) the majority of the studies adopted domain-general definitions of CT and a few proposed domain-specific CT definitions in STEM education; (b) the most popular instructional model was problem-based instruction, and the most popular topic contexts included game design, robotics, and computational modelling; (c) while the assessments of student learning in integrated CT and STEM education targeted different objectives with different formats, about a third of them assessed integrated CT and STEM; (d) about a quarter of the studies reported differential learning processes and outcomes between groups, but very few of them investigated how pedagogical design could improve equity. Based on the findings, suggestions for future research and practice in this field are discussed in terms of operationalizing and assessing CT in STEM contexts, instructional strategies for integrating CT in STEM, and research for broadening participation in integrated CT and STEM education.more » « less
-
null (Ed.)While systems engineers rely on systems thinking skills in their work, given the increasing complexity of modern engineering problems, engineers across disciplines need to be able to engage in systems thinking, including what we term comprehensive systems thinking. Due to the inherent complexity of systems thinking, and more specifically comprehensive systems thinking, it is not easy to know how well students (and practitioners) are learning and leveraging systems thinking approaches. Thus, engineering managers and educators can benefit from systems thinking assessments. A variety of systems thinking assessments exist that are relevant to engineers, including some focused on the demonstration of systems thinking knowledge or skills and others measuring attitudes, interests, or values related to systems thinking. Starting with a collection of systems thinking assessments from a systematic literature review conducted by our team, we analyzed in-depth those behavior-based assessments that included the creation of a visual representation and were open-ended, i.e., it did not presuppose or provide answers. The findings from this in-depth analysis of systems thinking behavior-based assessments identified 1) six visualization types that were leveraged, 2) dimensions of systems thinking that were assessed and 3) tensions between the affordances of different assessments. In addition, we consider the ways assessments can be used. For example, using assessments to provide feedback to students or using assessments to determine which students are meeting defined learning goals. We draw on our findings to highlight opportunities for future comprehensive systems thinking behavior-based assessment development.more » « less
-
Computational Thinking (CT) can play a central role in fostering students' integrated learning of science and engineering. We adopt this framework to design and develop the Water Runoff Challenge (WRC) curriculum for lower middle school students in the USA. This paper presents (1) the WRC curriculum implemented in an integrated computational modeling and engineering design environment and (2) formative and summative assessments used to evaluate learner’s science, engineering, and CT skills as they progress through the curriculum. We derived a series of performance measures associated with student learning from system log data and the assessments. By applying Path Analysis we found significant relations between measures of science, engineering, and CT learning, indicating that they are mutually supportive of learning across these disciplines.more » « less
-
Abstract We face complex global issues such as climate change that challenge our ability as humans to manage them. Models have been used as a pivotal science and engineering tool to investigate, represent, explain, and predict phenomena or solve problems that involve multi-faceted systems across many fields. To fully explain complex phenomena or solve problems using models requires both systems thinking (ST) and computational thinking (CT). This study proposes a theoretical framework that uses modeling as a way to integrate ST and CT. We developed a framework to guide the complex process of developing curriculum, learning tools, support strategies, and assessments for engaging learners in ST and CT in the context of modeling. The framework includes essential aspects of ST and CT based on selected literature, and illustrates how each modeling practice draws upon aspects of both ST and CT to support explaining phenomena and solving problems. We use computational models to show how these ST and CT aspects are manifested in modeling.